May 25 03:08:36 oleg425-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 May 25 03:08:36 oleg425-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:08:36 oleg425-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' May 25 03:08:36 oleg425-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' May 25 03:08:36 oleg425-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' May 25 03:08:36 oleg425-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 May 25 03:08:36 oleg425-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. May 25 03:08:36 oleg425-client kernel: signal: max sigframe size: 1776 May 25 03:08:36 oleg425-client kernel: BIOS-provided physical RAM map: May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved May 25 03:08:36 oleg425-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable May 25 03:08:36 oleg425-client kernel: NX (Execute Disable) protection: active May 25 03:08:36 oleg425-client kernel: SMBIOS 2.8 present. May 25 03:08:36 oleg425-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 May 25 03:08:36 oleg425-client kernel: Hypervisor detected: KVM May 25 03:08:36 oleg425-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 May 25 03:08:36 oleg425-client kernel: kvm-clock: using sched offset of 467941235 cycles May 25 03:08:36 oleg425-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns May 25 03:08:36 oleg425-client kernel: tsc: Detected 2399.998 MHz processor May 25 03:08:36 oleg425-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved May 25 03:08:36 oleg425-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable May 25 03:08:36 oleg425-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 May 25 03:08:36 oleg425-client kernel: MTRR default type: write-back May 25 03:08:36 oleg425-client kernel: MTRR fixed ranges enabled: May 25 03:08:36 oleg425-client kernel: 00000-9FFFF write-back May 25 03:08:36 oleg425-client kernel: A0000-BFFFF uncachable May 25 03:08:36 oleg425-client kernel: C0000-FFFFF write-protect May 25 03:08:36 oleg425-client kernel: MTRR variable ranges enabled: May 25 03:08:36 oleg425-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable May 25 03:08:36 oleg425-client kernel: 1 disabled May 25 03:08:36 oleg425-client kernel: 2 disabled May 25 03:08:36 oleg425-client kernel: 3 disabled May 25 03:08:36 oleg425-client kernel: 4 disabled May 25 03:08:36 oleg425-client kernel: 5 disabled May 25 03:08:36 oleg425-client kernel: 6 disabled May 25 03:08:36 oleg425-client kernel: 7 disabled May 25 03:08:36 oleg425-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT May 25 03:08:36 oleg425-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 May 25 03:08:36 oleg425-client kernel: found SMP MP-table at [mem 0x000f54d0-0x000f54df] May 25 03:08:36 oleg425-client kernel: BRK [0x44c01000, 0x44c01fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c02000, 0x44c02fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c03000, 0x44c03fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c04000, 0x44c04fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c05000, 0x44c05fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c06000, 0x44c06fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c07000, 0x44c07fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c08000, 0x44c08fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c09000, 0x44c09fff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c0a000, 0x44c0afff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c0b000, 0x44c0bfff] PGTABLE May 25 03:08:36 oleg425-client kernel: BRK [0x44c0c000, 0x44c0cfff] PGTABLE May 25 03:08:36 oleg425-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] May 25 03:08:36 oleg425-client kernel: ACPI: Early table checksum verification disabled May 25 03:08:36 oleg425-client kernel: ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) May 25 03:08:36 oleg425-client kernel: ACPI: RSDT 0x00000000BFFE2464 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: FACP 0x00000000BFFE2300 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: DSDT 0x00000000BFFE0040 0022C0 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 May 25 03:08:36 oleg425-client kernel: ACPI: APIC 0x00000000BFFE2374 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: HPET 0x00000000BFFE2404 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: WAET 0x00000000BFFE243C 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:08:36 oleg425-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe2300-0xbffe2373] May 25 03:08:36 oleg425-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22ff] May 25 03:08:36 oleg425-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] May 25 03:08:36 oleg425-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe2374-0xbffe2403] May 25 03:08:36 oleg425-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe2404-0xbffe243b] May 25 03:08:36 oleg425-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe243c-0xbffe2463] May 25 03:08:36 oleg425-client kernel: ACPI: Local APIC address 0xfee00000 May 25 03:08:36 oleg425-client kernel: No NUMA configuration found May 25 03:08:36 oleg425-client kernel: Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] May 25 03:08:36 oleg425-client kernel: NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] May 25 03:08:36 oleg425-client kernel: Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) May 25 03:08:36 oleg425-client kernel: Zone ranges: May 25 03:08:36 oleg425-client kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] May 25 03:08:36 oleg425-client kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] May 25 03:08:36 oleg425-client kernel: Normal [mem 0x0000000100000000-0x0000000146dfffff] May 25 03:08:36 oleg425-client kernel: Device empty May 25 03:08:36 oleg425-client kernel: Movable zone start for each node May 25 03:08:36 oleg425-client kernel: Early memory node ranges May 25 03:08:36 oleg425-client kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] May 25 03:08:36 oleg425-client kernel: node 0: [mem 0x0000000000100000-0x00000000bffd9fff] May 25 03:08:36 oleg425-client kernel: node 0: [mem 0x0000000100000000-0x0000000146dfffff] May 25 03:08:36 oleg425-client kernel: Zeroed struct page in unavailable ranges: 4744 pages May 25 03:08:36 oleg425-client kernel: Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] May 25 03:08:36 oleg425-client kernel: On node 0 totalpages: 1076600 May 25 03:08:36 oleg425-client kernel: DMA zone: 64 pages used for memmap May 25 03:08:36 oleg425-client kernel: DMA zone: 158 pages reserved May 25 03:08:36 oleg425-client kernel: DMA zone: 3998 pages, LIFO batch:0 May 25 03:08:36 oleg425-client kernel: DMA32 zone: 12224 pages used for memmap May 25 03:08:36 oleg425-client kernel: DMA32 zone: 782298 pages, LIFO batch:63 May 25 03:08:36 oleg425-client kernel: Normal zone: 4536 pages used for memmap May 25 03:08:36 oleg425-client kernel: Normal zone: 290304 pages, LIFO batch:63 May 25 03:08:36 oleg425-client kernel: ACPI: PM-Timer IO Port: 0x608 May 25 03:08:36 oleg425-client kernel: ACPI: Local APIC address 0xfee00000 May 25 03:08:36 oleg425-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) May 25 03:08:36 oleg425-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 May 25 03:08:36 oleg425-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) May 25 03:08:36 oleg425-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) May 25 03:08:36 oleg425-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) May 25 03:08:36 oleg425-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) May 25 03:08:36 oleg425-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) May 25 03:08:36 oleg425-client kernel: ACPI: IRQ0 used by override. May 25 03:08:36 oleg425-client kernel: ACPI: IRQ5 used by override. May 25 03:08:36 oleg425-client kernel: ACPI: IRQ9 used by override. May 25 03:08:36 oleg425-client kernel: ACPI: IRQ10 used by override. May 25 03:08:36 oleg425-client kernel: ACPI: IRQ11 used by override. May 25 03:08:36 oleg425-client kernel: Using ACPI (MADT) for SMP configuration information May 25 03:08:36 oleg425-client kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000 May 25 03:08:36 oleg425-client kernel: TSC deadline timer available May 25 03:08:36 oleg425-client kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs May 25 03:08:36 oleg425-client kernel: kvm-guest: KVM setup pv remote TLB flush May 25 03:08:36 oleg425-client kernel: kvm-guest: setup PV sched yield May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] May 25 03:08:36 oleg425-client kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] May 25 03:08:36 oleg425-client kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices May 25 03:08:36 oleg425-client kernel: Booting paravirtualized kernel on KVM May 25 03:08:36 oleg425-client kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns May 25 03:08:36 oleg425-client kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 May 25 03:08:36 oleg425-client kernel: percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 May 25 03:08:36 oleg425-client kernel: pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 May 25 03:08:36 oleg425-client kernel: pcpu-alloc: [0] 0 1 2 3 May 25 03:08:36 oleg425-client kernel: kvm-guest: PV spinlocks enabled May 25 03:08:36 oleg425-client kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) May 25 03:08:36 oleg425-client kernel: Built 1 zonelists, mobility grouping on. Total pages: 1059618 May 25 03:08:36 oleg425-client kernel: Policy zone: Normal May 25 03:08:36 oleg425-client kernel: Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:08:36 oleg425-client kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. May 25 03:08:36 oleg425-client kernel: audit: disabled (until reboot) May 25 03:08:36 oleg425-client kernel: software IO TLB: area num 4. May 25 03:08:36 oleg425-client kernel: Memory: 2829700K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524584K reserved, 0K cma-reserved) May 25 03:08:36 oleg425-client kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 May 25 03:08:36 oleg425-client kernel: kmemleak: Kernel memory leak detector disabled May 25 03:08:36 oleg425-client kernel: ftrace: allocating 41240 entries in 162 pages May 25 03:08:36 oleg425-client kernel: ftrace: allocated 162 pages with 3 groups May 25 03:08:36 oleg425-client kernel: rcu: Hierarchical RCU implementation. May 25 03:08:36 oleg425-client kernel: rcu: #011RCU event tracing is enabled. May 25 03:08:36 oleg425-client kernel: rcu: #011RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. May 25 03:08:36 oleg425-client kernel: rcu: #011RCU callback double-/use-after-free debug enabled. May 25 03:08:36 oleg425-client kernel: #011Rude variant of Tasks RCU enabled. May 25 03:08:36 oleg425-client kernel: #011Tracing variant of Tasks RCU enabled. May 25 03:08:36 oleg425-client kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. May 25 03:08:36 oleg425-client kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 May 25 03:08:36 oleg425-client kernel: NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 May 25 03:08:36 oleg425-client kernel: random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 May 25 03:08:36 oleg425-client kernel: Console: colour *CGA 80x25 May 25 03:08:36 oleg425-client kernel: printk: console [ttyS1] enabled May 25 03:08:36 oleg425-client kernel: ACPI: Core revision 20220331 May 25 03:08:36 oleg425-client kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns May 25 03:08:36 oleg425-client kernel: hpet clockevent registered May 25 03:08:36 oleg425-client kernel: APIC: Switch to symmetric I/O mode setup May 25 03:08:36 oleg425-client kernel: x2apic enabled May 25 03:08:36 oleg425-client kernel: Switched APIC routing to physical x2apic. May 25 03:08:36 oleg425-client kernel: kvm-guest: setup PV IPIs May 25 03:08:36 oleg425-client kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 May 25 03:08:36 oleg425-client kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns May 25 03:08:36 oleg425-client kernel: Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) May 25 03:08:36 oleg425-client kernel: pid_max: default: 32768 minimum: 301 May 25 03:08:36 oleg425-client kernel: LSM: Security Framework initializing May 25 03:08:36 oleg425-client kernel: Yama: becoming mindful. May 25 03:08:36 oleg425-client kernel: SELinux: Initializing. May 25 03:08:36 oleg425-client kernel: *** VALIDATE selinux *** May 25 03:08:36 oleg425-client kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: *** VALIDATE tmpfs *** May 25 03:08:36 oleg425-client kernel: *** VALIDATE proc *** May 25 03:08:36 oleg425-client kernel: *** VALIDATE cgroup *** May 25 03:08:36 oleg425-client kernel: *** VALIDATE cgroup2 *** May 25 03:08:36 oleg425-client kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated May 25 03:08:36 oleg425-client kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 May 25 03:08:36 oleg425-client kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 May 25 03:08:36 oleg425-client kernel: Spectre V2 : User space: Vulnerable May 25 03:08:36 oleg425-client kernel: Speculative Store Bypass: Vulnerable May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffffff8de59000-0xffffffff8de60fff] May 25 03:08:36 oleg425-client kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) May 25 03:08:36 oleg425-client kernel: Performance Events: IvyBridge events, full-width counters, Intel PMU driver. May 25 03:08:36 oleg425-client kernel: ... version: 2 May 25 03:08:36 oleg425-client kernel: ... bit width: 48 May 25 03:08:36 oleg425-client kernel: ... generic registers: 4 May 25 03:08:36 oleg425-client kernel: ... value mask: 0000ffffffffffff May 25 03:08:36 oleg425-client kernel: ... max period: 00007fffffffffff May 25 03:08:36 oleg425-client kernel: ... fixed-purpose events: 3 May 25 03:08:36 oleg425-client kernel: ... event mask: 000000070000000f May 25 03:08:36 oleg425-client kernel: rcu: Hierarchical SRCU implementation. May 25 03:08:36 oleg425-client kernel: smp: Bringing up secondary CPUs ... May 25 03:08:36 oleg425-client kernel: x86: Booting SMP configuration: May 25 03:08:36 oleg425-client kernel: .... node #0, CPUs: #1 #2 #3 May 25 03:08:36 oleg425-client kernel: smp: Brought up 1 node, 4 CPUs May 25 03:08:36 oleg425-client kernel: smpboot: Max logical packages: 1 May 25 03:08:36 oleg425-client kernel: smpboot: Total of 4 processors activated (19199.98 BogoMIPS) May 25 03:08:36 oleg425-client kernel: node 0 deferred pages initialised in 43ms May 25 03:08:36 oleg425-client kernel: devtmpfs: initialized May 25 03:08:36 oleg425-client kernel: x86/mm: Memory block size: 128MB May 25 03:08:36 oleg425-client kernel: gcov: version magic: 0x41383552 May 25 03:08:36 oleg425-client kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns May 25 03:08:36 oleg425-client kernel: futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: pinctrl core: initialized pinctrl subsystem May 25 03:08:36 oleg425-client kernel: May 25 03:08:36 oleg425-client kernel: ************************************************************* May 25 03:08:36 oleg425-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** May 25 03:08:36 oleg425-client kernel: ** ** May 25 03:08:36 oleg425-client kernel: ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** May 25 03:08:36 oleg425-client kernel: ** ** May 25 03:08:36 oleg425-client kernel: ** This means that this kernel is built to expose internal ** May 25 03:08:36 oleg425-client kernel: ** IOMMU data structures, which may compromise security on ** May 25 03:08:36 oleg425-client kernel: ** your system. ** May 25 03:08:36 oleg425-client kernel: ** ** May 25 03:08:36 oleg425-client kernel: ** If you see this message and you are not debugging the ** May 25 03:08:36 oleg425-client kernel: ** kernel, report this immediately to your vendor! ** May 25 03:08:36 oleg425-client kernel: ** ** May 25 03:08:36 oleg425-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** May 25 03:08:36 oleg425-client kernel: ************************************************************* May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 16 May 25 03:08:36 oleg425-client kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations May 25 03:08:36 oleg425-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations May 25 03:08:36 oleg425-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations May 25 03:08:36 oleg425-client kernel: cpuidle: using governor menu May 25 03:08:36 oleg425-client kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 May 25 03:08:36 oleg425-client kernel: PCI: Using configuration type 1 for base access May 25 03:08:36 oleg425-client kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on May 25 03:08:36 oleg425-client kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages May 25 03:08:36 oleg425-client kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages May 25 03:08:36 oleg425-client kernel: cryptd: max_cpu_qlen set to 1000 May 25 03:08:36 oleg425-client kernel: ACPI: Added _OSI(Module Device) May 25 03:08:36 oleg425-client kernel: ACPI: Added _OSI(Processor Device) May 25 03:08:36 oleg425-client kernel: ACPI: Added _OSI(3.0 _SCP Extensions) May 25 03:08:36 oleg425-client kernel: ACPI: Added _OSI(Processor Aggregator Device) May 25 03:08:36 oleg425-client kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded May 25 03:08:36 oleg425-client kernel: ACPI: Interpreter enabled May 25 03:08:36 oleg425-client kernel: ACPI: PM: (supports S0 S3 S4 S5) May 25 03:08:36 oleg425-client kernel: ACPI: Using IOAPIC for interrupt routing May 25 03:08:36 oleg425-client kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug May 25 03:08:36 oleg425-client kernel: ACPI: Enabled 2 GPEs in block 00 to 0F May 25 03:08:36 oleg425-client kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) May 25 03:08:36 oleg425-client kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] May 25 03:08:36 oleg425-client kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] May 25 03:08:36 oleg425-client kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [2] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [5] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [6] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [3] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [4] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [7] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [8] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [9] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [10] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [11] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [12] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [13] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [14] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [15] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [16] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [17] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [18] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [19] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [20] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [21] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [22] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [23] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [24] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [25] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [26] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [27] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [28] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [29] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [30] registered May 25 03:08:36 oleg425-client kernel: acpiphp: Slot [31] registered May 25 03:08:36 oleg425-client kernel: PCI host bridge to bus 0000:00 May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: root bus resource [bus 00-ff] May 25 03:08:36 oleg425-client kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB May 25 03:08:36 oleg425-client kernel: pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 May 25 03:08:36 oleg425-client kernel: pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] May 25 03:08:36 oleg425-client kernel: pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] May 25 03:08:36 oleg425-client kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] May 25 03:08:36 oleg425-client kernel: pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 May 25 03:08:36 oleg425-client kernel: pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] May 25 03:08:36 oleg425-client kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] May 25 03:08:36 oleg425-client kernel: pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] May 25 03:08:36 oleg425-client kernel: pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 May 25 03:08:36 oleg425-client kernel: pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] May 25 03:08:36 oleg425-client kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] May 25 03:08:36 oleg425-client kernel: pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] May 25 03:08:36 oleg425-client kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 May 25 03:08:36 oleg425-client kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 May 25 03:08:36 oleg425-client kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 May 25 03:08:36 oleg425-client kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 May 25 03:08:36 oleg425-client kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 May 25 03:08:36 oleg425-client kernel: iommu: Default domain type: Passthrough May 25 03:08:36 oleg425-client kernel: SCSI subsystem initialized May 25 03:08:36 oleg425-client kernel: ACPI: bus type USB registered May 25 03:08:36 oleg425-client kernel: usbcore: registered new interface driver usbfs May 25 03:08:36 oleg425-client kernel: usbcore: registered new interface driver hub May 25 03:08:36 oleg425-client kernel: usbcore: registered new device driver usb May 25 03:08:36 oleg425-client kernel: pps_core: LinuxPPS API ver. 1 registered May 25 03:08:36 oleg425-client kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti May 25 03:08:36 oleg425-client kernel: PTP clock support registered May 25 03:08:36 oleg425-client kernel: EDAC MC: Ver: 3.0.0 May 25 03:08:36 oleg425-client kernel: PCI: Using ACPI for IRQ routing May 25 03:08:36 oleg425-client kernel: PCI: pci_cache_line_size set to 64 bytes May 25 03:08:36 oleg425-client kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] May 25 03:08:36 oleg425-client kernel: e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] May 25 03:08:36 oleg425-client kernel: e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] May 25 03:08:36 oleg425-client kernel: NetLabel: Initializing May 25 03:08:36 oleg425-client kernel: NetLabel: domain hash size = 128 May 25 03:08:36 oleg425-client kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO May 25 03:08:36 oleg425-client kernel: NetLabel: unlabeled traffic allowed by default May 25 03:08:36 oleg425-client kernel: vgaarb: loaded May 25 03:08:36 oleg425-client kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 May 25 03:08:36 oleg425-client kernel: hpet0: 3 comparators, 64-bit 100.000000 MHz counter May 25 03:08:36 oleg425-client kernel: clocksource: Switched to clocksource kvm-clock May 25 03:08:36 oleg425-client kernel: VFS: Disk quotas dquot_6.6.0 May 25 03:08:36 oleg425-client kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) May 25 03:08:36 oleg425-client kernel: *** VALIDATE ramfs *** May 25 03:08:36 oleg425-client kernel: *** VALIDATE hugetlbfs *** May 25 03:08:36 oleg425-client kernel: pnp: PnP ACPI init May 25 03:08:36 oleg425-client kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) May 25 03:08:36 oleg425-client kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) May 25 03:08:36 oleg425-client kernel: pnp 00:02: [dma 2] May 25 03:08:36 oleg425-client kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) May 25 03:08:36 oleg425-client kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) May 25 03:08:36 oleg425-client kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) May 25 03:08:36 oleg425-client kernel: pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) May 25 03:08:36 oleg425-client kernel: pnp: PnP ACPI: found 6 devices May 25 03:08:36 oleg425-client kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] May 25 03:08:36 oleg425-client kernel: pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 2 May 25 03:08:36 oleg425-client kernel: IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: TCP: Hash tables configured (established 65536 bind 65536) May 25 03:08:36 oleg425-client kernel: MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 1 May 25 03:08:36 oleg425-client kernel: RPC: Registered named UNIX socket transport module. May 25 03:08:36 oleg425-client kernel: RPC: Registered udp transport module. May 25 03:08:36 oleg425-client kernel: RPC: Registered tcp transport module. May 25 03:08:36 oleg425-client kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 44 May 25 03:08:36 oleg425-client kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release May 25 03:08:36 oleg425-client kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds May 25 03:08:36 oleg425-client kernel: PCI: CLS 0 bytes, default 64 May 25 03:08:36 oleg425-client kernel: Unpacking initramfs... May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffa09abcc64000-0xffffa09abffcffff] May 25 03:08:36 oleg425-client kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) May 25 03:08:36 oleg425-client kernel: software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) May 25 03:08:36 oleg425-client kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns May 25 03:08:36 oleg425-client kernel: Initialise system trusted keyrings May 25 03:08:36 oleg425-client kernel: Key type blacklist registered May 25 03:08:36 oleg425-client kernel: workingset: timestamp_bits=36 max_order=20 bucket_order=0 May 25 03:08:36 oleg425-client kernel: zbud: loaded May 25 03:08:36 oleg425-client kernel: *** VALIDATE nfs *** May 25 03:08:36 oleg425-client kernel: *** VALIDATE nfs4 *** May 25 03:08:36 oleg425-client kernel: pstore: using deflate compression May 25 03:08:36 oleg425-client kernel: Platform Keyring initialized May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 38 May 25 03:08:36 oleg425-client kernel: Key type asymmetric registered May 25 03:08:36 oleg425-client kernel: Asymmetric key parser 'x509' registered May 25 03:08:36 oleg425-client kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) May 25 03:08:36 oleg425-client kernel: io scheduler mq-deadline registered May 25 03:08:36 oleg425-client kernel: io scheduler kyber registered May 25 03:08:36 oleg425-client kernel: io scheduler bfq registered May 25 03:08:36 oleg425-client kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE May 25 03:08:36 oleg425-client kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 May 25 03:08:36 oleg425-client kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 May 25 03:08:36 oleg425-client kernel: ACPI: Power Button [PWRF] May 25 03:08:36 oleg425-client kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 May 25 03:08:36 oleg425-client kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 11 May 25 03:08:36 oleg425-client kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled May 25 03:08:36 oleg425-client kernel: 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A May 25 03:08:36 oleg425-client kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A May 25 03:08:36 oleg425-client kernel: Non-volatile memory driver v1.3 May 25 03:08:36 oleg425-client kernel: Linux agpgart interface v0.103 May 25 03:08:36 oleg425-client kernel: virtio_blk virtio1: [vda] 134776 512-byte logical blocks (69.0 MB/65.8 MiB) May 25 03:08:36 oleg425-client kernel: vda: detected capacity change from 0 to 69005312 May 25 03:08:36 oleg425-client kernel: virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) May 25 03:08:36 oleg425-client kernel: vdb: detected capacity change from 0 to 1073741824 May 25 03:08:36 oleg425-client kernel: libphy: Fixed MDIO Bus: probed May 25 03:08:36 oleg425-client kernel: usbcore: registered new interface driver usbserial_generic May 25 03:08:36 oleg425-client kernel: usbserial: USB Serial support registered for generic May 25 03:08:36 oleg425-client kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 May 25 03:08:36 oleg425-client kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 May 25 03:08:36 oleg425-client kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 May 25 03:08:36 oleg425-client kernel: mousedev: PS/2 mouse device common for all mice May 25 03:08:36 oleg425-client kernel: rtc_cmos 00:05: RTC can wake from S4 May 25 03:08:36 oleg425-client kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 May 25 03:08:36 oleg425-client kernel: rtc_cmos 00:05: registered as rtc0 May 25 03:08:36 oleg425-client kernel: rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs May 25 03:08:36 oleg425-client kernel: intel_pstate: CPU model not supported May 25 03:08:36 oleg425-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 May 25 03:08:36 oleg425-client kernel: hid: raw HID events driver (C) Jiri Kosina May 25 03:08:36 oleg425-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 May 25 03:08:36 oleg425-client kernel: usbcore: registered new interface driver usbhid May 25 03:08:36 oleg425-client kernel: usbhid: USB HID core driver May 25 03:08:36 oleg425-client kernel: drop_monitor: Initializing network drop monitor service May 25 03:08:36 oleg425-client kernel: Initializing XFRM netlink socket May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 10 May 25 03:08:36 oleg425-client kernel: Segment Routing with IPv6 May 25 03:08:36 oleg425-client kernel: NET: Registered protocol family 17 May 25 03:08:36 oleg425-client kernel: mpls_gso: MPLS GSO support May 25 03:08:36 oleg425-client kernel: start plist test May 25 03:08:36 oleg425-client kernel: end plist test May 25 03:08:36 oleg425-client kernel: RAS: Correctable Errors collector initialized. May 25 03:08:36 oleg425-client kernel: AVX version of gcm_enc/dec engaged. May 25 03:08:36 oleg425-client kernel: AES CTR mode by8 optimization enabled May 25 03:08:36 oleg425-client kernel: sched_clock: Marking stable (4132394974, 0)->(5075920416, -943525442) May 25 03:08:36 oleg425-client kernel: registered taskstats version 1 May 25 03:08:36 oleg425-client kernel: Loading compiled-in X.509 certificates May 25 03:08:36 oleg425-client kernel: zswap: loaded using pool lzo/zbud May 25 03:08:36 oleg425-client kernel: Key type big_key registered May 25 03:08:36 oleg425-client kernel: Key type encrypted registered May 25 03:08:36 oleg425-client kernel: ima: No TPM chip found, activating TPM-bypass! May 25 03:08:36 oleg425-client kernel: ima: Allocated hash algorithm: sha1 May 25 03:08:36 oleg425-client kernel: ima: No architecture policies found May 25 03:08:36 oleg425-client kernel: evm: Initialising EVM extended attributes: May 25 03:08:36 oleg425-client kernel: evm: security.selinux May 25 03:08:36 oleg425-client kernel: evm: security.ima May 25 03:08:36 oleg425-client kernel: evm: security.capability May 25 03:08:36 oleg425-client kernel: evm: HMAC attrs: 0x1 May 25 03:08:36 oleg425-client kernel: rtc_cmos 00:05: setting system clock to 2026-05-25 07:08:35 UTC (1779692915) May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffffff8ee03000-0xffffffff8effffff] May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffffff8db82000-0xffffffff8de58fff] May 25 03:08:36 oleg425-client kernel: Write protecting the kernel read-only data: 28672k May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffffff8c203000-0xffffffff8c3fffff] May 25 03:08:36 oleg425-client kernel: debug: unmapping init [mem 0xffffffff8cb14000-0xffffffff8cbfffff] May 25 03:08:36 oleg425-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) May 25 03:08:36 oleg425-client systemd[1]: Detected virtualization kvm. May 25 03:08:36 oleg425-client systemd[1]: Detected architecture x86-64. May 25 03:08:36 oleg425-client systemd[1]: Running in initial RAM disk. May 25 03:08:36 oleg425-client systemd[1]: No hostname configured. May 25 03:08:36 oleg425-client systemd[1]: Set hostname to . May 25 03:08:36 oleg425-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:08:36 oleg425-client systemd[1]: Initializing machine ID from random generator. May 25 03:08:36 oleg425-client kernel: random: ln: uninitialized urandom read (6 bytes read) May 25 03:08:36 oleg425-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:08:36 oleg425-client systemd[1]: Listening on Journal Socket. May 25 03:08:36 oleg425-client systemd[1]: Listening on Journal Socket (/dev/log). May 25 03:08:36 oleg425-client systemd[1]: Starting Journal Service... May 25 03:08:36 oleg425-client systemd-journald[230]: Journal started May 25 03:08:36 oleg425-client systemd-journald[230]: Runtime journal (/run/log/journal/705e7c187b024eb086b30583ac1ba4e7) is 8.0M, max 184.6M, 176.6M free. May 25 03:08:36 oleg425-client systemd-vconsole-setup[233]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument May 25 03:08:36 oleg425-client systemd-vconsole-setup[233]: Fonts will not be copied to remaining consoles May 25 03:08:36 oleg425-client systemd[1]: Started Create list of required static device nodes for the current kernel. May 25 03:08:36 oleg425-client systemd[1]: Starting Create Static Device Nodes in /dev... May 25 03:08:36 oleg425-client systemd[1]: Starting dracut cmdline hook... May 25 03:08:36 oleg425-client systemd[1]: Started Create Static Device Nodes in /dev. May 25 03:08:37 oleg425-client dracut-cmdline[256]: dracut-8.10 (Green Obsidian) dracut-049-233.git20240115.el8 May 25 03:08:37 oleg425-client dracut-cmdline[256]: Using kernel command line parameters: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:08:37 oleg425-client systemd[1]: Started dracut cmdline hook. May 25 03:08:37 oleg425-client systemd[1]: Starting dracut pre-udev hook... May 25 03:08:38 oleg425-client kernel: device-mapper: uevent: version 1.0.3 May 25 03:08:38 oleg425-client kernel: device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com May 25 03:08:38 oleg425-client rpc.statd[386]: Version 2.3.3 starting May 25 03:08:38 oleg425-client rpc.statd[386]: Initializing NSM state May 25 03:08:38 oleg425-client rpc.idmapd[391]: Setting log level to 0 May 25 03:08:38 oleg425-client systemd[1]: Started dracut pre-udev hook. May 25 03:08:39 oleg425-client systemd[1]: Starting udev Kernel Device Manager... May 25 03:08:39 oleg425-client systemd[1]: Started udev Kernel Device Manager. May 25 03:08:39 oleg425-client systemd[1]: Starting dracut pre-trigger hook... May 25 03:08:39 oleg425-client systemd[1]: Started dracut pre-trigger hook. May 25 03:08:39 oleg425-client systemd[1]: Starting udev Coldplug all Devices... May 25 03:08:40 oleg425-client systemd[1]: Mounting Kernel Configuration File System... May 25 03:08:40 oleg425-client systemd[1]: Mounted Kernel Configuration File System. May 25 03:08:40 oleg425-client systemd[1]: Started udev Coldplug all Devices. May 25 03:08:40 oleg425-client systemd[1]: Reached target System Initialization. May 25 03:08:40 oleg425-client systemd[1]: Reached target Basic System. May 25 03:08:40 oleg425-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. May 25 03:08:40 oleg425-client systemd[1]: Starting dracut initqueue hook... May 25 03:08:40 oleg425-client systemd-udevd[445]: Using default interface naming scheme 'rhel-8.0'. May 25 03:08:40 oleg425-client kernel: libata version 3.00 loaded. May 25 03:08:40 oleg425-client systemd-udevd[445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:08:40 oleg425-client kernel: virtio_net virtio0 ens2: renamed from eth0 May 25 03:08:40 oleg425-client kernel: ata_piix 0000:00:01.1: version 2.13 May 25 03:08:41 oleg425-client kernel: scsi host0: ata_piix May 25 03:08:41 oleg425-client kernel: scsi host1: ata_piix May 25 03:08:41 oleg425-client kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 May 25 03:08:41 oleg425-client kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 May 25 03:08:41 oleg425-client systemd-udevd[438]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:08:41 oleg425-client rngd[454]: Disabling 7: PKCS11 Entropy generator (pkcs11) May 25 03:08:41 oleg425-client rngd[454]: Disabling 5: NIST Network Entropy Beacon (nist) May 25 03:08:41 oleg425-client rngd[454]: Disabling 9: Qrypt quantum entropy beacon (qrypt) May 25 03:08:41 oleg425-client rngd[454]: Initializing available sources May 25 03:08:41 oleg425-client rngd[454]: [hwrng ]: Initialization Failed May 25 03:08:41 oleg425-client rngd[454]: [rdrand]: Enabling RDRAND rng support May 25 03:08:41 oleg425-client rngd[454]: [rdrand]: Initialized May 25 03:08:41 oleg425-client rngd[454]: [jitter]: JITTER timeout set to 5 sec May 25 03:08:41 oleg425-client rngd[454]: [jitter]: Initializing AES buffer May 25 03:08:44 oleg425-client dracut-initqueue[505]: Starting dhcp for interface ens2 May 25 03:08:44 oleg425-client dracut-initqueue[538]: dhcp: PREINIT ens2 up May 25 03:08:45 oleg425-client kernel: random: fast init done May 25 03:08:45 oleg425-client dhclient[537]: Created duid "\000\004p^|\030{\002N\260\206\263\005\203\254\033\244\347". May 25 03:08:45 oleg425-client dhclient[537]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 4 (xid=0xe5399568) May 25 03:08:45 oleg425-client dhclient[537]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0xe5399568) May 25 03:08:45 oleg425-client dhclient[537]: DHCPOFFER from 192.168.204.254 May 25 03:08:45 oleg425-client dhclient[537]: DHCPACK from 192.168.204.254 (xid=0xe5399568) May 25 03:08:46 oleg425-client rngd[454]: [jitter]: Unable to obtain AES key, disabling JITTER source May 25 03:08:46 oleg425-client rngd[454]: [jitter]: Initialization Failed May 25 03:08:46 oleg425-client kernel: random: crng init done May 25 03:08:46 oleg425-client kernel: random: 7 urandom warning(s) missed due to ratelimiting May 25 03:08:46 oleg425-client dracut-initqueue[556]: dhcp: BOND setting ens2 May 25 03:08:48 oleg425-client dhclient[537]: bound to 192.168.204.25 -- renewal in 28493 seconds. May 25 03:08:48 oleg425-client dracut-initqueue[584]: RTNETLINK answers: File exists May 25 03:08:50 oleg425-client systemd[1]: Reloading. May 25 03:08:50 oleg425-client systemd[618]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. May 25 03:08:51 oleg425-client systemd[1]: Starting nbd nbd0... May 25 03:08:51 oleg425-client nbd-client[652]: Negotiation: ..size = 30720MB May 25 03:08:51 oleg425-client nbd-client[652]: Connected /dev/nbd0 May 25 03:08:51 oleg425-client systemd[1]: nbd0.service: Succeeded. May 25 03:08:51 oleg425-client systemd[1]: Started nbd nbd0. May 25 03:08:51 oleg425-client systemd[1]: Started dracut initqueue hook. May 25 03:08:51 oleg425-client systemd[1]: Reached target Remote File Systems (Pre). May 25 03:08:51 oleg425-client systemd[1]: Reached target Remote File Systems. May 25 03:08:51 oleg425-client systemd[1]: Mounting /sysroot... May 25 03:08:51 oleg425-client kernel: EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) May 25 03:08:52 oleg425-client systemd[1]: Mounted /sysroot. May 25 03:08:52 oleg425-client systemd[1]: Reached target Initrd Root File System. May 25 03:08:52 oleg425-client systemd[1]: Starting Reload Configuration from the Real Root... May 25 03:08:52 oleg425-client systemd[1]: Reloading. May 25 03:08:52 oleg425-client systemd[678]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. May 25 03:08:52 oleg425-client systemd[1]: initrd-parse-etc.service: Succeeded. May 25 03:08:52 oleg425-client systemd[1]: Started Reload Configuration from the Real Root. May 25 03:08:52 oleg425-client systemd[1]: Reached target Initrd File Systems. May 25 03:08:52 oleg425-client systemd[1]: Reached target Initrd Default Target. May 25 03:08:52 oleg425-client systemd[1]: Starting dracut pre-pivot and cleanup hook... May 25 03:08:53 oleg425-client systemd[1]: var-lib-nfs-rpc_pipefs.mount: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Started dracut pre-pivot and cleanup hook. May 25 03:08:53 oleg425-client systemd[1]: Starting Cleaning Up and Shutting Down Daemons... May 25 03:08:53 oleg425-client rngd[454]: [rdrand]: Shutting down May 25 03:08:53 oleg425-client systemd[1]: Stopping Hardware RNG Entropy Gatherer Daemon... May 25 03:08:53 oleg425-client systemd[1]: Stopped target Timers. May 25 03:08:53 oleg425-client systemd[1]: dracut-pre-pivot.service: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped dracut pre-pivot and cleanup hook. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Initrd Default Target. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Initrd Root Device. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Remote File Systems. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Remote File Systems (Pre). May 25 03:08:53 oleg425-client systemd[1]: dracut-initqueue.service: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped dracut initqueue hook. May 25 03:08:53 oleg425-client systemd[1]: rngd.service: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped Hardware RNG Entropy Gatherer Daemon. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Basic System. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Slices. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Sockets. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Paths. May 25 03:08:53 oleg425-client systemd[1]: Stopped target System Initialization. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Local Encrypted Volumes. May 25 03:08:53 oleg425-client systemd[1]: systemd-ask-password-console.path: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. May 25 03:08:53 oleg425-client systemd[1]: systemd-tmpfiles-setup.service: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped Create Volatile Files and Directories. May 25 03:08:53 oleg425-client systemd[1]: systemd-sysctl.service: Succeeded. May 25 03:08:53 oleg425-client systemd[1]: Stopped Apply Kernel Variables. May 25 03:08:53 oleg425-client systemd[1]: Stopped target Local File Systems. May 25 03:08:53 oleg425-client systemd[1]: systemd-udev-trigger.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped udev Coldplug all Devices. May 25 03:08:54 oleg425-client systemd[1]: dracut-pre-trigger.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped dracut pre-trigger hook. May 25 03:08:54 oleg425-client systemd[1]: Stopping udev Kernel Device Manager... May 25 03:08:54 oleg425-client systemd[1]: Stopped target Swap. May 25 03:08:54 oleg425-client systemd[1]: initrd-cleanup.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Started Cleaning Up and Shutting Down Daemons. May 25 03:08:54 oleg425-client systemd[1]: systemd-udevd.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped udev Kernel Device Manager. May 25 03:08:54 oleg425-client systemd[1]: systemd-tmpfiles-setup-dev.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped Create Static Device Nodes in /dev. May 25 03:08:54 oleg425-client systemd[1]: kmod-static-nodes.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped Create list of required static device nodes for the current kernel. May 25 03:08:54 oleg425-client systemd[1]: dracut-pre-udev.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped dracut pre-udev hook. May 25 03:08:54 oleg425-client systemd[1]: dracut-cmdline.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Stopped dracut cmdline hook. May 25 03:08:54 oleg425-client systemd[1]: systemd-udevd-control.socket: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Closed udev Control Socket. May 25 03:08:54 oleg425-client systemd[1]: systemd-udevd-kernel.socket: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Closed udev Kernel Socket. May 25 03:08:54 oleg425-client systemd[1]: Starting Cleanup udevd DB... May 25 03:08:54 oleg425-client systemd[1]: initrd-udevadm-cleanup-db.service: Succeeded. May 25 03:08:54 oleg425-client systemd[1]: Started Cleanup udevd DB. May 25 03:08:54 oleg425-client systemd[1]: Reached target Switch Root. May 25 03:08:54 oleg425-client systemd[1]: Starting Switch Root... May 25 03:08:54 oleg425-client systemd[1]: Switching root. May 25 03:08:54 oleg425-client systemd-journald[230]: Journal stopped May 25 03:09:01 oleg425-client kernel: printk: systemd: 22 output lines suppressed due to ratelimiting May 25 03:09:01 oleg425-client kernel: SELinux: Disabled at runtime. May 25 03:09:01 oleg425-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) May 25 03:09:01 oleg425-client systemd[1]: Detected virtualization kvm. May 25 03:09:01 oleg425-client systemd[1]: Detected architecture x86-64. May 25 03:09:01 oleg425-client systemd[1]: initrd-switch-root.service: Succeeded. May 25 03:09:01 oleg425-client systemd[1]: Stopped Switch Root. May 25 03:09:01 oleg425-client systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. May 25 03:09:01 oleg425-client systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. May 25 03:09:01 oleg425-client systemd[1]: Stopped Journal Service. May 25 03:09:01 oleg425-client systemd[1]: Starting Journal Service... May 25 03:09:01 oleg425-client systemd[1]: proc-sys-fs-binfmt_misc.automount: Refusing to start, unit to trigger not loaded. May 25 03:09:01 oleg425-client kernel: Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS May 25 03:09:01 oleg425-client systemd-journald[791]: Journal started May 25 03:09:01 oleg425-client systemd-journald[791]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. May 25 03:09:01 oleg425-client systemd[1]: systemd-journald.service: Succeeded. May 25 03:09:01 oleg425-client systemd-remount-fs[793]: /usr/bin/mount for / exited with exit status 32. May 25 03:09:01 oleg425-client systemd-remount-fs[796]: mount.nfs: access denied by server while mounting 192.168.10.1:/exports/rhel8.5-nfsroot May 25 03:09:01 oleg425-client systemd[1]: Mounted Kernel Debug File System. May 25 03:09:01 oleg425-client systemd[1]: systemd-remount-fs.service: Main process exited, code=exited, status=1/FAILURE May 25 03:09:01 oleg425-client systemd[1]: systemd-remount-fs.service: Failed with result 'exit-code'. May 25 03:09:01 oleg425-client systemd[1]: Failed to start Remount Root and Kernel File Systems. May 25 03:09:01 oleg425-client systemd[1]: Started Create list of required static device nodes for the current kernel. May 25 03:09:01 oleg425-client systemd[1]: Activated swap /dev/disk/by-label/SWAP. May 25 03:09:01 oleg425-client systemd[1]: Started Apply Kernel Variables. May 25 03:09:01 oleg425-client systemd[1]: Mounted Huge Pages File System. May 25 03:09:01 oleg425-client systemd[1]: Mounted POSIX Message Queue File System. May 25 03:09:01 oleg425-client systemd[1]: Reached target Swap. May 25 03:09:01 oleg425-client systemd[1]: Starting Configure read-only root support... May 25 03:09:01 oleg425-client systemd[1]: Starting Create Static Device Nodes in /dev... May 25 03:09:01 oleg425-client systemd[1]: Starting Flush Journal to Persistent Storage... May 25 03:09:02 oleg425-client systemd[1]: Started udev Coldplug all Devices. May 25 03:09:02 oleg425-client systemd-journald[791]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. May 25 03:09:02 oleg425-client systemd[1]: Started Flush Journal to Persistent Storage. May 25 03:09:02 oleg425-client systemd[1]: Started Create Static Device Nodes in /dev. May 25 03:09:02 oleg425-client systemd[1]: Reached target Local File Systems (Pre). May 25 03:09:02 oleg425-client systemd[1]: Mounting /mnt... May 25 03:09:02 oleg425-client systemd[1]: Mounting /home/green/git/lustre-release... May 25 03:09:02 oleg425-client systemd[1]: Starting udev Kernel Device Manager... May 25 03:09:02 oleg425-client systemd[1]: Mounted /mnt. May 25 03:09:02 oleg425-client kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher May 25 03:09:02 oleg425-client systemd[1]: Mounted /home/green/git/lustre-release. May 25 03:09:03 oleg425-client systemd[1]: Started udev Kernel Device Manager. May 25 03:09:04 oleg425-client kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 May 25 03:09:04 oleg425-client kernel: input: PC Speaker as /devices/platform/pcspkr/input/input5 May 25 03:09:05 oleg425-client systemd-udevd[879]: Using default interface naming scheme 'rhel-8.0'. May 25 03:09:05 oleg425-client systemd-udevd[879]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:05 oleg425-client kernel: RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer May 25 03:09:06 oleg425-client kernel: EDAC sbridge: Seeking for: PCI ID 8086:0ea0 May 25 03:09:06 oleg425-client kernel: EDAC sbridge: Ver: 1.1.2 May 25 03:09:07 oleg425-client systemd-udevd[882]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:13 oleg425-client kernel: Key type dns_resolver registered May 25 03:09:14 oleg425-client kernel: NFS: Registering the id_resolver key type May 25 03:09:14 oleg425-client kernel: Key type id_resolver registered May 25 03:09:14 oleg425-client kernel: Key type id_legacy registered May 25 03:09:15 oleg425-client nfsrahead[987]: setting /var/lib/stateless/state readahead to 128 May 25 03:09:15 oleg425-client systemd[1]: Started Configure read-only root support. May 25 03:09:15 oleg425-client systemd[1]: Starting Load/Save Random Seed... May 25 03:09:15 oleg425-client systemd[1]: Reached target Local File Systems. May 25 03:09:15 oleg425-client systemd[1]: Starting Create Volatile Files and Directories... May 25 03:09:15 oleg425-client systemd[1]: Starting Rebuild Dynamic Linker Cache... May 25 03:09:15 oleg425-client systemd[1]: Starting Mark the need to relabel after reboot... May 25 03:09:16 oleg425-client touch[1002]: /bin/touch: cannot touch '/.autorelabel': Read-only file system May 25 03:09:16 oleg425-client systemd[1]: Started Load/Save Random Seed. May 25 03:09:16 oleg425-client systemd[1]: Started Mark the need to relabel after reboot. May 25 03:09:16 oleg425-client systemd-tmpfiles[999]: rm(/var/lib/rpm/__db.003): Read-only file system May 25 03:09:16 oleg425-client systemd-tmpfiles[999]: rm(/var/lib/rpm/__db.002): Read-only file system May 25 03:09:16 oleg425-client systemd-tmpfiles[999]: rm(/var/lib/rpm/__db.001): Read-only file system May 25 03:09:16 oleg425-client systemd[1]: Started Create Volatile Files and Directories. May 25 03:09:16 oleg425-client systemd[1]: Starting RPC Bind... May 25 03:09:16 oleg425-client systemd[1]: Starting Update UTMP about System Boot/Shutdown... May 25 03:09:16 oleg425-client systemd[1]: Started Update UTMP about System Boot/Shutdown. May 25 03:09:16 oleg425-client systemd[1]: Started RPC Bind. May 25 03:09:20 oleg425-client systemd[1]: Started Rebuild Dynamic Linker Cache. May 25 03:09:20 oleg425-client systemd[1]: Starting Update is Completed... May 25 03:09:20 oleg425-client systemd[1]: Started Update is Completed. May 25 03:09:20 oleg425-client systemd[1]: Reached target System Initialization. May 25 03:09:20 oleg425-client systemd[1]: Started dnf makecache --timer. May 25 03:09:20 oleg425-client systemd[1]: Listening on D-Bus System Message Bus Socket. May 25 03:09:20 oleg425-client systemd[1]: Reached target Sockets. May 25 03:09:20 oleg425-client systemd[1]: Started Daily Cleanup of Temporary Directories. May 25 03:09:20 oleg425-client systemd[1]: Started daily update of the root trust anchor for DNSSEC. May 25 03:09:20 oleg425-client systemd[1]: Reached target Timers. May 25 03:09:20 oleg425-client systemd[1]: Reached target Basic System. May 25 03:09:20 oleg425-client systemd[1]: Started D-Bus System Message Bus. May 25 03:09:20 oleg425-client systemd[1]: Starting Network Manager... May 25 03:09:20 oleg425-client systemd[1]: Starting Restore /run/initramfs on shutdown... May 25 03:09:20 oleg425-client systemd[1]: Started irqbalance daemon. May 25 03:09:21 oleg425-client systemd[1]: Starting Login Service... May 25 03:09:21 oleg425-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. May 25 03:09:21 oleg425-client systemd[1]: Reached target sshd-keygen.target. May 25 03:09:21 oleg425-client systemd[1]: Started Restore /run/initramfs on shutdown. May 25 03:09:21 oleg425-client rngd[1021]: Disabling 7: PKCS11 Entropy generator (pkcs11) May 25 03:09:21 oleg425-client rngd[1021]: Disabling 5: NIST Network Entropy Beacon (nist) May 25 03:09:21 oleg425-client rngd[1021]: Disabling 9: Qrypt quantum entropy beacon (qrypt) May 25 03:09:21 oleg425-client rngd[1021]: Initializing available sources May 25 03:09:21 oleg425-client rngd[1021]: [hwrng ]: Initialization Failed May 25 03:09:21 oleg425-client rngd[1021]: [rdrand]: Enabling RDRAND rng support May 25 03:09:21 oleg425-client rngd[1021]: [rdrand]: Initialized May 25 03:09:21 oleg425-client rngd[1021]: [jitter]: JITTER timeout set to 5 sec May 25 03:09:21 oleg425-client NetworkManager[1016]: [1779692961.6905] NetworkManager (version 1.40.16-19.el8_10) is starting... (boot:560b8c3b-6caa-4864-a973-0eec4f89e4c6) May 25 03:09:21 oleg425-client NetworkManager[1016]: [1779692961.7066] Read config: /etc/NetworkManager/NetworkManager.conf (run: 10-dracut-dhclient.conf) May 25 03:09:21 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:09:21 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:09:21 oleg425-client systemd[1]: Started Network Manager. May 25 03:09:21 oleg425-client NetworkManager[1016]: [1779692961.8093] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" May 25 03:09:21 oleg425-client systemd-logind[1020]: New seat seat0. May 25 03:09:21 oleg425-client systemd[1]: Starting Network Manager Wait Online... May 25 03:09:21 oleg425-client systemd[1]: Reached target Network. May 25 03:09:21 oleg425-client systemd[1]: Starting OpenSSH server daemon... May 25 03:09:21 oleg425-client NetworkManager[1016]: [1779692961.9358] manager[0x5637e6ffc020]: monitoring kernel firmware directory '/lib/firmware'. May 25 03:09:21 oleg425-client dbus-daemon[1015]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.1' (uid=0 pid=1016 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:09:21 oleg425-client systemd[1]: Starting GSSAPI Proxy Daemon... May 25 03:09:21 oleg425-client systemd[1]: Starting Dynamic System Tuning Daemon... May 25 03:09:22 oleg425-client rngd[1021]: [jitter]: Initializing AES buffer May 25 03:09:22 oleg425-client systemd[1]: Started Login Service. May 25 03:09:22 oleg425-client sshd[1034]: Server listening on 0.0.0.0 port 22. May 25 03:09:22 oleg425-client sshd[1034]: Server listening on :: port 22. May 25 03:09:22 oleg425-client systemd[1]: Starting Hostname Service... May 25 03:09:22 oleg425-client systemd[1]: Started OpenSSH server daemon. May 25 03:09:22 oleg425-client systemd[1]: Started GSSAPI Proxy Daemon. May 25 03:09:22 oleg425-client systemd[1]: Reached target NFS client services. May 25 03:09:22 oleg425-client systemd[1]: Reached target Remote File Systems (Pre). May 25 03:09:22 oleg425-client systemd[1]: Reached target Remote File Systems. May 25 03:09:23 oleg425-client systemd[1]: Starting Permit User Sessions... May 25 03:09:23 oleg425-client systemd[1]: Started Permit User Sessions. May 25 03:09:23 oleg425-client systemd[1]: Started Command Scheduler. May 25 03:09:23 oleg425-client systemd[1]: Started Serial Getty on ttyS1. May 25 03:09:23 oleg425-client crond[1057]: (CRON) STARTUP (1.5.2) May 25 03:09:23 oleg425-client systemd[1]: Started Getty on tty1. May 25 03:09:23 oleg425-client crond[1057]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 65% if used.) May 25 03:09:23 oleg425-client crond[1057]: (CRON) INFO (running with inotify support) May 25 03:09:23 oleg425-client systemd[1]: Started Serial Getty on ttyS0. May 25 03:09:23 oleg425-client systemd[1]: Reached target Login Prompts. May 25 03:09:25 oleg425-client dbus-daemon[1015]: [system] Successfully activated service 'org.freedesktop.hostname1' May 25 03:09:25 oleg425-client systemd[1]: Started Hostname Service. May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.1833] hostname: hostname: using hostnamed May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.1842] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.3678] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-device-plugin-team.so) May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.3695] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.3707] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.3716] manager: Networking is enabled by state file May 25 03:09:25 oleg425-client dbus-daemon[1015]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.1' (uid=0 pid=1016 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.4083] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-settings-plugin-ifcfg-rh.so") May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.4085] settings: Loaded settings plugin: keyfile (internal) May 25 03:09:25 oleg425-client systemd[1]: Starting Network Manager Script Dispatcher Service... May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.5201] dhcp: init: Using DHCP client 'dhclient' May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.5278] device (lo): carrier: link connected May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.5286] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.5503] device (ens2): carrier: link connected May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.5849] manager: (ens2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.6231] manager: (ens2): assume: will attempt to assume matching connection 'ens2' (861fc0d8-7da0-4faa-a796-ddae408f3326) (guessed) May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.6460] manager: (ens2): assume: taking over an initramfs-configured connection May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.6509] device (ens2): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'assume') May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.6819] device (ens2): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'assume') May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.7073] device (ens2): Activation: starting connection 'ens2' (861fc0d8-7da0-4faa-a796-ddae408f3326) May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.8073] device (ens2): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'assume') May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.8457] device (ens2): state change: prepare -> config (reason 'none', sys-iface-state: 'assume') May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.8747] device (ens2): state change: config -> ip-config (reason 'none', sys-iface-state: 'assume') May 25 03:09:25 oleg425-client NetworkManager[1016]: [1779692965.9132] dhcp4 (ens2): activation: beginning transaction (timeout in 45 seconds) May 25 03:09:26 oleg425-client NetworkManager[1016]: [1779692966.1237] dhcp4 (ens2): dhclient started with pid 1062 May 25 03:09:26 oleg425-client dbus-daemon[1015]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.1' (uid=0 pid=1016 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:09:26 oleg425-client dbus-daemon[1015]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. May 25 03:09:26 oleg425-client dbus-daemon[1015]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' May 25 03:09:26 oleg425-client systemd[1]: Started Network Manager Script Dispatcher Service. May 25 03:09:27 oleg425-client rngd[1021]: [jitter]: Unable to obtain AES key, disabling JITTER source May 25 03:09:27 oleg425-client rngd[1021]: [jitter]: Initialization Failed May 25 03:09:27 oleg425-client rngd[1021]: Process privileges have been dropped to 2:2 May 25 03:09:27 oleg425-client dhclient[1062]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0xff652c03) May 25 03:09:27 oleg425-client dhclient[1062]: 5 udp packets in 5 too long - dropped May 25 03:09:27 oleg425-client dhclient[1062]: DHCPACK from 192.168.204.254 (xid=0xff652c03) May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3392] dhcp4 (ens2): address 192.168.204.25 May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3393] dhcp4 (ens2): plen 24 (255.255.255.0) May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3393] dhcp4 (ens2): gateway 192.168.204.254 May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3393] dhcp4 (ens2): lease time 60000 May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3394] dhcp4 (ens2): hostname 'oleg425-client.virtnet' May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3394] dhcp4 (ens2): nameserver '192.168.200.253' May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3394] dhcp4 (ens2): domain name 'virtnet' May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3395] dhcp4 (ens2): state changed new lease, address=192.168.204.25 May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3413] policy: set 'ens2' (ens2) as default for IPv4 routing and DNS May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.3663] device (ens2): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'assume') May 25 03:09:27 oleg425-client dhclient[1062]: bound to 192.168.204.25 -- renewal in 26546 seconds. May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4546] device (ens2): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'assume') May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4554] device (ens2): state change: secondaries -> activated (reason 'none', sys-iface-state: 'assume') May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4635] manager: NetworkManager state is now CONNECTED_SITE May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4941] device (ens2): Activation: successful, device activated. May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4954] manager: NetworkManager state is now CONNECTED_GLOBAL May 25 03:09:27 oleg425-client NetworkManager[1016]: [1779692967.4963] manager: startup complete May 25 03:09:27 oleg425-client systemd[1]: Started Network Manager Wait Online. May 25 03:09:27 oleg425-client systemd[1]: Reached target Network is Online. May 25 03:09:27 oleg425-client systemd[1]: Starting Crash recovery kernel arming... May 25 03:09:27 oleg425-client systemd[1]: Starting Notify NFS peers of a restart... May 25 03:09:27 oleg425-client systemd[1]: Starting System Logging Service... May 25 03:09:27 oleg425-client sm-notify[1082]: Version 2.3.3 starting May 25 03:09:27 oleg425-client systemd[1]: Started Notify NFS peers of a restart. May 25 03:09:29 oleg425-client systemd[1]: Started System Logging Service. May 25 03:09:29 oleg425-client rsyslogd[1083]: [origin software="rsyslogd" swVersion="8.2102.0-15.el8_10.1" x-pid="1083" x-info="https://www.rsyslog.com"] start May 25 03:09:29 oleg425-client rsyslogd[1083]: imjournal: No statefile exists, /var/lib/rsyslog/imjournal.state will be created (ignore if this is first run): No such file or directory [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/2040 ] May 25 03:09:29 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:09:29 oleg425-client kdumpctl[1176]: basename: missing operand May 25 03:09:29 oleg425-client kdumpctl[1176]: Try 'basename --help' for more information. May 25 03:09:31 oleg425-client dbus-daemon[1015]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.7' (uid=0 pid=1043 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") May 25 03:09:31 oleg425-client systemd[1]: Starting Authorization Manager... May 25 03:09:31 oleg425-client polkitd[1360]: Started polkitd version 0.115 May 25 03:09:32 oleg425-client systemd[1]: Started Dynamic System Tuning Daemon. May 25 03:09:32 oleg425-client systemd[1]: Reached target Multi-User System. May 25 03:09:32 oleg425-client systemd[1]: Reached target Graphical Interface. May 25 03:09:32 oleg425-client systemd[1]: Starting Update UTMP about System Runlevel Changes... May 25 03:09:32 oleg425-client polkitd[1360]: Loading rules from directory /etc/polkit-1/rules.d May 25 03:09:32 oleg425-client polkitd[1360]: Loading rules from directory /usr/share/polkit-1/rules.d May 25 03:09:33 oleg425-client polkitd[1360]: Finished loading, compiling and executing 2 rules May 25 03:09:33 oleg425-client dbus-daemon[1015]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' May 25 03:09:33 oleg425-client polkitd[1360]: Acquired the name org.freedesktop.PolicyKit1 on the system bus May 25 03:09:33 oleg425-client systemd[1]: Started Authorization Manager. May 25 03:09:33 oleg425-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. May 25 03:09:33 oleg425-client systemd[1]: Started Update UTMP about System Runlevel Changes. May 25 03:09:33 oleg425-client kernel: hrtimer: interrupt took 13664026 ns May 25 03:09:37 oleg425-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. May 25 03:09:46 oleg425-client sshd[1446]: Accepted publickey for root from 192.168.200.253 port 41292 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I May 25 03:09:46 oleg425-client systemd[1]: Created slice User Slice of UID 0. May 25 03:09:46 oleg425-client systemd-logind[1020]: New session 1 of user root. May 25 03:09:46 oleg425-client systemd[1]: Starting User runtime directory /run/user/0... May 25 03:09:46 oleg425-client systemd[1]: Started User runtime directory /run/user/0. May 25 03:09:46 oleg425-client systemd[1]: Starting User Manager for UID 0... May 25 03:09:47 oleg425-client systemd[1474]: pam_unix(systemd-user:session): session opened for user root by (uid=0) May 25 03:09:47 oleg425-client systemd[1474]: Starting D-Bus User Message Bus Socket. May 25 03:09:47 oleg425-client systemd[1474]: Reached target Timers. May 25 03:09:47 oleg425-client systemd[1474]: Reached target Paths. May 25 03:09:47 oleg425-client systemd[1474]: Listening on D-Bus User Message Bus Socket. May 25 03:09:47 oleg425-client systemd[1474]: Reached target Sockets. May 25 03:09:47 oleg425-client systemd[1474]: Reached target Basic System. May 25 03:09:47 oleg425-client systemd[1474]: Reached target Default. May 25 03:09:47 oleg425-client systemd[1474]: Startup finished in 593ms. May 25 03:09:47 oleg425-client systemd[1]: Started User Manager for UID 0. May 25 03:09:47 oleg425-client systemd[1]: Started Session 1 of user root. May 25 03:09:47 oleg425-client sshd[1446]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:09:47 oleg425-client kdumpctl[1086]: kdump: kexec: loaded kdump kernel May 25 03:09:47 oleg425-client kdumpctl[1086]: kdump: Starting kdump: [OK] May 25 03:09:47 oleg425-client systemd[1]: Started Crash recovery kernel arming. May 25 03:09:47 oleg425-client systemd[1]: Startup finished in 4.253s (kernel) + 21.359s (initrd) + 51.029s (userspace) = 1min 16.642s. May 25 03:09:48 oleg425-client sshd[1486]: Received disconnect from 192.168.200.253 port 41292:11: disconnected by user May 25 03:09:48 oleg425-client sshd[1486]: Disconnected from user root 192.168.200.253 port 41292 May 25 03:09:48 oleg425-client sshd[1446]: pam_unix(sshd:session): session closed for user root May 25 03:09:49 oleg425-client systemd[1]: session-1.scope: Succeeded. May 25 03:09:49 oleg425-client systemd-logind[1020]: Session 1 logged out. Waiting for processes to exit. May 25 03:09:49 oleg425-client systemd-logind[1020]: Removed session 1. May 25 03:09:49 oleg425-client sshd[1522]: Accepted publickey for root from 192.168.200.253 port 41304 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I May 25 03:09:49 oleg425-client systemd[1]: Started Session 3 of user root. May 25 03:09:49 oleg425-client systemd-logind[1020]: New session 3 of user root. May 25 03:09:49 oleg425-client sshd[1522]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:09:55 oleg425-client systemd[1]: systemd-hostnamed.service: Succeeded. May 25 03:10:41 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:10:42 oleg425-client systemd-udevd[2267]: Using default interface naming scheme 'rhel-8.0'. May 25 03:10:42 oleg425-client kernel: libcfs: loading out-of-tree module taints kernel. May 25 03:10:42 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:10:42 oleg425-client kernel: Key type ._llcrypt registered May 25 03:10:42 oleg425-client kernel: Key type .llcrypt registered May 25 03:10:43 oleg425-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 May 25 03:10:43 oleg425-client kernel: alg: No test for adler32 (adler32-zlib) May 25 03:10:44 oleg425-client kernel: Lustre: Lustre: Build Version: 2.17.53_24_gacb3840 May 25 03:10:45 oleg425-client kernel: LNet: Added LNI 192.168.204.25@tcp [8/256/0/180] May 25 03:10:47 oleg425-client kernel: Key type lgssc registered May 25 03:10:49 oleg425-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 25 03:11:47 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:11:48 oleg425-client systemd-udevd[4212]: Using default interface naming scheme 'rhel-8.0'. May 25 03:11:48 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:12:53 oleg425-client kernel: Lustre: Mounted lustre-client May 25 03:12:55 oleg425-client sshd[5647]: Accepted publickey for root from 192.168.204.25 port 56682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:12:55 oleg425-client systemd-logind[1020]: New session 4 of user root. May 25 03:12:55 oleg425-client systemd[1]: Started Session 4 of user root. May 25 03:12:55 oleg425-client sshd[5647]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:12:55 oleg425-client sshd[5660]: Received disconnect from 192.168.204.25 port 56682:11: disconnected by user May 25 03:12:55 oleg425-client sshd[5660]: Disconnected from user root 192.168.204.25 port 56682 May 25 03:12:55 oleg425-client sshd[5647]: pam_unix(sshd:session): session closed for user root May 25 03:12:56 oleg425-client systemd[1]: session-4.scope: Succeeded. May 25 03:12:56 oleg425-client systemd-logind[1020]: Session 4 logged out. Waiting for processes to exit. May 25 03:12:56 oleg425-client systemd-logind[1020]: Removed session 4. May 25 03:12:57 oleg425-client sshd[5820]: Accepted publickey for root from 192.168.204.25 port 56686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:12:57 oleg425-client systemd-logind[1020]: New session 5 of user root. May 25 03:12:57 oleg425-client systemd[1]: Started Session 5 of user root. May 25 03:12:57 oleg425-client sshd[5820]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:12:58 oleg425-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 25 03:12:58 oleg425-client sshd[5833]: Received disconnect from 192.168.204.25 port 56686:11: disconnected by user May 25 03:12:58 oleg425-client sshd[5833]: Disconnected from user root 192.168.204.25 port 56686 May 25 03:12:58 oleg425-client sshd[5820]: pam_unix(sshd:session): session closed for user root May 25 03:12:58 oleg425-client systemd[1]: session-5.scope: Succeeded. May 25 03:12:58 oleg425-client systemd-logind[1020]: Session 5 logged out. Waiting for processes to exit. May 25 03:12:58 oleg425-client systemd-logind[1020]: Removed session 5. May 25 03:12:59 oleg425-client sshd[5952]: Accepted publickey for root from 192.168.204.25 port 56696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:12:59 oleg425-client systemd-logind[1020]: New session 6 of user root. May 25 03:12:59 oleg425-client systemd[1]: Started Session 6 of user root. May 25 03:12:59 oleg425-client sshd[5952]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:12:59 oleg425-client sshd[5965]: Received disconnect from 192.168.204.25 port 56696:11: disconnected by user May 25 03:12:59 oleg425-client sshd[5965]: Disconnected from user root 192.168.204.25 port 56696 May 25 03:12:59 oleg425-client sshd[5952]: pam_unix(sshd:session): session closed for user root May 25 03:12:59 oleg425-client systemd[1]: session-6.scope: Succeeded. May 25 03:12:59 oleg425-client systemd-logind[1020]: Session 6 logged out. Waiting for processes to exit. May 25 03:12:59 oleg425-client systemd-logind[1020]: Removed session 6. May 25 03:13:08 oleg425-client systemd-udevd[6122]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:13:11 oleg425-client sshd[6259]: Accepted publickey for root from 192.168.204.25 port 44114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:11 oleg425-client systemd[1]: Started Session 7 of user root. May 25 03:13:11 oleg425-client systemd-logind[1020]: New session 7 of user root. May 25 03:13:11 oleg425-client sshd[6259]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:14 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing check_logdir /tmp/testlogs/ May 25 03:13:14 oleg425-client sshd[6272]: Received disconnect from 192.168.204.25 port 44114:11: disconnected by user May 25 03:13:14 oleg425-client sshd[6272]: Disconnected from user root 192.168.204.25 port 44114 May 25 03:13:14 oleg425-client sshd[6259]: pam_unix(sshd:session): session closed for user root May 25 03:13:15 oleg425-client systemd[1]: session-7.scope: Succeeded. May 25 03:13:15 oleg425-client systemd-logind[1020]: Session 7 logged out. Waiting for processes to exit. May 25 03:13:15 oleg425-client systemd-logind[1020]: Removed session 7. May 25 03:13:17 oleg425-client sshd[6522]: Accepted publickey for root from 192.168.204.25 port 50166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:17 oleg425-client systemd-logind[1020]: New session 8 of user root. May 25 03:13:17 oleg425-client systemd[1]: Started Session 8 of user root. May 25 03:13:17 oleg425-client sshd[6522]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:19 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b187f3000: disconnect after 24s idle May 25 03:13:20 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing yml_node May 25 03:13:22 oleg425-client sshd[6535]: Received disconnect from 192.168.204.25 port 50166:11: disconnected by user May 25 03:13:22 oleg425-client sshd[6535]: Disconnected from user root 192.168.204.25 port 50166 May 25 03:13:22 oleg425-client sshd[6522]: pam_unix(sshd:session): session closed for user root May 25 03:13:22 oleg425-client systemd-logind[1020]: Session 8 logged out. Waiting for processes to exit. May 25 03:13:22 oleg425-client systemd[1]: session-8.scope: Succeeded. May 25 03:13:22 oleg425-client systemd-logind[1020]: Removed session 8. May 25 03:13:25 oleg425-client sshd[7101]: Accepted publickey for root from 192.168.204.25 port 54296 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:25 oleg425-client systemd[1]: Started Session 9 of user root. May 25 03:13:25 oleg425-client systemd-logind[1020]: New session 9 of user root. May 25 03:13:25 oleg425-client sshd[7101]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:25 oleg425-client kernel: Lustre: DEBUG MARKER: Client: 2.17.53.24 May 25 03:13:25 oleg425-client sshd[7114]: Received disconnect from 192.168.204.25 port 54296:11: disconnected by user May 25 03:13:26 oleg425-client sshd[7114]: Disconnected from user root 192.168.204.25 port 54296 May 25 03:13:26 oleg425-client sshd[7101]: pam_unix(sshd:session): session closed for user root May 25 03:13:26 oleg425-client systemd[1]: session-9.scope: Succeeded. May 25 03:13:26 oleg425-client systemd-logind[1020]: Session 9 logged out. Waiting for processes to exit. May 25 03:13:26 oleg425-client systemd-logind[1020]: Removed session 9. May 25 03:13:28 oleg425-client sshd[7255]: Accepted publickey for root from 192.168.204.25 port 54304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:28 oleg425-client systemd-logind[1020]: New session 10 of user root. May 25 03:13:28 oleg425-client systemd[1]: Started Session 10 of user root. May 25 03:13:28 oleg425-client sshd[7255]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:28 oleg425-client kernel: Lustre: DEBUG MARKER: MDS: 2.17.53.24 May 25 03:13:28 oleg425-client sshd[7268]: Received disconnect from 192.168.204.25 port 54304:11: disconnected by user May 25 03:13:28 oleg425-client sshd[7268]: Disconnected from user root 192.168.204.25 port 54304 May 25 03:13:28 oleg425-client sshd[7255]: pam_unix(sshd:session): session closed for user root May 25 03:13:28 oleg425-client systemd[1]: session-10.scope: Succeeded. May 25 03:13:28 oleg425-client systemd-logind[1020]: Session 10 logged out. Waiting for processes to exit. May 25 03:13:28 oleg425-client systemd-logind[1020]: Removed session 10. May 25 03:13:30 oleg425-client sshd[7409]: Accepted publickey for root from 192.168.204.25 port 54308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:30 oleg425-client systemd-logind[1020]: New session 11 of user root. May 25 03:13:30 oleg425-client systemd[1]: Started Session 11 of user root. May 25 03:13:30 oleg425-client sshd[7409]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:31 oleg425-client kernel: Lustre: DEBUG MARKER: OSS: 2.17.53.24 May 25 03:13:31 oleg425-client sshd[7423]: Received disconnect from 192.168.204.25 port 54308:11: disconnected by user May 25 03:13:31 oleg425-client sshd[7423]: Disconnected from user root 192.168.204.25 port 54308 May 25 03:13:31 oleg425-client sshd[7409]: pam_unix(sshd:session): session closed for user root May 25 03:13:31 oleg425-client systemd-logind[1020]: Session 11 logged out. Waiting for processes to exit. May 25 03:13:31 oleg425-client systemd[1]: session-11.scope: Succeeded. May 25 03:13:31 oleg425-client systemd-logind[1020]: Removed session 11. May 25 03:13:32 oleg425-client sshd[7555]: Accepted publickey for root from 192.168.204.25 port 54322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:32 oleg425-client systemd-logind[1020]: New session 12 of user root. May 25 03:13:32 oleg425-client systemd[1]: Started Session 12 of user root. May 25 03:13:32 oleg425-client sshd[7555]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:33 oleg425-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Mon May 25 03:13:31 EDT 2026 May 25 03:13:33 oleg425-client sshd[7568]: Received disconnect from 192.168.204.25 port 54322:11: disconnected by user May 25 03:13:33 oleg425-client sshd[7568]: Disconnected from user root 192.168.204.25 port 54322 May 25 03:13:33 oleg425-client sshd[7555]: pam_unix(sshd:session): session closed for user root May 25 03:13:33 oleg425-client systemd[1]: session-12.scope: Succeeded. May 25 03:13:33 oleg425-client systemd-logind[1020]: Session 12 logged out. Waiting for processes to exit. May 25 03:13:33 oleg425-client systemd-logind[1020]: Removed session 12. May 25 03:13:52 oleg425-client sshd[8084]: Accepted publickey for root from 192.168.204.25 port 54836 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:52 oleg425-client systemd-logind[1020]: New session 13 of user root. May 25 03:13:52 oleg425-client systemd[1]: Started Session 13 of user root. May 25 03:13:52 oleg425-client sshd[8084]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:52 oleg425-client kernel: Lustre: DEBUG MARKER: excepting tests: 136 May 25 03:13:52 oleg425-client sshd[8097]: Received disconnect from 192.168.204.25 port 54836:11: disconnected by user May 25 03:13:52 oleg425-client sshd[8097]: Disconnected from user root 192.168.204.25 port 54836 May 25 03:13:52 oleg425-client sshd[8084]: pam_unix(sshd:session): session closed for user root May 25 03:13:52 oleg425-client systemd[1]: session-13.scope: Succeeded. May 25 03:13:52 oleg425-client systemd-logind[1020]: Session 13 logged out. Waiting for processes to exit. May 25 03:13:52 oleg425-client systemd-logind[1020]: Removed session 13. May 25 03:13:53 oleg425-client sshd[8266]: Accepted publickey for root from 192.168.204.25 port 54850 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:53 oleg425-client systemd-logind[1020]: New session 14 of user root. May 25 03:13:53 oleg425-client systemd[1]: Started Session 14 of user root. May 25 03:13:53 oleg425-client sshd[8266]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:54 oleg425-client kernel: Lustre: DEBUG MARKER: === recovery-small: start setup 03:13:52 (1779693232) === May 25 03:13:54 oleg425-client sshd[8279]: Received disconnect from 192.168.204.25 port 54850:11: disconnected by user May 25 03:13:54 oleg425-client sshd[8279]: Disconnected from user root 192.168.204.25 port 54850 May 25 03:13:54 oleg425-client sshd[8266]: pam_unix(sshd:session): session closed for user root May 25 03:13:54 oleg425-client systemd[1]: session-14.scope: Succeeded. May 25 03:13:54 oleg425-client systemd-logind[1020]: Session 14 logged out. Waiting for processes to exit. May 25 03:13:54 oleg425-client systemd-logind[1020]: Removed session 14. May 25 03:13:58 oleg425-client sshd[8513]: Accepted publickey for root from 192.168.204.25 port 41976 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:13:58 oleg425-client systemd-logind[1020]: New session 15 of user root. May 25 03:13:58 oleg425-client systemd[1]: Started Session 15 of user root. May 25 03:13:58 oleg425-client sshd[8513]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:13:58 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing check_config_client /mnt/lustre May 25 03:13:58 oleg425-client sshd[8526]: Received disconnect from 192.168.204.25 port 41976:11: disconnected by user May 25 03:13:58 oleg425-client sshd[8526]: Disconnected from user root 192.168.204.25 port 41976 May 25 03:13:58 oleg425-client sshd[8513]: pam_unix(sshd:session): session closed for user root May 25 03:13:58 oleg425-client systemd[1]: session-15.scope: Succeeded. May 25 03:13:58 oleg425-client systemd-logind[1020]: Session 15 logged out. Waiting for processes to exit. May 25 03:13:58 oleg425-client systemd-logind[1020]: Removed session 15. May 25 03:14:14 oleg425-client sshd[9170]: Accepted publickey for root from 192.168.204.25 port 51000 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:14:14 oleg425-client systemd-logind[1020]: New session 16 of user root. May 25 03:14:14 oleg425-client systemd[1]: Started Session 16 of user root. May 25 03:14:14 oleg425-client sshd[9170]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:14:14 oleg425-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 25 03:14:14 oleg425-client sshd[9183]: Received disconnect from 192.168.204.25 port 51000:11: disconnected by user May 25 03:14:15 oleg425-client sshd[9183]: Disconnected from user root 192.168.204.25 port 51000 May 25 03:14:15 oleg425-client sshd[9170]: pam_unix(sshd:session): session closed for user root May 25 03:14:15 oleg425-client systemd-logind[1020]: Session 16 logged out. Waiting for processes to exit. May 25 03:14:15 oleg425-client systemd[1]: session-16.scope: Succeeded. May 25 03:14:15 oleg425-client systemd-logind[1020]: Removed session 16. May 25 03:14:15 oleg425-client sshd[9302]: Accepted publickey for root from 192.168.204.25 port 51004 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:14:16 oleg425-client systemd-logind[1020]: New session 17 of user root. May 25 03:14:16 oleg425-client systemd[1]: Started Session 17 of user root. May 25 03:14:16 oleg425-client sshd[9302]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:14:16 oleg425-client sshd[9315]: Received disconnect from 192.168.204.25 port 51004:11: disconnected by user May 25 03:14:16 oleg425-client sshd[9315]: Disconnected from user root 192.168.204.25 port 51004 May 25 03:14:16 oleg425-client sshd[9302]: pam_unix(sshd:session): session closed for user root May 25 03:14:16 oleg425-client systemd-logind[1020]: Session 17 logged out. Waiting for processes to exit. May 25 03:14:16 oleg425-client systemd[1]: session-17.scope: Succeeded. May 25 03:14:16 oleg425-client systemd-logind[1020]: Removed session 17. May 25 03:14:23 oleg425-client sshd[9635]: Accepted publickey for root from 192.168.204.25 port 51018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:14:23 oleg425-client systemd-logind[1020]: New session 18 of user root. May 25 03:14:23 oleg425-client systemd[1]: Started Session 18 of user root. May 25 03:14:23 oleg425-client sshd[9635]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:14:24 oleg425-client sshd[9648]: Received disconnect from 192.168.204.25 port 51018:11: disconnected by user May 25 03:14:24 oleg425-client sshd[9648]: Disconnected from user root 192.168.204.25 port 51018 May 25 03:14:24 oleg425-client sshd[9635]: pam_unix(sshd:session): session closed for user root May 25 03:14:24 oleg425-client systemd-logind[1020]: Session 18 logged out. Waiting for processes to exit. May 25 03:14:24 oleg425-client systemd[1]: session-18.scope: Succeeded. May 25 03:14:24 oleg425-client systemd-logind[1020]: Removed session 18. May 25 03:14:25 oleg425-client sshd[9772]: Accepted publickey for root from 192.168.204.25 port 59340 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:14:25 oleg425-client systemd-logind[1020]: New session 19 of user root. May 25 03:14:25 oleg425-client systemd[1]: Started Session 19 of user root. May 25 03:14:25 oleg425-client sshd[9772]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:14:25 oleg425-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish setup 03:14:24 (1779693264) === May 25 03:14:25 oleg425-client sshd[9785]: Received disconnect from 192.168.204.25 port 59340:11: disconnected by user May 25 03:14:25 oleg425-client sshd[9785]: Disconnected from user root 192.168.204.25 port 59340 May 25 03:14:25 oleg425-client sshd[9772]: pam_unix(sshd:session): session closed for user root May 25 03:14:25 oleg425-client systemd[1]: session-19.scope: Succeeded. May 25 03:14:25 oleg425-client systemd-logind[1020]: Session 19 logged out. Waiting for processes to exit. May 25 03:14:25 oleg425-client systemd-logind[1020]: Removed session 19. May 25 03:14:27 oleg425-client sshd[9925]: Accepted publickey for root from 192.168.204.25 port 59356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:14:27 oleg425-client systemd[1]: Started Session 20 of user root. May 25 03:14:27 oleg425-client systemd-logind[1020]: New session 20 of user root. May 25 03:14:27 oleg425-client sshd[9925]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:14:27 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 1: create, chmod, stat: drop req, drop rep ========================================================== 03:14:26 (1779693266) May 25 03:14:27 oleg425-client sshd[9938]: Received disconnect from 192.168.204.25 port 59356:11: disconnected by user May 25 03:14:27 oleg425-client sshd[9938]: Disconnected from user root 192.168.204.25 port 59356 May 25 03:14:27 oleg425-client sshd[9925]: pam_unix(sshd:session): session closed for user root May 25 03:14:27 oleg425-client systemd-logind[1020]: Session 20 logged out. Waiting for processes to exit. May 25 03:14:27 oleg425-client systemd[1]: session-20.scope: Succeeded. May 25 03:14:27 oleg425-client systemd-logind[1020]: Removed session 20. May 25 03:14:45 oleg425-client kernel: Lustre: 9988:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693268/real 1779693268] req@ffffa09b061b0700 x1866143414365952/t0(0) o700->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:30/10 lens 264/248 e 0 to 1 dl 1779693284 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 May 25 03:14:45 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:14:45 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:15:04 oleg425-client kernel: Lustre: 10010:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693287/real 1779693287] req@ffffa09b05055c00 x1866143414367744/t0(0) o36->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 520/576 e 0 to 1 dl 1779693303 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 May 25 03:15:04 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:15:04 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:15:22 oleg425-client kernel: Lustre: 10036:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693306/real 1779693306] req@ffffa09b061b0e00 x1866143414369024/t0(0) o101->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693322 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:0 May 25 03:15:22 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:15:22 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:15:41 oleg425-client kernel: Lustre: 10057:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693325/real 1779693325] req@ffffa09b061b3b80 x1866143414371200/t0(0) o36->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 488/512 e 0 to 1 dl 1779693341 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:4294967295 May 25 03:15:41 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:15:41 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:16:00 oleg425-client kernel: Lustre: 10083:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693344/real 1779693344] req@ffffa09b061b2300 x1866143414372480/t0(0) o34->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 472/728 e 0 to 1 dl 1779693360 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 May 25 03:16:00 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:16:00 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:16:19 oleg425-client kernel: Lustre: 10103:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693363/real 1779693363] req@ffffa09b0687e680 x1866143414373760/t0(0) o34->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 472/728 e 0 to 1 dl 1779693379 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 May 25 03:16:19 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:16:19 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:16:22 oleg425-client sshd[10200]: Accepted publickey for root from 192.168.204.25 port 43546 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:22 oleg425-client systemd-logind[1020]: New session 21 of user root. May 25 03:16:22 oleg425-client systemd[1]: Started Session 21 of user root. May 25 03:16:22 oleg425-client sshd[10200]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:22 oleg425-client sshd[10213]: Received disconnect from 192.168.204.25 port 43546:11: disconnected by user May 25 03:16:22 oleg425-client sshd[10213]: Disconnected from user root 192.168.204.25 port 43546 May 25 03:16:22 oleg425-client sshd[10200]: pam_unix(sshd:session): session closed for user root May 25 03:16:23 oleg425-client systemd[1]: session-21.scope: Succeeded. May 25 03:16:23 oleg425-client systemd-logind[1020]: Session 21 logged out. Waiting for processes to exit. May 25 03:16:23 oleg425-client systemd-logind[1020]: Removed session 21. May 25 03:16:23 oleg425-client sshd[10337]: Accepted publickey for root from 192.168.204.25 port 43560 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:23 oleg425-client systemd[1]: Started Session 22 of user root. May 25 03:16:23 oleg425-client systemd-logind[1020]: New session 22 of user root. May 25 03:16:23 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:16:23 oleg425-client sshd[10337]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:24 oleg425-client sshd[10351]: Received disconnect from 192.168.204.25 port 43560:11: disconnected by user May 25 03:16:24 oleg425-client sshd[10351]: Disconnected from user root 192.168.204.25 port 43560 May 25 03:16:24 oleg425-client sshd[10337]: pam_unix(sshd:session): session closed for user root May 25 03:16:24 oleg425-client systemd-logind[1020]: Session 22 logged out. Waiting for processes to exit. May 25 03:16:24 oleg425-client systemd[1]: session-22.scope: Succeeded. May 25 03:16:24 oleg425-client systemd-logind[1020]: Removed session 22. May 25 03:16:25 oleg425-client sshd[10483]: Accepted publickey for root from 192.168.204.25 port 58364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:25 oleg425-client systemd-logind[1020]: New session 23 of user root. May 25 03:16:25 oleg425-client systemd[1]: Started Session 23 of user root. May 25 03:16:25 oleg425-client sshd[10483]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:25 oleg425-client sshd[10496]: Received disconnect from 192.168.204.25 port 58364:11: disconnected by user May 25 03:16:25 oleg425-client sshd[10496]: Disconnected from user root 192.168.204.25 port 58364 May 25 03:16:25 oleg425-client sshd[10483]: pam_unix(sshd:session): session closed for user root May 25 03:16:25 oleg425-client systemd-logind[1020]: Session 23 logged out. Waiting for processes to exit. May 25 03:16:25 oleg425-client systemd[1]: session-23.scope: Succeeded. May 25 03:16:25 oleg425-client systemd-logind[1020]: Removed session 23. May 25 03:16:27 oleg425-client sshd[10638]: Accepted publickey for root from 192.168.204.25 port 58376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:27 oleg425-client systemd-logind[1020]: New session 24 of user root. May 25 03:16:27 oleg425-client systemd[1]: Started Session 24 of user root. May 25 03:16:27 oleg425-client sshd[10638]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:27 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 4: open: drop req, drop rep ======= 03:16:26 (1779693386) May 25 03:16:27 oleg425-client sshd[10651]: Received disconnect from 192.168.204.25 port 58376:11: disconnected by user May 25 03:16:28 oleg425-client sshd[10651]: Disconnected from user root 192.168.204.25 port 58376 May 25 03:16:28 oleg425-client sshd[10638]: pam_unix(sshd:session): session closed for user root May 25 03:16:28 oleg425-client systemd[1]: session-24.scope: Succeeded. May 25 03:16:28 oleg425-client systemd-logind[1020]: Session 24 logged out. Waiting for processes to exit. May 25 03:16:28 oleg425-client systemd-logind[1020]: Removed session 24. May 25 03:16:45 oleg425-client kernel: Lustre: 10707:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693389/real 1779693389] req@ffffa09b061b0380 x1866143414376064/t0(0) o101->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693405 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 May 25 03:16:45 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:16:45 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:17:06 oleg425-client sshd[10825]: Accepted publickey for root from 192.168.204.25 port 39920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:06 oleg425-client systemd-logind[1020]: New session 25 of user root. May 25 03:17:06 oleg425-client systemd[1]: Started Session 25 of user root. May 25 03:17:06 oleg425-client sshd[10825]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:06 oleg425-client sshd[10838]: Received disconnect from 192.168.204.25 port 39920:11: disconnected by user May 25 03:17:06 oleg425-client sshd[10838]: Disconnected from user root 192.168.204.25 port 39920 May 25 03:17:06 oleg425-client sshd[10825]: pam_unix(sshd:session): session closed for user root May 25 03:17:07 oleg425-client systemd[1]: session-25.scope: Succeeded. May 25 03:17:07 oleg425-client systemd-logind[1020]: Session 25 logged out. Waiting for processes to exit. May 25 03:17:07 oleg425-client systemd-logind[1020]: Removed session 25. May 25 03:17:08 oleg425-client sshd[10962]: Accepted publickey for root from 192.168.204.25 port 39936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:08 oleg425-client systemd-logind[1020]: New session 26 of user root. May 25 03:17:08 oleg425-client systemd[1]: Started Session 26 of user root. May 25 03:17:08 oleg425-client sshd[10962]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:09 oleg425-client sshd[10975]: Received disconnect from 192.168.204.25 port 39936:11: disconnected by user May 25 03:17:09 oleg425-client sshd[10975]: Disconnected from user root 192.168.204.25 port 39936 May 25 03:17:09 oleg425-client sshd[10962]: pam_unix(sshd:session): session closed for user root May 25 03:17:09 oleg425-client systemd[1]: session-26.scope: Succeeded. May 25 03:17:09 oleg425-client systemd-logind[1020]: Session 26 logged out. Waiting for processes to exit. May 25 03:17:09 oleg425-client systemd-logind[1020]: Removed session 26. May 25 03:17:10 oleg425-client sshd[11106]: Accepted publickey for root from 192.168.204.25 port 39946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:10 oleg425-client systemd-logind[1020]: New session 27 of user root. May 25 03:17:10 oleg425-client systemd[1]: Started Session 27 of user root. May 25 03:17:10 oleg425-client sshd[11106]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:11 oleg425-client sshd[11119]: Received disconnect from 192.168.204.25 port 39946:11: disconnected by user May 25 03:17:11 oleg425-client sshd[11119]: Disconnected from user root 192.168.204.25 port 39946 May 25 03:17:11 oleg425-client sshd[11106]: pam_unix(sshd:session): session closed for user root May 25 03:17:11 oleg425-client systemd[1]: session-27.scope: Succeeded. May 25 03:17:11 oleg425-client systemd-logind[1020]: Session 27 logged out. Waiting for processes to exit. May 25 03:17:11 oleg425-client systemd-logind[1020]: Removed session 27. May 25 03:17:12 oleg425-client sshd[11260]: Accepted publickey for root from 192.168.204.25 port 39952 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:13 oleg425-client systemd-logind[1020]: New session 28 of user root. May 25 03:17:13 oleg425-client systemd[1]: Started Session 28 of user root. May 25 03:17:13 oleg425-client sshd[11260]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:13 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 5: rename: drop req, drop rep ===== 03:17:11 (1779693431) May 25 03:17:13 oleg425-client sshd[11273]: Received disconnect from 192.168.204.25 port 39952:11: disconnected by user May 25 03:17:13 oleg425-client sshd[11273]: Disconnected from user root 192.168.204.25 port 39952 May 25 03:17:13 oleg425-client sshd[11260]: pam_unix(sshd:session): session closed for user root May 25 03:17:13 oleg425-client systemd[1]: session-28.scope: Succeeded. May 25 03:17:13 oleg425-client systemd-logind[1020]: Session 28 logged out. Waiting for processes to exit. May 25 03:17:13 oleg425-client systemd-logind[1020]: Removed session 28. May 25 03:17:30 oleg425-client kernel: Lustre: 11329:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693434/real 1779693434] req@ffffa09b0684ca80 x1866143414382720/t0(0) o101->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693450 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:0 May 25 03:17:30 oleg425-client kernel: Lustre: 11329:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message May 25 03:17:30 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:17:30 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 03:17:31 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:17:31 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 03:17:52 oleg425-client sshd[11460]: Accepted publickey for root from 192.168.204.25 port 38582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:52 oleg425-client systemd-logind[1020]: New session 29 of user root. May 25 03:17:52 oleg425-client systemd[1]: Started Session 29 of user root. May 25 03:17:52 oleg425-client sshd[11460]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:52 oleg425-client sshd[11473]: Received disconnect from 192.168.204.25 port 38582:11: disconnected by user May 25 03:17:52 oleg425-client sshd[11473]: Disconnected from user root 192.168.204.25 port 38582 May 25 03:17:52 oleg425-client sshd[11460]: pam_unix(sshd:session): session closed for user root May 25 03:17:52 oleg425-client systemd[1]: session-29.scope: Succeeded. May 25 03:17:52 oleg425-client systemd-logind[1020]: Session 29 logged out. Waiting for processes to exit. May 25 03:17:52 oleg425-client systemd-logind[1020]: Removed session 29. May 25 03:17:53 oleg425-client sshd[11597]: Accepted publickey for root from 192.168.204.25 port 38588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:54 oleg425-client systemd[1]: Started Session 30 of user root. May 25 03:17:54 oleg425-client systemd-logind[1020]: New session 30 of user root. May 25 03:17:54 oleg425-client sshd[11597]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:54 oleg425-client sshd[11610]: Received disconnect from 192.168.204.25 port 38588:11: disconnected by user May 25 03:17:54 oleg425-client sshd[11610]: Disconnected from user root 192.168.204.25 port 38588 May 25 03:17:54 oleg425-client sshd[11597]: pam_unix(sshd:session): session closed for user root May 25 03:17:54 oleg425-client systemd[1]: session-30.scope: Succeeded. May 25 03:17:54 oleg425-client systemd-logind[1020]: Session 30 logged out. Waiting for processes to exit. May 25 03:17:54 oleg425-client systemd-logind[1020]: Removed session 30. May 25 03:17:55 oleg425-client sshd[11741]: Accepted publickey for root from 192.168.204.25 port 42654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:55 oleg425-client systemd-logind[1020]: New session 31 of user root. May 25 03:17:55 oleg425-client systemd[1]: Started Session 31 of user root. May 25 03:17:55 oleg425-client sshd[11741]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:55 oleg425-client sshd[11754]: Received disconnect from 192.168.204.25 port 42654:11: disconnected by user May 25 03:17:55 oleg425-client sshd[11754]: Disconnected from user root 192.168.204.25 port 42654 May 25 03:17:55 oleg425-client sshd[11741]: pam_unix(sshd:session): session closed for user root May 25 03:17:55 oleg425-client systemd[1]: session-31.scope: Succeeded. May 25 03:17:55 oleg425-client systemd-logind[1020]: Session 31 logged out. Waiting for processes to exit. May 25 03:17:55 oleg425-client systemd-logind[1020]: Removed session 31. May 25 03:17:57 oleg425-client sshd[11894]: Accepted publickey for root from 192.168.204.25 port 42670 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:57 oleg425-client systemd-logind[1020]: New session 32 of user root. May 25 03:17:57 oleg425-client systemd[1]: Started Session 32 of user root. May 25 03:17:57 oleg425-client sshd[11894]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:57 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 6: link, unlink: drop req, drop rep ========================================================== 03:17:56 (1779693476) May 25 03:17:57 oleg425-client sshd[11907]: Received disconnect from 192.168.204.25 port 42670:11: disconnected by user May 25 03:17:57 oleg425-client sshd[11907]: Disconnected from user root 192.168.204.25 port 42670 May 25 03:17:57 oleg425-client sshd[11894]: pam_unix(sshd:session): session closed for user root May 25 03:17:57 oleg425-client systemd-logind[1020]: Session 32 logged out. Waiting for processes to exit. May 25 03:17:57 oleg425-client systemd[1]: session-32.scope: Succeeded. May 25 03:17:57 oleg425-client systemd-logind[1020]: Removed session 32. May 25 03:18:15 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b187f3000: disconnect after 21s idle May 25 03:18:15 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 03:18:51 oleg425-client kernel: Lustre: 12009:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693515/real 1779693515] req@ffffa09b0684e300 x1866143414395264/t0(0) o101->lustre-MDT0000-mdc-ffffa09b187f3000@192.168.204.125@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693531 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'unlink.0' uid:0 gid:0 projid:0 May 25 03:18:51 oleg425-client kernel: Lustre: 12009:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 3 previous similar messages May 25 03:18:51 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:18:51 oleg425-client kernel: Lustre: Skipped 3 previous similar messages May 25 03:18:51 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:18:51 oleg425-client kernel: Lustre: Skipped 3 previous similar messages May 25 03:19:12 oleg425-client sshd[12132]: Accepted publickey for root from 192.168.204.25 port 44132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:12 oleg425-client systemd[1]: Started Session 33 of user root. May 25 03:19:12 oleg425-client systemd-logind[1020]: New session 33 of user root. May 25 03:19:12 oleg425-client sshd[12132]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:12 oleg425-client sshd[12145]: Received disconnect from 192.168.204.25 port 44132:11: disconnected by user May 25 03:19:12 oleg425-client sshd[12145]: Disconnected from user root 192.168.204.25 port 44132 May 25 03:19:12 oleg425-client sshd[12132]: pam_unix(sshd:session): session closed for user root May 25 03:19:12 oleg425-client systemd[1]: session-33.scope: Succeeded. May 25 03:19:12 oleg425-client systemd-logind[1020]: Session 33 logged out. Waiting for processes to exit. May 25 03:19:12 oleg425-client systemd-logind[1020]: Removed session 33. May 25 03:19:13 oleg425-client sshd[12269]: Accepted publickey for root from 192.168.204.25 port 44148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:13 oleg425-client systemd[1]: Started Session 34 of user root. May 25 03:19:13 oleg425-client systemd-logind[1020]: New session 34 of user root. May 25 03:19:13 oleg425-client sshd[12269]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:13 oleg425-client sshd[12282]: Received disconnect from 192.168.204.25 port 44148:11: disconnected by user May 25 03:19:13 oleg425-client sshd[12282]: Disconnected from user root 192.168.204.25 port 44148 May 25 03:19:14 oleg425-client sshd[12269]: pam_unix(sshd:session): session closed for user root May 25 03:19:14 oleg425-client systemd[1]: session-34.scope: Succeeded. May 25 03:19:14 oleg425-client systemd-logind[1020]: Session 34 logged out. Waiting for processes to exit. May 25 03:19:14 oleg425-client systemd-logind[1020]: Removed session 34. May 25 03:19:14 oleg425-client sshd[12414]: Accepted publickey for root from 192.168.204.25 port 49416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:15 oleg425-client systemd-logind[1020]: New session 35 of user root. May 25 03:19:15 oleg425-client systemd[1]: Started Session 35 of user root. May 25 03:19:15 oleg425-client sshd[12414]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:15 oleg425-client sshd[12427]: Received disconnect from 192.168.204.25 port 49416:11: disconnected by user May 25 03:19:15 oleg425-client sshd[12427]: Disconnected from user root 192.168.204.25 port 49416 May 25 03:19:15 oleg425-client sshd[12414]: pam_unix(sshd:session): session closed for user root May 25 03:19:15 oleg425-client systemd-logind[1020]: Session 35 logged out. Waiting for processes to exit. May 25 03:19:15 oleg425-client systemd[1]: session-35.scope: Succeeded. May 25 03:19:15 oleg425-client systemd-logind[1020]: Removed session 35. May 25 03:19:16 oleg425-client sshd[12567]: Accepted publickey for root from 192.168.204.25 port 49426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:17 oleg425-client systemd[1]: Started Session 36 of user root. May 25 03:19:17 oleg425-client systemd-logind[1020]: New session 36 of user root. May 25 03:19:17 oleg425-client sshd[12567]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:17 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 8: touch: drop rep (bug 1423) ===== 03:19:15 (1779693555) May 25 03:19:17 oleg425-client sshd[12580]: Received disconnect from 192.168.204.25 port 49426:11: disconnected by user May 25 03:19:17 oleg425-client sshd[12580]: Disconnected from user root 192.168.204.25 port 49426 May 25 03:19:17 oleg425-client sshd[12567]: pam_unix(sshd:session): session closed for user root May 25 03:19:17 oleg425-client systemd[1]: session-36.scope: Succeeded. May 25 03:19:17 oleg425-client systemd-logind[1020]: Session 36 logged out. Waiting for processes to exit. May 25 03:19:17 oleg425-client systemd-logind[1020]: Removed session 36. May 25 03:19:37 oleg425-client sshd[12720]: Accepted publickey for root from 192.168.204.25 port 45228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:37 oleg425-client systemd[1]: Started Session 37 of user root. May 25 03:19:37 oleg425-client systemd-logind[1020]: New session 37 of user root. May 25 03:19:37 oleg425-client sshd[12720]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:38 oleg425-client sshd[12733]: Received disconnect from 192.168.204.25 port 45228:11: disconnected by user May 25 03:19:38 oleg425-client sshd[12733]: Disconnected from user root 192.168.204.25 port 45228 May 25 03:19:38 oleg425-client sshd[12720]: pam_unix(sshd:session): session closed for user root May 25 03:19:38 oleg425-client systemd[1]: session-37.scope: Succeeded. May 25 03:19:38 oleg425-client systemd-logind[1020]: Session 37 logged out. Waiting for processes to exit. May 25 03:19:38 oleg425-client systemd-logind[1020]: Removed session 37. May 25 03:19:39 oleg425-client sshd[12857]: Accepted publickey for root from 192.168.204.25 port 45230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:39 oleg425-client systemd-logind[1020]: New session 38 of user root. May 25 03:19:39 oleg425-client systemd[1]: Started Session 38 of user root. May 25 03:19:39 oleg425-client sshd[12857]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:39 oleg425-client sshd[12870]: Received disconnect from 192.168.204.25 port 45230:11: disconnected by user May 25 03:19:39 oleg425-client sshd[12870]: Disconnected from user root 192.168.204.25 port 45230 May 25 03:19:40 oleg425-client sshd[12857]: pam_unix(sshd:session): session closed for user root May 25 03:19:40 oleg425-client systemd[1]: session-38.scope: Succeeded. May 25 03:19:40 oleg425-client systemd-logind[1020]: Session 38 logged out. Waiting for processes to exit. May 25 03:19:40 oleg425-client systemd-logind[1020]: Removed session 38. May 25 03:19:40 oleg425-client sshd[13002]: Accepted publickey for root from 192.168.204.25 port 45242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:41 oleg425-client systemd-logind[1020]: New session 39 of user root. May 25 03:19:41 oleg425-client systemd[1]: Started Session 39 of user root. May 25 03:19:41 oleg425-client sshd[13002]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:41 oleg425-client sshd[13016]: Received disconnect from 192.168.204.25 port 45242:11: disconnected by user May 25 03:19:41 oleg425-client sshd[13016]: Disconnected from user root 192.168.204.25 port 45242 May 25 03:19:41 oleg425-client sshd[13002]: pam_unix(sshd:session): session closed for user root May 25 03:19:41 oleg425-client systemd-logind[1020]: Session 39 logged out. Waiting for processes to exit. May 25 03:19:41 oleg425-client systemd[1]: session-39.scope: Succeeded. May 25 03:19:41 oleg425-client systemd-logind[1020]: Removed session 39. May 25 03:19:42 oleg425-client sshd[13156]: Accepted publickey for root from 192.168.204.25 port 45246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:42 oleg425-client systemd[1]: Started Session 40 of user root. May 25 03:19:42 oleg425-client systemd-logind[1020]: New session 40 of user root. May 25 03:19:42 oleg425-client sshd[13156]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:43 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 9: pause bulk on OST (bug 1420) === 03:19:41 (1779693581) May 25 03:19:43 oleg425-client sshd[13169]: Received disconnect from 192.168.204.25 port 45246:11: disconnected by user May 25 03:19:43 oleg425-client sshd[13169]: Disconnected from user root 192.168.204.25 port 45246 May 25 03:19:43 oleg425-client sshd[13156]: pam_unix(sshd:session): session closed for user root May 25 03:19:43 oleg425-client systemd-logind[1020]: Session 40 logged out. Waiting for processes to exit. May 25 03:19:43 oleg425-client systemd[1]: session-40.scope: Succeeded. May 25 03:19:43 oleg425-client systemd-logind[1020]: Removed session 40. May 25 03:19:53 oleg425-client sshd[13394]: Accepted publickey for root from 192.168.204.25 port 50140 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:53 oleg425-client systemd[1]: Started Session 41 of user root. May 25 03:19:53 oleg425-client systemd-logind[1020]: New session 41 of user root. May 25 03:19:53 oleg425-client sshd[13394]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:53 oleg425-client sshd[13407]: Received disconnect from 192.168.204.25 port 50140:11: disconnected by user May 25 03:19:53 oleg425-client sshd[13407]: Disconnected from user root 192.168.204.25 port 50140 May 25 03:19:53 oleg425-client sshd[13394]: pam_unix(sshd:session): session closed for user root May 25 03:19:54 oleg425-client systemd[1]: session-41.scope: Succeeded. May 25 03:19:54 oleg425-client systemd-logind[1020]: Session 41 logged out. Waiting for processes to exit. May 25 03:19:54 oleg425-client systemd-logind[1020]: Removed session 41. May 25 03:19:55 oleg425-client sshd[13531]: Accepted publickey for root from 192.168.204.25 port 60962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:55 oleg425-client systemd-logind[1020]: New session 42 of user root. May 25 03:19:55 oleg425-client systemd[1]: Started Session 42 of user root. May 25 03:19:55 oleg425-client sshd[13531]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:55 oleg425-client sshd[13544]: Received disconnect from 192.168.204.25 port 60962:11: disconnected by user May 25 03:19:55 oleg425-client sshd[13544]: Disconnected from user root 192.168.204.25 port 60962 May 25 03:19:55 oleg425-client sshd[13531]: pam_unix(sshd:session): session closed for user root May 25 03:19:55 oleg425-client systemd[1]: session-42.scope: Succeeded. May 25 03:19:55 oleg425-client systemd-logind[1020]: Session 42 logged out. Waiting for processes to exit. May 25 03:19:55 oleg425-client systemd-logind[1020]: Removed session 42. May 25 03:19:56 oleg425-client sshd[13675]: Accepted publickey for root from 192.168.204.25 port 60966 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:56 oleg425-client systemd-logind[1020]: New session 43 of user root. May 25 03:19:56 oleg425-client systemd[1]: Started Session 43 of user root. May 25 03:19:56 oleg425-client sshd[13675]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:57 oleg425-client sshd[13688]: Received disconnect from 192.168.204.25 port 60966:11: disconnected by user May 25 03:19:57 oleg425-client sshd[13688]: Disconnected from user root 192.168.204.25 port 60966 May 25 03:19:57 oleg425-client sshd[13675]: pam_unix(sshd:session): session closed for user root May 25 03:19:57 oleg425-client systemd-logind[1020]: Session 43 logged out. Waiting for processes to exit. May 25 03:19:57 oleg425-client systemd[1]: session-43.scope: Succeeded. May 25 03:19:57 oleg425-client systemd-logind[1020]: Removed session 43. May 25 03:19:58 oleg425-client sshd[13828]: Accepted publickey for root from 192.168.204.25 port 60978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:19:58 oleg425-client systemd-logind[1020]: New session 44 of user root. May 25 03:19:58 oleg425-client systemd[1]: Started Session 44 of user root. May 25 03:19:58 oleg425-client sshd[13828]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:19:59 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 03:19:57 (1779693597) May 25 03:19:59 oleg425-client sshd[13841]: Received disconnect from 192.168.204.25 port 60978:11: disconnected by user May 25 03:19:59 oleg425-client sshd[13841]: Disconnected from user root 192.168.204.25 port 60978 May 25 03:19:59 oleg425-client sshd[13828]: pam_unix(sshd:session): session closed for user root May 25 03:19:59 oleg425-client systemd[1]: session-44.scope: Succeeded. May 25 03:19:59 oleg425-client systemd-logind[1020]: Session 44 logged out. Waiting for processes to exit. May 25 03:19:59 oleg425-client systemd-logind[1020]: Removed session 44. May 25 03:20:00 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:20:16 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:20:20 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b187f3000: disconnect after 23s idle May 25 03:20:32 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:20:48 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:21:04 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:21:19 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:21:36 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:21:53 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b187f3000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -107 May 25 03:21:53 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:21:53 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:21:53 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b187f3000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:21:53 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b187f3000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:21:53 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:21:57 oleg425-client sshd[14084]: Accepted publickey for root from 192.168.204.25 port 53782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:57 oleg425-client systemd-logind[1020]: New session 45 of user root. May 25 03:21:57 oleg425-client systemd[1]: Started Session 45 of user root. May 25 03:21:57 oleg425-client sshd[14084]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:57 oleg425-client sshd[14098]: Received disconnect from 192.168.204.25 port 53782:11: disconnected by user May 25 03:21:57 oleg425-client sshd[14098]: Disconnected from user root 192.168.204.25 port 53782 May 25 03:21:57 oleg425-client sshd[14084]: pam_unix(sshd:session): session closed for user root May 25 03:21:58 oleg425-client systemd[1]: session-45.scope: Succeeded. May 25 03:21:58 oleg425-client systemd-logind[1020]: Session 45 logged out. Waiting for processes to exit. May 25 03:21:58 oleg425-client systemd-logind[1020]: Removed session 45. May 25 03:21:58 oleg425-client sshd[14223]: Accepted publickey for root from 192.168.204.25 port 53790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:58 oleg425-client systemd-logind[1020]: New session 46 of user root. May 25 03:21:58 oleg425-client systemd[1]: Started Session 46 of user root. May 25 03:21:59 oleg425-client sshd[14223]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:59 oleg425-client sshd[14236]: Received disconnect from 192.168.204.25 port 53790:11: disconnected by user May 25 03:21:59 oleg425-client sshd[14236]: Disconnected from user root 192.168.204.25 port 53790 May 25 03:21:59 oleg425-client sshd[14223]: pam_unix(sshd:session): session closed for user root May 25 03:21:59 oleg425-client systemd[1]: session-46.scope: Succeeded. May 25 03:21:59 oleg425-client systemd-logind[1020]: Session 46 logged out. Waiting for processes to exit. May 25 03:21:59 oleg425-client systemd-logind[1020]: Removed session 46. May 25 03:22:00 oleg425-client sshd[14367]: Accepted publickey for root from 192.168.204.25 port 53794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:01 oleg425-client systemd-logind[1020]: New session 47 of user root. May 25 03:22:01 oleg425-client systemd[1]: Started Session 47 of user root. May 25 03:22:01 oleg425-client sshd[14367]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:01 oleg425-client sshd[14380]: Received disconnect from 192.168.204.25 port 53794:11: disconnected by user May 25 03:22:01 oleg425-client sshd[14380]: Disconnected from user root 192.168.204.25 port 53794 May 25 03:22:01 oleg425-client sshd[14367]: pam_unix(sshd:session): session closed for user root May 25 03:22:01 oleg425-client systemd-logind[1020]: Session 47 logged out. Waiting for processes to exit. May 25 03:22:01 oleg425-client systemd[1]: session-47.scope: Succeeded. May 25 03:22:02 oleg425-client systemd-logind[1020]: Removed session 47. May 25 03:22:03 oleg425-client sshd[14521]: Accepted publickey for root from 192.168.204.25 port 53798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:03 oleg425-client systemd[1]: Started Session 48 of user root. May 25 03:22:03 oleg425-client systemd-logind[1020]: New session 48 of user root. May 25 03:22:03 oleg425-client sshd[14521]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:04 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10b: re-send BL AST =============== 03:22:02 (1779693722) May 25 03:22:04 oleg425-client sshd[14534]: Received disconnect from 192.168.204.25 port 53798:11: disconnected by user May 25 03:22:04 oleg425-client sshd[14534]: Disconnected from user root 192.168.204.25 port 53798 May 25 03:22:04 oleg425-client sshd[14521]: pam_unix(sshd:session): session closed for user root May 25 03:22:04 oleg425-client systemd[1]: session-48.scope: Succeeded. May 25 03:22:04 oleg425-client systemd-logind[1020]: Session 48 logged out. Waiting for processes to exit. May 25 03:22:04 oleg425-client systemd-logind[1020]: Removed session 48. May 25 03:22:18 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b187f3000: disconnect after 23s idle May 25 03:22:23 oleg425-client sshd[14729]: Accepted publickey for root from 192.168.204.25 port 58178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:23 oleg425-client systemd-logind[1020]: New session 49 of user root. May 25 03:22:23 oleg425-client systemd[1]: Started Session 49 of user root. May 25 03:22:23 oleg425-client sshd[14729]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:23 oleg425-client sshd[14742]: Received disconnect from 192.168.204.25 port 58178:11: disconnected by user May 25 03:22:23 oleg425-client sshd[14742]: Disconnected from user root 192.168.204.25 port 58178 May 25 03:22:23 oleg425-client sshd[14729]: pam_unix(sshd:session): session closed for user root May 25 03:22:23 oleg425-client systemd[1]: session-49.scope: Succeeded. May 25 03:22:23 oleg425-client systemd-logind[1020]: Session 49 logged out. Waiting for processes to exit. May 25 03:22:23 oleg425-client systemd-logind[1020]: Removed session 49. May 25 03:22:25 oleg425-client sshd[14867]: Accepted publickey for root from 192.168.204.25 port 60224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:25 oleg425-client systemd[1]: Started Session 50 of user root. May 25 03:22:25 oleg425-client systemd-logind[1020]: New session 50 of user root. May 25 03:22:25 oleg425-client sshd[14867]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:25 oleg425-client sshd[14880]: Received disconnect from 192.168.204.25 port 60224:11: disconnected by user May 25 03:22:25 oleg425-client sshd[14880]: Disconnected from user root 192.168.204.25 port 60224 May 25 03:22:25 oleg425-client sshd[14867]: pam_unix(sshd:session): session closed for user root May 25 03:22:25 oleg425-client systemd[1]: session-50.scope: Succeeded. May 25 03:22:25 oleg425-client systemd-logind[1020]: Session 50 logged out. Waiting for processes to exit. May 25 03:22:25 oleg425-client systemd-logind[1020]: Removed session 50. May 25 03:22:27 oleg425-client sshd[15011]: Accepted publickey for root from 192.168.204.25 port 60230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:27 oleg425-client systemd-logind[1020]: New session 51 of user root. May 25 03:22:27 oleg425-client systemd[1]: Started Session 51 of user root. May 25 03:22:27 oleg425-client sshd[15011]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:27 oleg425-client sshd[15024]: Received disconnect from 192.168.204.25 port 60230:11: disconnected by user May 25 03:22:27 oleg425-client sshd[15024]: Disconnected from user root 192.168.204.25 port 60230 May 25 03:22:27 oleg425-client sshd[15011]: pam_unix(sshd:session): session closed for user root May 25 03:22:27 oleg425-client systemd-logind[1020]: Session 51 logged out. Waiting for processes to exit. May 25 03:22:27 oleg425-client systemd[1]: session-51.scope: Succeeded. May 25 03:22:27 oleg425-client systemd-logind[1020]: Removed session 51. May 25 03:22:29 oleg425-client sshd[15164]: Accepted publickey for root from 192.168.204.25 port 60232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:29 oleg425-client systemd-logind[1020]: New session 52 of user root. May 25 03:22:29 oleg425-client systemd[1]: Started Session 52 of user root. May 25 03:22:29 oleg425-client sshd[15164]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:29 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10c: re-send BL AST vs reconnect race (LU-5569) ========================================================== 03:22:28 (1779693748) May 25 03:22:29 oleg425-client sshd[15177]: Received disconnect from 192.168.204.25 port 60232:11: disconnected by user May 25 03:22:29 oleg425-client sshd[15177]: Disconnected from user root 192.168.204.25 port 60232 May 25 03:22:29 oleg425-client sshd[15164]: pam_unix(sshd:session): session closed for user root May 25 03:22:29 oleg425-client systemd[1]: session-52.scope: Succeeded. May 25 03:22:29 oleg425-client systemd-logind[1020]: Session 52 logged out. Waiting for processes to exit. May 25 03:22:29 oleg425-client systemd-logind[1020]: Removed session 52. May 25 03:22:30 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:22:30 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 03:22:32 oleg425-client sshd[15364]: Accepted publickey for root from 192.168.204.25 port 60244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:32 oleg425-client systemd[1]: Started Session 53 of user root. May 25 03:22:32 oleg425-client systemd-logind[1020]: New session 53 of user root. May 25 03:22:32 oleg425-client sshd[15364]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:32 oleg425-client sshd[15377]: Received disconnect from 192.168.204.25 port 60244:11: disconnected by user May 25 03:22:32 oleg425-client sshd[15377]: Disconnected from user root 192.168.204.25 port 60244 May 25 03:22:32 oleg425-client sshd[15364]: pam_unix(sshd:session): session closed for user root May 25 03:22:33 oleg425-client systemd-logind[1020]: Session 53 logged out. Waiting for processes to exit. May 25 03:22:33 oleg425-client systemd[1]: session-53.scope: Succeeded. May 25 03:22:33 oleg425-client systemd-logind[1020]: Removed session 53. May 25 03:22:33 oleg425-client sshd[15501]: Accepted publickey for root from 192.168.204.25 port 60248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:33 oleg425-client systemd-logind[1020]: New session 54 of user root. May 25 03:22:33 oleg425-client systemd[1]: Started Session 54 of user root. May 25 03:22:33 oleg425-client sshd[15501]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:34 oleg425-client sshd[15514]: Received disconnect from 192.168.204.25 port 60248:11: disconnected by user May 25 03:22:34 oleg425-client sshd[15514]: Disconnected from user root 192.168.204.25 port 60248 May 25 03:22:34 oleg425-client sshd[15501]: pam_unix(sshd:session): session closed for user root May 25 03:22:34 oleg425-client systemd-logind[1020]: Session 54 logged out. Waiting for processes to exit. May 25 03:22:34 oleg425-client systemd[1]: session-54.scope: Succeeded. May 25 03:22:34 oleg425-client systemd-logind[1020]: Removed session 54. May 25 03:22:35 oleg425-client sshd[15647]: Accepted publickey for root from 192.168.204.25 port 42736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:35 oleg425-client systemd[1]: Started Session 55 of user root. May 25 03:22:35 oleg425-client systemd-logind[1020]: New session 55 of user root. May 25 03:22:35 oleg425-client sshd[15647]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:36 oleg425-client sshd[15660]: Received disconnect from 192.168.204.25 port 42736:11: disconnected by user May 25 03:22:36 oleg425-client sshd[15660]: Disconnected from user root 192.168.204.25 port 42736 May 25 03:22:36 oleg425-client sshd[15647]: pam_unix(sshd:session): session closed for user root May 25 03:22:36 oleg425-client systemd[1]: session-55.scope: Succeeded. May 25 03:22:36 oleg425-client systemd-logind[1020]: Session 55 logged out. Waiting for processes to exit. May 25 03:22:36 oleg425-client systemd-logind[1020]: Removed session 55. May 25 03:22:37 oleg425-client sshd[15801]: Accepted publickey for root from 192.168.204.25 port 42748 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:37 oleg425-client systemd[1]: Started Session 56 of user root. May 25 03:22:37 oleg425-client systemd-logind[1020]: New session 56 of user root. May 25 03:22:37 oleg425-client sshd[15801]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:37 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10d: test failed blocking ast ===== 03:22:36 (1779693756) May 25 03:22:37 oleg425-client sshd[15814]: Received disconnect from 192.168.204.25 port 42748:11: disconnected by user May 25 03:22:37 oleg425-client sshd[15814]: Disconnected from user root 192.168.204.25 port 42748 May 25 03:22:37 oleg425-client sshd[15801]: pam_unix(sshd:session): session closed for user root May 25 03:22:38 oleg425-client systemd[1]: session-56.scope: Succeeded. May 25 03:22:38 oleg425-client systemd-logind[1020]: Session 56 logged out. Waiting for processes to exit. May 25 03:22:38 oleg425-client systemd-logind[1020]: Removed session 56. May 25 03:22:41 oleg425-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 03:22:41 oleg425-client kernel: LustreError: 15875:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b187f3000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:22:41 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 03:22:42 oleg425-client systemd-udevd[15910]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:22:42 oleg425-client kernel: Lustre: Mounted lustre-client May 25 03:22:42 oleg425-client systemd-udevd[15942]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:22:44 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ost_statfs to node 192.168.204.125@tcp failed: rc = -107 May 25 03:22:44 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:22:44 oleg425-client kernel: Lustre: 2372:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.125@tcp:/lustre/fid: [0x200000403:0x1:0x0]/ may get corrupted (rc -108) May 25 03:22:47 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:22:47 oleg425-client kernel: LustreError: 16056:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b093be000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:22:47 oleg425-client kernel: LustreError: 16056:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:22:47 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 03:22:48 oleg425-client sshd[16143]: Accepted publickey for root from 192.168.204.25 port 49334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:48 oleg425-client systemd-logind[1020]: New session 57 of user root. May 25 03:22:48 oleg425-client systemd[1]: Started Session 57 of user root. May 25 03:22:48 oleg425-client sshd[16143]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:49 oleg425-client sshd[16156]: Received disconnect from 192.168.204.25 port 49334:11: disconnected by user May 25 03:22:49 oleg425-client sshd[16156]: Disconnected from user root 192.168.204.25 port 49334 May 25 03:22:49 oleg425-client sshd[16143]: pam_unix(sshd:session): session closed for user root May 25 03:22:49 oleg425-client systemd[1]: session-57.scope: Succeeded. May 25 03:22:49 oleg425-client systemd-logind[1020]: Session 57 logged out. Waiting for processes to exit. May 25 03:22:49 oleg425-client systemd-logind[1020]: Removed session 57. May 25 03:22:51 oleg425-client sshd[16281]: Accepted publickey for root from 192.168.204.25 port 49340 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:51 oleg425-client systemd[1]: Started Session 58 of user root. May 25 03:22:51 oleg425-client systemd-logind[1020]: New session 58 of user root. May 25 03:22:51 oleg425-client sshd[16281]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:52 oleg425-client sshd[16294]: Received disconnect from 192.168.204.25 port 49340:11: disconnected by user May 25 03:22:52 oleg425-client sshd[16294]: Disconnected from user root 192.168.204.25 port 49340 May 25 03:22:52 oleg425-client sshd[16281]: pam_unix(sshd:session): session closed for user root May 25 03:22:52 oleg425-client systemd[1]: session-58.scope: Succeeded. May 25 03:22:52 oleg425-client systemd-logind[1020]: Session 58 logged out. Waiting for processes to exit. May 25 03:22:52 oleg425-client systemd-logind[1020]: Removed session 58. May 25 03:22:53 oleg425-client sshd[16425]: Accepted publickey for root from 192.168.204.25 port 49352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:53 oleg425-client systemd[1]: Started Session 59 of user root. May 25 03:22:53 oleg425-client systemd-logind[1020]: New session 59 of user root. May 25 03:22:53 oleg425-client sshd[16425]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:53 oleg425-client sshd[16438]: Received disconnect from 192.168.204.25 port 49352:11: disconnected by user May 25 03:22:53 oleg425-client sshd[16438]: Disconnected from user root 192.168.204.25 port 49352 May 25 03:22:53 oleg425-client sshd[16425]: pam_unix(sshd:session): session closed for user root May 25 03:22:54 oleg425-client systemd[1]: session-59.scope: Succeeded. May 25 03:22:54 oleg425-client systemd-logind[1020]: Session 59 logged out. Waiting for processes to exit. May 25 03:22:54 oleg425-client systemd-logind[1020]: Removed session 59. May 25 03:22:55 oleg425-client sshd[16579]: Accepted publickey for root from 192.168.204.25 port 43936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:56 oleg425-client systemd-logind[1020]: New session 60 of user root. May 25 03:22:56 oleg425-client systemd[1]: Started Session 60 of user root. May 25 03:22:56 oleg425-client sshd[16579]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:56 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10e: re-send BL AST vs reconnect race 2 ========================================================== 03:22:54 (1779693774) May 25 03:22:56 oleg425-client sshd[16592]: Received disconnect from 192.168.204.25 port 43936:11: disconnected by user May 25 03:22:56 oleg425-client sshd[16592]: Disconnected from user root 192.168.204.25 port 43936 May 25 03:22:56 oleg425-client sshd[16579]: pam_unix(sshd:session): session closed for user root May 25 03:22:56 oleg425-client systemd[1]: session-60.scope: Succeeded. May 25 03:22:56 oleg425-client systemd-logind[1020]: Session 60 logged out. Waiting for processes to exit. May 25 03:22:56 oleg425-client systemd-logind[1020]: Removed session 60. May 25 03:22:57 oleg425-client sshd[16718]: Accepted publickey for root from 192.168.204.25 port 43946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:57 oleg425-client systemd-logind[1020]: New session 61 of user root. May 25 03:22:57 oleg425-client systemd[1]: Started Session 61 of user root. May 25 03:22:57 oleg425-client sshd[16718]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:58 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_10e need two clients May 25 03:22:58 oleg425-client sshd[16731]: Received disconnect from 192.168.204.25 port 43946:11: disconnected by user May 25 03:22:58 oleg425-client sshd[16731]: Disconnected from user root 192.168.204.25 port 43946 May 25 03:22:58 oleg425-client sshd[16718]: pam_unix(sshd:session): session closed for user root May 25 03:22:58 oleg425-client systemd[1]: session-61.scope: Succeeded. May 25 03:22:58 oleg425-client systemd-logind[1020]: Session 61 logged out. Waiting for processes to exit. May 25 03:22:58 oleg425-client systemd-logind[1020]: Removed session 61. May 25 03:22:59 oleg425-client sshd[16870]: Accepted publickey for root from 192.168.204.25 port 43948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:59 oleg425-client systemd-logind[1020]: New session 62 of user root. May 25 03:22:59 oleg425-client systemd[1]: Started Session 62 of user root. May 25 03:22:59 oleg425-client sshd[16870]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:00 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 11: wake up a thread waiting for completion after eviction (b=2460) ========================================================== 03:22:58 (1779693778) May 25 03:23:00 oleg425-client sshd[16883]: Received disconnect from 192.168.204.25 port 43948:11: disconnected by user May 25 03:23:00 oleg425-client sshd[16883]: Disconnected from user root 192.168.204.25 port 43948 May 25 03:23:00 oleg425-client sshd[16870]: pam_unix(sshd:session): session closed for user root May 25 03:23:00 oleg425-client systemd-logind[1020]: Session 62 logged out. Waiting for processes to exit. May 25 03:23:00 oleg425-client systemd[1]: session-62.scope: Succeeded. May 25 03:23:00 oleg425-client systemd-logind[1020]: Removed session 62. May 25 03:23:19 oleg425-client sshd[16992]: Accepted publickey for root from 192.168.204.25 port 46040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:19 oleg425-client systemd-logind[1020]: New session 63 of user root. May 25 03:23:19 oleg425-client systemd[1]: Started Session 63 of user root. May 25 03:23:19 oleg425-client sshd[16992]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:19 oleg425-client sshd[17006]: Received disconnect from 192.168.204.25 port 46040:11: disconnected by user May 25 03:23:19 oleg425-client sshd[17006]: Disconnected from user root 192.168.204.25 port 46040 May 25 03:23:19 oleg425-client sshd[16992]: pam_unix(sshd:session): session closed for user root May 25 03:23:19 oleg425-client systemd-logind[1020]: Session 63 logged out. Waiting for processes to exit. May 25 03:23:19 oleg425-client systemd[1]: session-63.scope: Succeeded. May 25 03:23:19 oleg425-client systemd-logind[1020]: Removed session 63. May 25 03:23:20 oleg425-client sshd[17123]: Accepted publickey for root from 192.168.204.25 port 46044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:20 oleg425-client systemd[1]: Started Session 64 of user root. May 25 03:23:20 oleg425-client systemd-logind[1020]: New session 64 of user root. May 25 03:23:20 oleg425-client sshd[17123]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:20 oleg425-client sshd[17136]: Received disconnect from 192.168.204.25 port 46044:11: disconnected by user May 25 03:23:20 oleg425-client sshd[17136]: Disconnected from user root 192.168.204.25 port 46044 May 25 03:23:20 oleg425-client sshd[17123]: pam_unix(sshd:session): session closed for user root May 25 03:23:21 oleg425-client systemd[1]: session-64.scope: Succeeded. May 25 03:23:21 oleg425-client systemd-logind[1020]: Session 64 logged out. Waiting for processes to exit. May 25 03:23:21 oleg425-client systemd-logind[1020]: Removed session 64. May 25 03:23:22 oleg425-client sshd[17260]: Accepted publickey for root from 192.168.204.25 port 46060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:22 oleg425-client systemd-logind[1020]: New session 65 of user root. May 25 03:23:22 oleg425-client systemd[1]: Started Session 65 of user root. May 25 03:23:22 oleg425-client sshd[17260]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:23 oleg425-client sshd[17273]: Received disconnect from 192.168.204.25 port 46060:11: disconnected by user May 25 03:23:23 oleg425-client sshd[17273]: Disconnected from user root 192.168.204.25 port 46060 May 25 03:23:23 oleg425-client sshd[17260]: pam_unix(sshd:session): session closed for user root May 25 03:23:23 oleg425-client systemd-logind[1020]: Session 65 logged out. Waiting for processes to exit. May 25 03:23:23 oleg425-client systemd[1]: session-65.scope: Succeeded. May 25 03:23:23 oleg425-client systemd-logind[1020]: Removed session 65. May 25 03:23:24 oleg425-client sshd[17404]: Accepted publickey for root from 192.168.204.25 port 56462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:24 oleg425-client systemd[1]: Started Session 66 of user root. May 25 03:23:24 oleg425-client systemd-logind[1020]: New session 66 of user root. May 25 03:23:24 oleg425-client sshd[17404]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:25 oleg425-client sshd[17417]: Received disconnect from 192.168.204.25 port 56462:11: disconnected by user May 25 03:23:25 oleg425-client sshd[17417]: Disconnected from user root 192.168.204.25 port 56462 May 25 03:23:25 oleg425-client sshd[17404]: pam_unix(sshd:session): session closed for user root May 25 03:23:25 oleg425-client systemd-logind[1020]: Session 66 logged out. Waiting for processes to exit. May 25 03:23:25 oleg425-client systemd[1]: session-66.scope: Succeeded. May 25 03:23:25 oleg425-client systemd-logind[1020]: Removed session 66. May 25 03:23:26 oleg425-client sshd[17557]: Accepted publickey for root from 192.168.204.25 port 56466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:26 oleg425-client systemd-logind[1020]: New session 67 of user root. May 25 03:23:26 oleg425-client systemd[1]: Started Session 67 of user root. May 25 03:23:26 oleg425-client sshd[17557]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:26 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 12: recover from timed out resend in ptlrpcd (b=2494) ========================================================== 03:23:25 (1779693805) May 25 03:23:26 oleg425-client sshd[17571]: Received disconnect from 192.168.204.25 port 56466:11: disconnected by user May 25 03:23:26 oleg425-client sshd[17571]: Disconnected from user root 192.168.204.25 port 56466 May 25 03:23:26 oleg425-client kernel: Lustre: DEBUG MARKER: multiop /mnt/lustre/f12.recovery-small OS_c May 25 03:23:26 oleg425-client sshd[17557]: pam_unix(sshd:session): session closed for user root May 25 03:23:27 oleg425-client systemd[1]: session-67.scope: Succeeded. May 25 03:23:27 oleg425-client systemd-logind[1020]: Session 67 logged out. Waiting for processes to exit. May 25 03:23:27 oleg425-client systemd-logind[1020]: Removed session 67. May 25 03:23:36 oleg425-client systemd[1]: Starting Cleanup of Temporary Directories... May 25 03:23:36 oleg425-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. May 25 03:23:36 oleg425-client systemd[1]: Started Cleanup of Temporary Directories. May 25 03:23:43 oleg425-client kernel: Lustre: 17618:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693807/real 1779693807] req@ffffa09b0684d500 x1866143414465280/t0(0) o35->lustre-MDT0000-mdc-ffffa09b0ab14000@192.168.204.125@tcp:23/10 lens 392/624 e 0 to 1 dl 1779693823 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 May 25 03:23:43 oleg425-client kernel: Lustre: 17618:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 03:23:44 oleg425-client sshd[17638]: Accepted publickey for root from 192.168.204.25 port 58900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:44 oleg425-client systemd[1]: Started Session 68 of user root. May 25 03:23:44 oleg425-client systemd-logind[1020]: New session 68 of user root. May 25 03:23:44 oleg425-client sshd[17638]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:45 oleg425-client sshd[17651]: Received disconnect from 192.168.204.25 port 58900:11: disconnected by user May 25 03:23:45 oleg425-client sshd[17651]: Disconnected from user root 192.168.204.25 port 58900 May 25 03:23:45 oleg425-client sshd[17638]: pam_unix(sshd:session): session closed for user root May 25 03:23:45 oleg425-client systemd-logind[1020]: Session 68 logged out. Waiting for processes to exit. May 25 03:23:45 oleg425-client systemd[1]: session-68.scope: Succeeded. May 25 03:23:45 oleg425-client systemd-logind[1020]: Removed session 68. May 25 03:23:46 oleg425-client sshd[17768]: Accepted publickey for root from 192.168.204.25 port 58902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:46 oleg425-client systemd-logind[1020]: New session 69 of user root. May 25 03:23:46 oleg425-client systemd[1]: Started Session 69 of user root. May 25 03:23:46 oleg425-client sshd[17768]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:47 oleg425-client sshd[17781]: Received disconnect from 192.168.204.25 port 58902:11: disconnected by user May 25 03:23:47 oleg425-client sshd[17781]: Disconnected from user root 192.168.204.25 port 58902 May 25 03:23:47 oleg425-client sshd[17768]: pam_unix(sshd:session): session closed for user root May 25 03:23:47 oleg425-client systemd[1]: session-69.scope: Succeeded. May 25 03:23:47 oleg425-client systemd-logind[1020]: Session 69 logged out. Waiting for processes to exit. May 25 03:23:47 oleg425-client systemd-logind[1020]: Removed session 69. May 25 03:23:49 oleg425-client sshd[17905]: Accepted publickey for root from 192.168.204.25 port 58904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:49 oleg425-client systemd-logind[1020]: New session 70 of user root. May 25 03:23:49 oleg425-client systemd[1]: Started Session 70 of user root. May 25 03:23:49 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:23:49 oleg425-client sshd[17905]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:49 oleg425-client sshd[17919]: Received disconnect from 192.168.204.25 port 58904:11: disconnected by user May 25 03:23:49 oleg425-client sshd[17919]: Disconnected from user root 192.168.204.25 port 58904 May 25 03:23:49 oleg425-client sshd[17905]: pam_unix(sshd:session): session closed for user root May 25 03:23:49 oleg425-client systemd[1]: session-70.scope: Succeeded. May 25 03:23:49 oleg425-client systemd-logind[1020]: Session 70 logged out. Waiting for processes to exit. May 25 03:23:49 oleg425-client systemd-logind[1020]: Removed session 70. May 25 03:23:50 oleg425-client sshd[18050]: Accepted publickey for root from 192.168.204.25 port 58920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:50 oleg425-client systemd-logind[1020]: New session 71 of user root. May 25 03:23:50 oleg425-client systemd[1]: Started Session 71 of user root. May 25 03:23:50 oleg425-client sshd[18050]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:51 oleg425-client sshd[18064]: Received disconnect from 192.168.204.25 port 58920:11: disconnected by user May 25 03:23:51 oleg425-client sshd[18064]: Disconnected from user root 192.168.204.25 port 58920 May 25 03:23:51 oleg425-client sshd[18050]: pam_unix(sshd:session): session closed for user root May 25 03:23:51 oleg425-client systemd-logind[1020]: Session 71 logged out. Waiting for processes to exit. May 25 03:23:51 oleg425-client systemd[1]: session-71.scope: Succeeded. May 25 03:23:51 oleg425-client systemd-logind[1020]: Removed session 71. May 25 03:24:10 oleg425-client sshd[18214]: Accepted publickey for root from 192.168.204.25 port 50724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:10 oleg425-client systemd[1]: Started Session 72 of user root. May 25 03:24:10 oleg425-client systemd-logind[1020]: New session 72 of user root. May 25 03:24:10 oleg425-client sshd[18214]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 13: mdc_readpage restart test (bug 1138) ========================================================== 03:24:09 (1779693849) May 25 03:24:11 oleg425-client sshd[18227]: Received disconnect from 192.168.204.25 port 50724:11: disconnected by user May 25 03:24:11 oleg425-client sshd[18227]: Disconnected from user root 192.168.204.25 port 50724 May 25 03:24:11 oleg425-client sshd[18214]: pam_unix(sshd:session): session closed for user root May 25 03:24:11 oleg425-client systemd-logind[1020]: Session 72 logged out. Waiting for processes to exit. May 25 03:24:11 oleg425-client systemd[1]: session-72.scope: Succeeded. May 25 03:24:11 oleg425-client systemd-logind[1020]: Removed session 72. May 25 03:24:31 oleg425-client sshd[18370]: Accepted publickey for root from 192.168.204.25 port 41276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:31 oleg425-client systemd-logind[1020]: New session 73 of user root. May 25 03:24:31 oleg425-client systemd[1]: Started Session 73 of user root. May 25 03:24:31 oleg425-client sshd[18370]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:32 oleg425-client sshd[18384]: Received disconnect from 192.168.204.25 port 41276:11: disconnected by user May 25 03:24:32 oleg425-client sshd[18384]: Disconnected from user root 192.168.204.25 port 41276 May 25 03:24:32 oleg425-client sshd[18370]: pam_unix(sshd:session): session closed for user root May 25 03:24:32 oleg425-client systemd-logind[1020]: Session 73 logged out. Waiting for processes to exit. May 25 03:24:32 oleg425-client systemd[1]: session-73.scope: Succeeded. May 25 03:24:32 oleg425-client systemd-logind[1020]: Removed session 73. May 25 03:24:33 oleg425-client sshd[18508]: Accepted publickey for root from 192.168.204.25 port 41284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:33 oleg425-client systemd-logind[1020]: New session 74 of user root. May 25 03:24:33 oleg425-client systemd[1]: Started Session 74 of user root. May 25 03:24:33 oleg425-client sshd[18508]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:33 oleg425-client sshd[18521]: Received disconnect from 192.168.204.25 port 41284:11: disconnected by user May 25 03:24:33 oleg425-client sshd[18521]: Disconnected from user root 192.168.204.25 port 41284 May 25 03:24:33 oleg425-client sshd[18508]: pam_unix(sshd:session): session closed for user root May 25 03:24:33 oleg425-client systemd[1]: session-74.scope: Succeeded. May 25 03:24:33 oleg425-client systemd-logind[1020]: Session 74 logged out. Waiting for processes to exit. May 25 03:24:33 oleg425-client systemd-logind[1020]: Removed session 74. May 25 03:24:34 oleg425-client sshd[18652]: Accepted publickey for root from 192.168.204.25 port 34962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:34 oleg425-client systemd-logind[1020]: New session 75 of user root. May 25 03:24:34 oleg425-client systemd[1]: Started Session 75 of user root. May 25 03:24:34 oleg425-client sshd[18652]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:35 oleg425-client sshd[18665]: Received disconnect from 192.168.204.25 port 34962:11: disconnected by user May 25 03:24:35 oleg425-client sshd[18665]: Disconnected from user root 192.168.204.25 port 34962 May 25 03:24:35 oleg425-client sshd[18652]: pam_unix(sshd:session): session closed for user root May 25 03:24:35 oleg425-client systemd-logind[1020]: Session 75 logged out. Waiting for processes to exit. May 25 03:24:35 oleg425-client systemd[1]: session-75.scope: Succeeded. May 25 03:24:35 oleg425-client systemd-logind[1020]: Removed session 75. May 25 03:24:36 oleg425-client sshd[18805]: Accepted publickey for root from 192.168.204.25 port 34972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:36 oleg425-client systemd-logind[1020]: New session 76 of user root. May 25 03:24:36 oleg425-client systemd[1]: Started Session 76 of user root. May 25 03:24:36 oleg425-client sshd[18805]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:37 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 14: mdc_readpage resend test (bug 1138) ========================================================== 03:24:35 (1779693875) May 25 03:24:37 oleg425-client sshd[18818]: Received disconnect from 192.168.204.25 port 34972:11: disconnected by user May 25 03:24:37 oleg425-client sshd[18818]: Disconnected from user root 192.168.204.25 port 34972 May 25 03:24:37 oleg425-client sshd[18805]: pam_unix(sshd:session): session closed for user root May 25 03:24:37 oleg425-client systemd-logind[1020]: Session 76 logged out. Waiting for processes to exit. May 25 03:24:37 oleg425-client systemd[1]: session-76.scope: Succeeded. May 25 03:24:37 oleg425-client systemd-logind[1020]: Removed session 76. May 25 03:24:40 oleg425-client sshd[18957]: Accepted publickey for root from 192.168.204.25 port 34976 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:40 oleg425-client systemd-logind[1020]: New session 77 of user root. May 25 03:24:40 oleg425-client systemd[1]: Started Session 77 of user root. May 25 03:24:40 oleg425-client sshd[18957]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:41 oleg425-client sshd[18970]: Received disconnect from 192.168.204.25 port 34976:11: disconnected by user May 25 03:24:41 oleg425-client sshd[18970]: Disconnected from user root 192.168.204.25 port 34976 May 25 03:24:41 oleg425-client sshd[18957]: pam_unix(sshd:session): session closed for user root May 25 03:24:41 oleg425-client systemd[1]: session-77.scope: Succeeded. May 25 03:24:41 oleg425-client systemd-logind[1020]: Session 77 logged out. Waiting for processes to exit. May 25 03:24:41 oleg425-client systemd-logind[1020]: Removed session 77. May 25 03:24:42 oleg425-client sshd[19094]: Accepted publickey for root from 192.168.204.25 port 34992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:42 oleg425-client systemd-logind[1020]: New session 78 of user root. May 25 03:24:42 oleg425-client systemd[1]: Started Session 78 of user root. May 25 03:24:42 oleg425-client sshd[19094]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:43 oleg425-client sshd[19107]: Received disconnect from 192.168.204.25 port 34992:11: disconnected by user May 25 03:24:43 oleg425-client sshd[19107]: Disconnected from user root 192.168.204.25 port 34992 May 25 03:24:43 oleg425-client sshd[19094]: pam_unix(sshd:session): session closed for user root May 25 03:24:43 oleg425-client systemd[1]: session-78.scope: Succeeded. May 25 03:24:43 oleg425-client systemd-logind[1020]: Session 78 logged out. Waiting for processes to exit. May 25 03:24:43 oleg425-client systemd-logind[1020]: Removed session 78. May 25 03:24:44 oleg425-client sshd[19239]: Accepted publickey for root from 192.168.204.25 port 44706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:44 oleg425-client systemd[1]: Started Session 79 of user root. May 25 03:24:44 oleg425-client systemd-logind[1020]: New session 79 of user root. May 25 03:24:44 oleg425-client sshd[19239]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:45 oleg425-client sshd[19252]: Received disconnect from 192.168.204.25 port 44706:11: disconnected by user May 25 03:24:45 oleg425-client sshd[19252]: Disconnected from user root 192.168.204.25 port 44706 May 25 03:24:45 oleg425-client sshd[19239]: pam_unix(sshd:session): session closed for user root May 25 03:24:45 oleg425-client systemd[1]: session-79.scope: Succeeded. May 25 03:24:45 oleg425-client systemd-logind[1020]: Session 79 logged out. Waiting for processes to exit. May 25 03:24:45 oleg425-client systemd-logind[1020]: Removed session 79. May 25 03:24:46 oleg425-client sshd[19392]: Accepted publickey for root from 192.168.204.25 port 44716 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:46 oleg425-client systemd-logind[1020]: New session 80 of user root. May 25 03:24:46 oleg425-client systemd[1]: Started Session 80 of user root. May 25 03:24:46 oleg425-client sshd[19392]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:47 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 15: failed open (-ENOMEM) ========= 03:24:45 (1779693885) May 25 03:24:47 oleg425-client sshd[19405]: Received disconnect from 192.168.204.25 port 44716:11: disconnected by user May 25 03:24:47 oleg425-client sshd[19405]: Disconnected from user root 192.168.204.25 port 44716 May 25 03:24:47 oleg425-client sshd[19392]: pam_unix(sshd:session): session closed for user root May 25 03:24:47 oleg425-client systemd[1]: session-80.scope: Succeeded. May 25 03:24:47 oleg425-client systemd-logind[1020]: Session 80 logged out. Waiting for processes to exit. May 25 03:24:47 oleg425-client systemd-logind[1020]: Removed session 80. May 25 03:24:49 oleg425-client sshd[19533]: Accepted publickey for root from 192.168.204.25 port 44722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:49 oleg425-client systemd-logind[1020]: New session 81 of user root. May 25 03:24:49 oleg425-client systemd[1]: Started Session 81 of user root. May 25 03:24:49 oleg425-client sshd[19533]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:49 oleg425-client sshd[19546]: Received disconnect from 192.168.204.25 port 44722:11: disconnected by user May 25 03:24:49 oleg425-client sshd[19546]: Disconnected from user root 192.168.204.25 port 44722 May 25 03:24:49 oleg425-client sshd[19533]: pam_unix(sshd:session): session closed for user root May 25 03:24:49 oleg425-client systemd-logind[1020]: Session 81 logged out. Waiting for processes to exit. May 25 03:24:49 oleg425-client systemd[1]: session-81.scope: Succeeded. May 25 03:24:49 oleg425-client systemd-logind[1020]: Removed session 81. May 25 03:24:50 oleg425-client sshd[19670]: Accepted publickey for root from 192.168.204.25 port 44732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:50 oleg425-client systemd[1]: Started Session 82 of user root. May 25 03:24:50 oleg425-client systemd-logind[1020]: New session 82 of user root. May 25 03:24:50 oleg425-client sshd[19670]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:51 oleg425-client sshd[19684]: Received disconnect from 192.168.204.25 port 44732:11: disconnected by user May 25 03:24:51 oleg425-client sshd[19684]: Disconnected from user root 192.168.204.25 port 44732 May 25 03:24:51 oleg425-client sshd[19670]: pam_unix(sshd:session): session closed for user root May 25 03:24:51 oleg425-client systemd[1]: session-82.scope: Succeeded. May 25 03:24:51 oleg425-client systemd-logind[1020]: Session 82 logged out. Waiting for processes to exit. May 25 03:24:51 oleg425-client systemd-logind[1020]: Removed session 82. May 25 03:24:52 oleg425-client sshd[19815]: Accepted publickey for root from 192.168.204.25 port 44736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:52 oleg425-client systemd[1]: Started Session 83 of user root. May 25 03:24:52 oleg425-client systemd-logind[1020]: New session 83 of user root. May 25 03:24:52 oleg425-client sshd[19815]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:52 oleg425-client sshd[19828]: Received disconnect from 192.168.204.25 port 44736:11: disconnected by user May 25 03:24:52 oleg425-client sshd[19828]: Disconnected from user root 192.168.204.25 port 44736 May 25 03:24:52 oleg425-client sshd[19815]: pam_unix(sshd:session): session closed for user root May 25 03:24:52 oleg425-client systemd[1]: session-83.scope: Succeeded. May 25 03:24:52 oleg425-client systemd-logind[1020]: Session 83 logged out. Waiting for processes to exit. May 25 03:24:52 oleg425-client systemd-logind[1020]: Removed session 83. May 25 03:24:53 oleg425-client sshd[19971]: Accepted publickey for root from 192.168.204.25 port 44738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:53 oleg425-client systemd-logind[1020]: New session 84 of user root. May 25 03:24:53 oleg425-client systemd[1]: Started Session 84 of user root. May 25 03:24:53 oleg425-client sshd[19971]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:54 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 16: timeout bulk put, don't evict client (2732) ========================================================== 03:24:53 (1779693893) May 25 03:24:54 oleg425-client sshd[19984]: Received disconnect from 192.168.204.25 port 44738:11: disconnected by user May 25 03:24:54 oleg425-client sshd[19984]: Disconnected from user root 192.168.204.25 port 44738 May 25 03:24:54 oleg425-client sshd[19971]: pam_unix(sshd:session): session closed for user root May 25 03:24:54 oleg425-client systemd[1]: session-84.scope: Succeeded. May 25 03:24:54 oleg425-client systemd-logind[1020]: Session 84 logged out. Waiting for processes to exit. May 25 03:24:54 oleg425-client systemd-logind[1020]: Removed session 84. May 25 03:25:35 oleg425-client sshd[20191]: Accepted publickey for root from 192.168.204.25 port 50256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:25:35 oleg425-client systemd-logind[1020]: New session 85 of user root. May 25 03:25:35 oleg425-client systemd[1]: Started Session 85 of user root. May 25 03:25:36 oleg425-client sshd[20191]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:25:36 oleg425-client sshd[20204]: Received disconnect from 192.168.204.25 port 50256:11: disconnected by user May 25 03:25:36 oleg425-client sshd[20204]: Disconnected from user root 192.168.204.25 port 50256 May 25 03:25:36 oleg425-client sshd[20191]: pam_unix(sshd:session): session closed for user root May 25 03:25:36 oleg425-client systemd[1]: session-85.scope: Succeeded. May 25 03:25:36 oleg425-client systemd-logind[1020]: Session 85 logged out. Waiting for processes to exit. May 25 03:25:36 oleg425-client systemd-logind[1020]: Removed session 85. May 25 03:25:38 oleg425-client sshd[20329]: Accepted publickey for root from 192.168.204.25 port 50272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:25:38 oleg425-client systemd[1]: Started Session 86 of user root. May 25 03:25:38 oleg425-client systemd-logind[1020]: New session 86 of user root. May 25 03:25:38 oleg425-client sshd[20329]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:25:38 oleg425-client sshd[20342]: Received disconnect from 192.168.204.25 port 50272:11: disconnected by user May 25 03:25:38 oleg425-client sshd[20342]: Disconnected from user root 192.168.204.25 port 50272 May 25 03:25:38 oleg425-client sshd[20329]: pam_unix(sshd:session): session closed for user root May 25 03:25:38 oleg425-client systemd-logind[1020]: Session 86 logged out. Waiting for processes to exit. May 25 03:25:38 oleg425-client systemd[1]: session-86.scope: Succeeded. May 25 03:25:38 oleg425-client systemd-logind[1020]: Removed session 86. May 25 03:25:39 oleg425-client sshd[20473]: Accepted publickey for root from 192.168.204.25 port 50284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:25:39 oleg425-client systemd-logind[1020]: New session 87 of user root. May 25 03:25:39 oleg425-client systemd[1]: Started Session 87 of user root. May 25 03:25:39 oleg425-client sshd[20473]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:25:40 oleg425-client sshd[20486]: Received disconnect from 192.168.204.25 port 50284:11: disconnected by user May 25 03:25:40 oleg425-client sshd[20486]: Disconnected from user root 192.168.204.25 port 50284 May 25 03:25:40 oleg425-client sshd[20473]: pam_unix(sshd:session): session closed for user root May 25 03:25:40 oleg425-client systemd-logind[1020]: Session 87 logged out. Waiting for processes to exit. May 25 03:25:40 oleg425-client systemd[1]: session-87.scope: Succeeded. May 25 03:25:40 oleg425-client systemd-logind[1020]: Removed session 87. May 25 03:25:42 oleg425-client sshd[20626]: Accepted publickey for root from 192.168.204.25 port 50286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:25:42 oleg425-client systemd-logind[1020]: New session 88 of user root. May 25 03:25:42 oleg425-client systemd[1]: Started Session 88 of user root. May 25 03:25:42 oleg425-client sshd[20626]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:25:42 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17a: timeout bulk get, don't evict client (2732) ========================================================== 03:25:40 (1779693940) May 25 03:25:42 oleg425-client sshd[20639]: Received disconnect from 192.168.204.25 port 50286:11: disconnected by user May 25 03:25:42 oleg425-client sshd[20639]: Disconnected from user root 192.168.204.25 port 50286 May 25 03:25:42 oleg425-client sshd[20626]: pam_unix(sshd:session): session closed for user root May 25 03:25:42 oleg425-client systemd[1]: session-88.scope: Succeeded. May 25 03:25:42 oleg425-client systemd-logind[1020]: Session 88 logged out. Waiting for processes to exit. May 25 03:25:42 oleg425-client systemd-logind[1020]: Removed session 88. May 25 03:26:31 oleg425-client sshd[20980]: Accepted publickey for root from 192.168.204.25 port 52316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:31 oleg425-client systemd[1]: Started Session 89 of user root. May 25 03:26:31 oleg425-client systemd-logind[1020]: New session 89 of user root. May 25 03:26:31 oleg425-client sshd[20980]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:31 oleg425-client sshd[20993]: Received disconnect from 192.168.204.25 port 52316:11: disconnected by user May 25 03:26:31 oleg425-client sshd[20993]: Disconnected from user root 192.168.204.25 port 52316 May 25 03:26:31 oleg425-client sshd[20980]: pam_unix(sshd:session): session closed for user root May 25 03:26:31 oleg425-client systemd[1]: session-89.scope: Succeeded. May 25 03:26:31 oleg425-client systemd-logind[1020]: Session 89 logged out. Waiting for processes to exit. May 25 03:26:31 oleg425-client systemd-logind[1020]: Removed session 89. May 25 03:26:32 oleg425-client sshd[21117]: Accepted publickey for root from 192.168.204.25 port 52324 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:32 oleg425-client systemd-logind[1020]: New session 90 of user root. May 25 03:26:32 oleg425-client systemd[1]: Started Session 90 of user root. May 25 03:26:32 oleg425-client sshd[21117]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:33 oleg425-client sshd[21130]: Received disconnect from 192.168.204.25 port 52324:11: disconnected by user May 25 03:26:33 oleg425-client sshd[21130]: Disconnected from user root 192.168.204.25 port 52324 May 25 03:26:33 oleg425-client sshd[21117]: pam_unix(sshd:session): session closed for user root May 25 03:26:33 oleg425-client systemd[1]: session-90.scope: Succeeded. May 25 03:26:33 oleg425-client systemd-logind[1020]: Session 90 logged out. Waiting for processes to exit. May 25 03:26:33 oleg425-client systemd-logind[1020]: Removed session 90. May 25 03:26:34 oleg425-client sshd[21261]: Accepted publickey for root from 192.168.204.25 port 49656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:34 oleg425-client systemd-logind[1020]: New session 91 of user root. May 25 03:26:34 oleg425-client systemd[1]: Started Session 91 of user root. May 25 03:26:34 oleg425-client sshd[21261]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:35 oleg425-client sshd[21274]: Received disconnect from 192.168.204.25 port 49656:11: disconnected by user May 25 03:26:35 oleg425-client sshd[21274]: Disconnected from user root 192.168.204.25 port 49656 May 25 03:26:35 oleg425-client sshd[21261]: pam_unix(sshd:session): session closed for user root May 25 03:26:35 oleg425-client systemd[1]: session-91.scope: Succeeded. May 25 03:26:35 oleg425-client systemd-logind[1020]: Session 91 logged out. Waiting for processes to exit. May 25 03:26:35 oleg425-client systemd-logind[1020]: Removed session 91. May 25 03:26:36 oleg425-client sshd[21414]: Accepted publickey for root from 192.168.204.25 port 49658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:36 oleg425-client systemd-logind[1020]: New session 92 of user root. May 25 03:26:36 oleg425-client systemd[1]: Started Session 92 of user root. May 25 03:26:36 oleg425-client sshd[21414]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:37 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17b: timeout bulk get, dont evict client (3582) ========================================================== 03:26:35 (1779693995) May 25 03:26:37 oleg425-client sshd[21427]: Received disconnect from 192.168.204.25 port 49658:11: disconnected by user May 25 03:26:37 oleg425-client sshd[21427]: Disconnected from user root 192.168.204.25 port 49658 May 25 03:26:37 oleg425-client sshd[21414]: pam_unix(sshd:session): session closed for user root May 25 03:26:37 oleg425-client systemd[1]: session-92.scope: Succeeded. May 25 03:26:37 oleg425-client systemd-logind[1020]: Session 92 logged out. Waiting for processes to exit. May 25 03:26:37 oleg425-client systemd-logind[1020]: Removed session 92. May 25 03:26:38 oleg425-client sshd[21551]: Accepted publickey for root from 192.168.204.25 port 49660 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:38 oleg425-client systemd-logind[1020]: New session 93 of user root. May 25 03:26:38 oleg425-client systemd[1]: Started Session 93 of user root. May 25 03:26:38 oleg425-client sshd[21551]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:38 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_17b Needs multiple clients May 25 03:26:38 oleg425-client sshd[21564]: Received disconnect from 192.168.204.25 port 49660:11: disconnected by user May 25 03:26:38 oleg425-client sshd[21564]: Disconnected from user root 192.168.204.25 port 49660 May 25 03:26:38 oleg425-client sshd[21551]: pam_unix(sshd:session): session closed for user root May 25 03:26:38 oleg425-client systemd-logind[1020]: Session 93 logged out. Waiting for processes to exit. May 25 03:26:38 oleg425-client systemd[1]: session-93.scope: Succeeded. May 25 03:26:39 oleg425-client systemd-logind[1020]: Removed session 93. May 25 03:26:40 oleg425-client sshd[21703]: Accepted publickey for root from 192.168.204.25 port 49666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:40 oleg425-client systemd-logind[1020]: New session 94 of user root. May 25 03:26:40 oleg425-client systemd[1]: Started Session 94 of user root. May 25 03:26:40 oleg425-client sshd[21703]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:41 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18a: manual ost invalidate clears page cache immediately ========================================================== 03:26:39 (1779693999) May 25 03:26:41 oleg425-client sshd[21716]: Received disconnect from 192.168.204.25 port 49666:11: disconnected by user May 25 03:26:41 oleg425-client sshd[21716]: Disconnected from user root 192.168.204.25 port 49666 May 25 03:26:41 oleg425-client sshd[21703]: pam_unix(sshd:session): session closed for user root May 25 03:26:41 oleg425-client systemd[1]: session-94.scope: Succeeded. May 25 03:26:41 oleg425-client systemd-logind[1020]: Session 94 logged out. Waiting for processes to exit. May 25 03:26:41 oleg425-client systemd-logind[1020]: Removed session 94. May 25 03:26:42 oleg425-client kernel: Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request May 25 03:26:42 oleg425-client kernel: Lustre: lustre-OST0001-osc-ffffa09b0ab14000: Connection to lustre-OST0001 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:26:42 oleg425-client kernel: Lustre: Skipped 5 previous similar messages May 25 03:26:42 oleg425-client kernel: LustreError: lustre-OST0001-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. May 25 03:26:43 oleg425-client sshd[21880]: Accepted publickey for root from 192.168.204.25 port 49668 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:44 oleg425-client systemd-logind[1020]: New session 95 of user root. May 25 03:26:44 oleg425-client systemd[1]: Started Session 95 of user root. May 25 03:26:44 oleg425-client sshd[21880]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:44 oleg425-client sshd[21893]: Received disconnect from 192.168.204.25 port 49668:11: disconnected by user May 25 03:26:44 oleg425-client sshd[21893]: Disconnected from user root 192.168.204.25 port 49668 May 25 03:26:44 oleg425-client sshd[21880]: pam_unix(sshd:session): session closed for user root May 25 03:26:44 oleg425-client systemd[1]: session-95.scope: Succeeded. May 25 03:26:44 oleg425-client systemd-logind[1020]: Session 95 logged out. Waiting for processes to exit. May 25 03:26:44 oleg425-client systemd-logind[1020]: Removed session 95. May 25 03:26:45 oleg425-client sshd[22017]: Accepted publickey for root from 192.168.204.25 port 34648 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:45 oleg425-client systemd-logind[1020]: New session 96 of user root. May 25 03:26:45 oleg425-client systemd[1]: Started Session 96 of user root. May 25 03:26:45 oleg425-client sshd[22017]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:46 oleg425-client sshd[22030]: Received disconnect from 192.168.204.25 port 34648:11: disconnected by user May 25 03:26:46 oleg425-client sshd[22030]: Disconnected from user root 192.168.204.25 port 34648 May 25 03:26:46 oleg425-client sshd[22017]: pam_unix(sshd:session): session closed for user root May 25 03:26:46 oleg425-client systemd[1]: session-96.scope: Succeeded. May 25 03:26:46 oleg425-client systemd-logind[1020]: Session 96 logged out. Waiting for processes to exit. May 25 03:26:46 oleg425-client systemd-logind[1020]: Removed session 96. May 25 03:26:47 oleg425-client sshd[22161]: Accepted publickey for root from 192.168.204.25 port 34652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:47 oleg425-client systemd-logind[1020]: New session 97 of user root. May 25 03:26:47 oleg425-client systemd[1]: Started Session 97 of user root. May 25 03:26:47 oleg425-client sshd[22161]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:48 oleg425-client sshd[22174]: Received disconnect from 192.168.204.25 port 34652:11: disconnected by user May 25 03:26:48 oleg425-client sshd[22174]: Disconnected from user root 192.168.204.25 port 34652 May 25 03:26:48 oleg425-client sshd[22161]: pam_unix(sshd:session): session closed for user root May 25 03:26:48 oleg425-client systemd[1]: session-97.scope: Succeeded. May 25 03:26:48 oleg425-client systemd-logind[1020]: Session 97 logged out. Waiting for processes to exit. May 25 03:26:48 oleg425-client systemd-logind[1020]: Removed session 97. May 25 03:26:49 oleg425-client sshd[22315]: Accepted publickey for root from 192.168.204.25 port 34668 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:49 oleg425-client systemd[1]: Started Session 98 of user root. May 25 03:26:49 oleg425-client systemd-logind[1020]: New session 98 of user root. May 25 03:26:49 oleg425-client sshd[22315]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:49 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18b: eviction and reconnect clears page cache (2766) ========================================================== 03:26:48 (1779694008) May 25 03:26:49 oleg425-client sshd[22328]: Received disconnect from 192.168.204.25 port 34668:11: disconnected by user May 25 03:26:50 oleg425-client sshd[22328]: Disconnected from user root 192.168.204.25 port 34668 May 25 03:26:50 oleg425-client sshd[22315]: pam_unix(sshd:session): session closed for user root May 25 03:26:50 oleg425-client systemd-logind[1020]: Session 98 logged out. Waiting for processes to exit. May 25 03:26:50 oleg425-client systemd[1]: session-98.scope: Succeeded. May 25 03:26:50 oleg425-client systemd-logind[1020]: Removed session 98. May 25 03:26:55 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:26:55 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab14000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:26:55 oleg425-client kernel: Lustre: Skipped 4 previous similar messages May 25 03:27:15 oleg425-client sshd[22530]: Accepted publickey for root from 192.168.204.25 port 57154 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:15 oleg425-client systemd-logind[1020]: New session 99 of user root. May 25 03:27:15 oleg425-client systemd[1]: Started Session 99 of user root. May 25 03:27:15 oleg425-client sshd[22530]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:15 oleg425-client sshd[22543]: Received disconnect from 192.168.204.25 port 57154:11: disconnected by user May 25 03:27:15 oleg425-client sshd[22543]: Disconnected from user root 192.168.204.25 port 57154 May 25 03:27:15 oleg425-client sshd[22530]: pam_unix(sshd:session): session closed for user root May 25 03:27:15 oleg425-client systemd[1]: session-99.scope: Succeeded. May 25 03:27:15 oleg425-client systemd-logind[1020]: Session 99 logged out. Waiting for processes to exit. May 25 03:27:15 oleg425-client systemd-logind[1020]: Removed session 99. May 25 03:27:17 oleg425-client sshd[22668]: Accepted publickey for root from 192.168.204.25 port 57158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:17 oleg425-client systemd-logind[1020]: New session 100 of user root. May 25 03:27:17 oleg425-client systemd[1]: Started Session 100 of user root. May 25 03:27:17 oleg425-client sshd[22668]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:17 oleg425-client sshd[22681]: Received disconnect from 192.168.204.25 port 57158:11: disconnected by user May 25 03:27:17 oleg425-client sshd[22681]: Disconnected from user root 192.168.204.25 port 57158 May 25 03:27:17 oleg425-client sshd[22668]: pam_unix(sshd:session): session closed for user root May 25 03:27:18 oleg425-client systemd-logind[1020]: Session 100 logged out. Waiting for processes to exit. May 25 03:27:18 oleg425-client systemd[1]: session-100.scope: Succeeded. May 25 03:27:18 oleg425-client systemd-logind[1020]: Removed session 100. May 25 03:27:19 oleg425-client sshd[22812]: Accepted publickey for root from 192.168.204.25 port 57174 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:19 oleg425-client systemd[1]: Started Session 101 of user root. May 25 03:27:19 oleg425-client systemd-logind[1020]: New session 101 of user root. May 25 03:27:19 oleg425-client sshd[22812]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:19 oleg425-client sshd[22825]: Received disconnect from 192.168.204.25 port 57174:11: disconnected by user May 25 03:27:19 oleg425-client sshd[22825]: Disconnected from user root 192.168.204.25 port 57174 May 25 03:27:19 oleg425-client sshd[22812]: pam_unix(sshd:session): session closed for user root May 25 03:27:19 oleg425-client systemd-logind[1020]: Session 101 logged out. Waiting for processes to exit. May 25 03:27:19 oleg425-client systemd[1]: session-101.scope: Succeeded. May 25 03:27:19 oleg425-client systemd-logind[1020]: Removed session 101. May 25 03:27:20 oleg425-client sshd[22965]: Accepted publickey for root from 192.168.204.25 port 57182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:21 oleg425-client systemd-logind[1020]: New session 102 of user root. May 25 03:27:21 oleg425-client systemd[1]: Started Session 102 of user root. May 25 03:27:21 oleg425-client sshd[22965]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:21 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18c: Dropped connect reply after eviction handing (14755) ========================================================== 03:27:20 (1779694040) May 25 03:27:21 oleg425-client sshd[22978]: Received disconnect from 192.168.204.25 port 57182:11: disconnected by user May 25 03:27:21 oleg425-client sshd[22978]: Disconnected from user root 192.168.204.25 port 57182 May 25 03:27:21 oleg425-client sshd[22965]: pam_unix(sshd:session): session closed for user root May 25 03:27:21 oleg425-client systemd[1]: session-102.scope: Succeeded. May 25 03:27:21 oleg425-client systemd-logind[1020]: Session 102 logged out. Waiting for processes to exit. May 25 03:27:21 oleg425-client systemd-logind[1020]: Removed session 102. May 25 03:27:25 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ost_statfs to node 192.168.204.125@tcp failed: rc = -107 May 25 03:27:35 oleg425-client kernel: Lustre: Evicted from lustre-OST0000_UUID (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008b49b6 to 0x799e3d1c008b4b06 May 25 03:27:35 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:27:38 oleg425-client sshd[23190]: Accepted publickey for root from 192.168.204.25 port 43490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:38 oleg425-client systemd[1]: Started Session 103 of user root. May 25 03:27:38 oleg425-client systemd-logind[1020]: New session 103 of user root. May 25 03:27:38 oleg425-client sshd[23190]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:39 oleg425-client sshd[23203]: Received disconnect from 192.168.204.25 port 43490:11: disconnected by user May 25 03:27:39 oleg425-client sshd[23203]: Disconnected from user root 192.168.204.25 port 43490 May 25 03:27:39 oleg425-client sshd[23190]: pam_unix(sshd:session): session closed for user root May 25 03:27:39 oleg425-client systemd[1]: session-103.scope: Succeeded. May 25 03:27:39 oleg425-client systemd-logind[1020]: Session 103 logged out. Waiting for processes to exit. May 25 03:27:39 oleg425-client systemd-logind[1020]: Removed session 103. May 25 03:27:40 oleg425-client sshd[23327]: Accepted publickey for root from 192.168.204.25 port 43504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:40 oleg425-client systemd-logind[1020]: New session 104 of user root. May 25 03:27:40 oleg425-client systemd[1]: Started Session 104 of user root. May 25 03:27:40 oleg425-client sshd[23327]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:41 oleg425-client sshd[23340]: Received disconnect from 192.168.204.25 port 43504:11: disconnected by user May 25 03:27:41 oleg425-client sshd[23340]: Disconnected from user root 192.168.204.25 port 43504 May 25 03:27:41 oleg425-client sshd[23327]: pam_unix(sshd:session): session closed for user root May 25 03:27:41 oleg425-client systemd[1]: session-104.scope: Succeeded. May 25 03:27:41 oleg425-client systemd-logind[1020]: Session 104 logged out. Waiting for processes to exit. May 25 03:27:41 oleg425-client systemd-logind[1020]: Removed session 104. May 25 03:27:42 oleg425-client sshd[23471]: Accepted publickey for root from 192.168.204.25 port 43506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:42 oleg425-client systemd[1]: Started Session 105 of user root. May 25 03:27:42 oleg425-client systemd-logind[1020]: New session 105 of user root. May 25 03:27:42 oleg425-client sshd[23471]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:42 oleg425-client sshd[23484]: Received disconnect from 192.168.204.25 port 43506:11: disconnected by user May 25 03:27:42 oleg425-client sshd[23484]: Disconnected from user root 192.168.204.25 port 43506 May 25 03:27:42 oleg425-client sshd[23471]: pam_unix(sshd:session): session closed for user root May 25 03:27:43 oleg425-client systemd[1]: session-105.scope: Succeeded. May 25 03:27:43 oleg425-client systemd-logind[1020]: Session 105 logged out. Waiting for processes to exit. May 25 03:27:43 oleg425-client systemd-logind[1020]: Removed session 105. May 25 03:27:44 oleg425-client sshd[23625]: Accepted publickey for root from 192.168.204.25 port 49242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:44 oleg425-client systemd-logind[1020]: New session 106 of user root. May 25 03:27:44 oleg425-client systemd[1]: Started Session 106 of user root. May 25 03:27:44 oleg425-client sshd[23625]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:44 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19a: test expired_lock_main on mds (2867) ========================================================== 03:27:43 (1779694063) May 25 03:27:44 oleg425-client sshd[23638]: Received disconnect from 192.168.204.25 port 49242:11: disconnected by user May 25 03:27:44 oleg425-client sshd[23638]: Disconnected from user root 192.168.204.25 port 49242 May 25 03:27:44 oleg425-client sshd[23625]: pam_unix(sshd:session): session closed for user root May 25 03:27:45 oleg425-client systemd-logind[1020]: Session 106 logged out. Waiting for processes to exit. May 25 03:27:45 oleg425-client systemd[1]: session-106.scope: Succeeded. May 25 03:27:45 oleg425-client systemd-logind[1020]: Removed session 106. May 25 03:27:45 oleg425-client systemd-udevd[23693]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:27:45 oleg425-client kernel: Lustre: Mounted lustre-client May 25 03:27:45 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 03:28:02 oleg425-client kernel: Lustre: 2372:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694066/real 1779694066] req@ffffa09b061b0a80 x1866143414523136/t0(0) o103->lustre-MDT0000-mdc-ffffa09b0ab14000@192.168.204.125@tcp:17/18 lens 328/224 e 0 to 1 dl 1779694082 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 May 25 03:28:02 oleg425-client kernel: Lustre: 2372:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 03:29:31 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -107 May 25 03:29:31 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:29:31 oleg425-client kernel: LustreError: 23865:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffffa09b0ab14000: inode [0x200000403:0x1:0x0] mdc close failed: rc = -108 May 25 03:29:31 oleg425-client kernel: LustreError: 23864:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 May 25 03:29:33 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:29:33 oleg425-client kernel: LustreError: 23874:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b0722e800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:29:33 oleg425-client kernel: LustreError: 23874:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:29:33 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 03:29:35 oleg425-client sshd[23979]: Accepted publickey for root from 192.168.204.25 port 46596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:35 oleg425-client systemd-logind[1020]: New session 107 of user root. May 25 03:29:35 oleg425-client systemd[1]: Started Session 107 of user root. May 25 03:29:35 oleg425-client sshd[23979]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:36 oleg425-client sshd[23992]: Received disconnect from 192.168.204.25 port 46596:11: disconnected by user May 25 03:29:36 oleg425-client sshd[23992]: Disconnected from user root 192.168.204.25 port 46596 May 25 03:29:36 oleg425-client sshd[23979]: pam_unix(sshd:session): session closed for user root May 25 03:29:36 oleg425-client systemd-logind[1020]: Session 107 logged out. Waiting for processes to exit. May 25 03:29:36 oleg425-client systemd[1]: session-107.scope: Succeeded. May 25 03:29:36 oleg425-client systemd-logind[1020]: Removed session 107. May 25 03:29:37 oleg425-client sshd[24116]: Accepted publickey for root from 192.168.204.25 port 46602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:37 oleg425-client systemd-logind[1020]: New session 108 of user root. May 25 03:29:37 oleg425-client systemd[1]: Started Session 108 of user root. May 25 03:29:37 oleg425-client sshd[24116]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:37 oleg425-client sshd[24130]: Received disconnect from 192.168.204.25 port 46602:11: disconnected by user May 25 03:29:37 oleg425-client sshd[24130]: Disconnected from user root 192.168.204.25 port 46602 May 25 03:29:37 oleg425-client sshd[24116]: pam_unix(sshd:session): session closed for user root May 25 03:29:38 oleg425-client systemd[1]: session-108.scope: Succeeded. May 25 03:29:38 oleg425-client systemd-logind[1020]: Session 108 logged out. Waiting for processes to exit. May 25 03:29:38 oleg425-client systemd-logind[1020]: Removed session 108. May 25 03:29:39 oleg425-client sshd[24262]: Accepted publickey for root from 192.168.204.25 port 46612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:39 oleg425-client systemd-logind[1020]: New session 109 of user root. May 25 03:29:39 oleg425-client systemd[1]: Started Session 109 of user root. May 25 03:29:39 oleg425-client sshd[24262]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:39 oleg425-client sshd[24275]: Received disconnect from 192.168.204.25 port 46612:11: disconnected by user May 25 03:29:39 oleg425-client sshd[24275]: Disconnected from user root 192.168.204.25 port 46612 May 25 03:29:39 oleg425-client sshd[24262]: pam_unix(sshd:session): session closed for user root May 25 03:29:39 oleg425-client systemd[1]: session-109.scope: Succeeded. May 25 03:29:39 oleg425-client systemd-logind[1020]: Session 109 logged out. Waiting for processes to exit. May 25 03:29:39 oleg425-client systemd-logind[1020]: Removed session 109. May 25 03:29:41 oleg425-client sshd[24415]: Accepted publickey for root from 192.168.204.25 port 46626 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:41 oleg425-client systemd-logind[1020]: New session 110 of user root. May 25 03:29:41 oleg425-client systemd[1]: Started Session 110 of user root. May 25 03:29:41 oleg425-client sshd[24415]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:41 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19b: test expired_lock_main on ost (2867) ========================================================== 03:29:39 (1779694179) May 25 03:29:41 oleg425-client sshd[24428]: Received disconnect from 192.168.204.25 port 46626:11: disconnected by user May 25 03:29:41 oleg425-client sshd[24428]: Disconnected from user root 192.168.204.25 port 46626 May 25 03:29:41 oleg425-client sshd[24415]: pam_unix(sshd:session): session closed for user root May 25 03:29:41 oleg425-client systemd-logind[1020]: Session 110 logged out. Waiting for processes to exit. May 25 03:29:41 oleg425-client systemd[1]: session-110.scope: Succeeded. May 25 03:29:41 oleg425-client systemd-logind[1020]: Removed session 110. May 25 03:29:42 oleg425-client systemd-udevd[24480]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:29:42 oleg425-client kernel: Lustre: Mounted lustre-client May 25 03:31:27 oleg425-client kernel: LustreError: lustre-OST0001-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. May 25 03:31:28 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:31:28 oleg425-client kernel: LustreError: 24652:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b072df800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:31:28 oleg425-client kernel: LustreError: 24652:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:31:28 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 03:31:30 oleg425-client sshd[24763]: Accepted publickey for root from 192.168.204.25 port 33352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:30 oleg425-client systemd[1]: Started Session 111 of user root. May 25 03:31:30 oleg425-client systemd-logind[1020]: New session 111 of user root. May 25 03:31:30 oleg425-client sshd[24763]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:30 oleg425-client sshd[24776]: Received disconnect from 192.168.204.25 port 33352:11: disconnected by user May 25 03:31:30 oleg425-client sshd[24776]: Disconnected from user root 192.168.204.25 port 33352 May 25 03:31:30 oleg425-client sshd[24763]: pam_unix(sshd:session): session closed for user root May 25 03:31:31 oleg425-client systemd-logind[1020]: Session 111 logged out. Waiting for processes to exit. May 25 03:31:31 oleg425-client systemd[1]: session-111.scope: Succeeded. May 25 03:31:31 oleg425-client systemd-logind[1020]: Removed session 111. May 25 03:31:32 oleg425-client sshd[24902]: Accepted publickey for root from 192.168.204.25 port 33366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:32 oleg425-client systemd[1]: Started Session 112 of user root. May 25 03:31:32 oleg425-client systemd-logind[1020]: New session 112 of user root. May 25 03:31:32 oleg425-client sshd[24902]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:32 oleg425-client sshd[24915]: Received disconnect from 192.168.204.25 port 33366:11: disconnected by user May 25 03:31:32 oleg425-client sshd[24915]: Disconnected from user root 192.168.204.25 port 33366 May 25 03:31:32 oleg425-client sshd[24902]: pam_unix(sshd:session): session closed for user root May 25 03:31:32 oleg425-client systemd-logind[1020]: Session 112 logged out. Waiting for processes to exit. May 25 03:31:32 oleg425-client systemd[1]: session-112.scope: Succeeded. May 25 03:31:32 oleg425-client systemd-logind[1020]: Removed session 112. May 25 03:31:33 oleg425-client sshd[25046]: Accepted publickey for root from 192.168.204.25 port 33368 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:33 oleg425-client systemd-logind[1020]: New session 113 of user root. May 25 03:31:33 oleg425-client systemd[1]: Started Session 113 of user root. May 25 03:31:33 oleg425-client sshd[25046]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:34 oleg425-client sshd[25060]: Received disconnect from 192.168.204.25 port 33368:11: disconnected by user May 25 03:31:34 oleg425-client sshd[25060]: Disconnected from user root 192.168.204.25 port 33368 May 25 03:31:34 oleg425-client sshd[25046]: pam_unix(sshd:session): session closed for user root May 25 03:31:34 oleg425-client systemd[1]: session-113.scope: Succeeded. May 25 03:31:34 oleg425-client systemd-logind[1020]: Session 113 logged out. Waiting for processes to exit. May 25 03:31:34 oleg425-client systemd-logind[1020]: Removed session 113. May 25 03:31:35 oleg425-client sshd[25200]: Accepted publickey for root from 192.168.204.25 port 35698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:36 oleg425-client systemd-logind[1020]: New session 114 of user root. May 25 03:31:36 oleg425-client systemd[1]: Started Session 114 of user root. May 25 03:31:36 oleg425-client sshd[25200]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:36 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19c: check reconnect and lock resend do not trigger expired_lock_main ========================================================== 03:31:34 (1779694294) May 25 03:31:36 oleg425-client sshd[25213]: Received disconnect from 192.168.204.25 port 35698:11: disconnected by user May 25 03:31:36 oleg425-client sshd[25213]: Disconnected from user root 192.168.204.25 port 35698 May 25 03:31:36 oleg425-client sshd[25200]: pam_unix(sshd:session): session closed for user root May 25 03:31:36 oleg425-client systemd-logind[1020]: Session 114 logged out. Waiting for processes to exit. May 25 03:31:36 oleg425-client systemd[1]: session-114.scope: Succeeded. May 25 03:31:36 oleg425-client systemd-logind[1020]: Removed session 114. May 25 03:31:37 oleg425-client systemd-udevd[25267]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:31:37 oleg425-client kernel: Lustre: Mounted lustre-client May 25 03:31:42 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:31:43 oleg425-client kernel: LustreError: 25315:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b072d8000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:31:43 oleg425-client kernel: LustreError: 25315:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:31:43 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 03:31:49 oleg425-client sshd[25412]: Accepted publickey for root from 192.168.204.25 port 52652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:49 oleg425-client systemd[1]: Started Session 115 of user root. May 25 03:31:49 oleg425-client systemd-logind[1020]: New session 115 of user root. May 25 03:31:49 oleg425-client sshd[25412]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:49 oleg425-client sshd[25425]: Received disconnect from 192.168.204.25 port 52652:11: disconnected by user May 25 03:31:49 oleg425-client sshd[25425]: Disconnected from user root 192.168.204.25 port 52652 May 25 03:31:49 oleg425-client sshd[25412]: pam_unix(sshd:session): session closed for user root May 25 03:31:49 oleg425-client systemd[1]: session-115.scope: Succeeded. May 25 03:31:49 oleg425-client systemd-logind[1020]: Session 115 logged out. Waiting for processes to exit. May 25 03:31:49 oleg425-client systemd-logind[1020]: Removed session 115. May 25 03:31:51 oleg425-client sshd[25550]: Accepted publickey for root from 192.168.204.25 port 52654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:51 oleg425-client systemd-logind[1020]: New session 116 of user root. May 25 03:31:51 oleg425-client systemd[1]: Started Session 116 of user root. May 25 03:31:51 oleg425-client sshd[25550]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:51 oleg425-client sshd[25563]: Received disconnect from 192.168.204.25 port 52654:11: disconnected by user May 25 03:31:51 oleg425-client sshd[25563]: Disconnected from user root 192.168.204.25 port 52654 May 25 03:31:51 oleg425-client sshd[25550]: pam_unix(sshd:session): session closed for user root May 25 03:31:51 oleg425-client systemd[1]: session-116.scope: Succeeded. May 25 03:31:51 oleg425-client systemd-logind[1020]: Session 116 logged out. Waiting for processes to exit. May 25 03:31:51 oleg425-client systemd-logind[1020]: Removed session 116. May 25 03:31:52 oleg425-client sshd[25695]: Accepted publickey for root from 192.168.204.25 port 52656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:52 oleg425-client systemd[1]: Started Session 117 of user root. May 25 03:31:52 oleg425-client systemd-logind[1020]: New session 117 of user root. May 25 03:31:52 oleg425-client sshd[25695]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:53 oleg425-client sshd[25708]: Received disconnect from 192.168.204.25 port 52656:11: disconnected by user May 25 03:31:53 oleg425-client sshd[25708]: Disconnected from user root 192.168.204.25 port 52656 May 25 03:31:53 oleg425-client sshd[25695]: pam_unix(sshd:session): session closed for user root May 25 03:31:53 oleg425-client systemd[1]: session-117.scope: Succeeded. May 25 03:31:53 oleg425-client systemd-logind[1020]: Session 117 logged out. Waiting for processes to exit. May 25 03:31:53 oleg425-client systemd-logind[1020]: Removed session 117. May 25 03:31:54 oleg425-client sshd[25848]: Accepted publickey for root from 192.168.204.25 port 44212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:54 oleg425-client systemd[1]: Started Session 118 of user root. May 25 03:31:55 oleg425-client systemd-logind[1020]: New session 118 of user root. May 25 03:31:55 oleg425-client sshd[25848]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:55 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20a: ldlm_handle_enqueue error (should return error) ========================================================== 03:31:53 (1779694313) May 25 03:31:55 oleg425-client sshd[25861]: Received disconnect from 192.168.204.25 port 44212:11: disconnected by user May 25 03:31:55 oleg425-client sshd[25861]: Disconnected from user root 192.168.204.25 port 44212 May 25 03:31:55 oleg425-client sshd[25848]: pam_unix(sshd:session): session closed for user root May 25 03:31:55 oleg425-client systemd[1]: session-118.scope: Succeeded. May 25 03:31:55 oleg425-client systemd-logind[1020]: Session 118 logged out. Waiting for processes to exit. May 25 03:31:55 oleg425-client systemd-logind[1020]: Removed session 118. May 25 03:31:57 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -12 May 25 03:31:58 oleg425-client sshd[26030]: Accepted publickey for root from 192.168.204.25 port 44226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:58 oleg425-client systemd-logind[1020]: New session 119 of user root. May 25 03:31:58 oleg425-client systemd[1]: Started Session 119 of user root. May 25 03:31:58 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:31:58 oleg425-client sshd[26030]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:59 oleg425-client sshd[26044]: Received disconnect from 192.168.204.25 port 44226:11: disconnected by user May 25 03:31:59 oleg425-client sshd[26044]: Disconnected from user root 192.168.204.25 port 44226 May 25 03:31:59 oleg425-client sshd[26030]: pam_unix(sshd:session): session closed for user root May 25 03:31:59 oleg425-client systemd[1]: session-119.scope: Succeeded. May 25 03:31:59 oleg425-client systemd-logind[1020]: Session 119 logged out. Waiting for processes to exit. May 25 03:31:59 oleg425-client systemd-logind[1020]: Removed session 119. May 25 03:32:00 oleg425-client sshd[26168]: Accepted publickey for root from 192.168.204.25 port 44238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:00 oleg425-client systemd-logind[1020]: New session 120 of user root. May 25 03:32:00 oleg425-client systemd[1]: Started Session 120 of user root. May 25 03:32:00 oleg425-client sshd[26168]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:01 oleg425-client sshd[26181]: Received disconnect from 192.168.204.25 port 44238:11: disconnected by user May 25 03:32:01 oleg425-client sshd[26181]: Disconnected from user root 192.168.204.25 port 44238 May 25 03:32:01 oleg425-client sshd[26168]: pam_unix(sshd:session): session closed for user root May 25 03:32:01 oleg425-client systemd[1]: session-120.scope: Succeeded. May 25 03:32:01 oleg425-client systemd-logind[1020]: Session 120 logged out. Waiting for processes to exit. May 25 03:32:01 oleg425-client systemd-logind[1020]: Removed session 120. May 25 03:32:02 oleg425-client sshd[26313]: Accepted publickey for root from 192.168.204.25 port 44250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:02 oleg425-client systemd-logind[1020]: New session 121 of user root. May 25 03:32:02 oleg425-client systemd[1]: Started Session 121 of user root. May 25 03:32:02 oleg425-client sshd[26313]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:03 oleg425-client sshd[26326]: Received disconnect from 192.168.204.25 port 44250:11: disconnected by user May 25 03:32:03 oleg425-client sshd[26326]: Disconnected from user root 192.168.204.25 port 44250 May 25 03:32:03 oleg425-client sshd[26313]: pam_unix(sshd:session): session closed for user root May 25 03:32:03 oleg425-client systemd[1]: session-121.scope: Succeeded. May 25 03:32:03 oleg425-client systemd-logind[1020]: Session 121 logged out. Waiting for processes to exit. May 25 03:32:03 oleg425-client systemd-logind[1020]: Removed session 121. May 25 03:32:04 oleg425-client sshd[26466]: Accepted publickey for root from 192.168.204.25 port 45828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:04 oleg425-client systemd-logind[1020]: New session 122 of user root. May 25 03:32:04 oleg425-client systemd[1]: Started Session 122 of user root. May 25 03:32:04 oleg425-client sshd[26466]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:05 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20b: ldlm_handle_enqueue error (should return error) ========================================================== 03:32:03 (1779694323) May 25 03:32:05 oleg425-client sshd[26479]: Received disconnect from 192.168.204.25 port 45828:11: disconnected by user May 25 03:32:05 oleg425-client sshd[26479]: Disconnected from user root 192.168.204.25 port 45828 May 25 03:32:05 oleg425-client sshd[26466]: pam_unix(sshd:session): session closed for user root May 25 03:32:05 oleg425-client systemd-logind[1020]: Session 122 logged out. Waiting for processes to exit. May 25 03:32:05 oleg425-client systemd[1]: session-122.scope: Succeeded. May 25 03:32:05 oleg425-client systemd-logind[1020]: Removed session 122. May 25 03:32:07 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -12 May 25 03:32:08 oleg425-client sshd[26645]: Accepted publickey for root from 192.168.204.25 port 45840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:08 oleg425-client systemd[1]: Started Session 123 of user root. May 25 03:32:08 oleg425-client systemd-logind[1020]: New session 123 of user root. May 25 03:32:08 oleg425-client sshd[26645]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:09 oleg425-client sshd[26658]: Received disconnect from 192.168.204.25 port 45840:11: disconnected by user May 25 03:32:09 oleg425-client sshd[26658]: Disconnected from user root 192.168.204.25 port 45840 May 25 03:32:09 oleg425-client sshd[26645]: pam_unix(sshd:session): session closed for user root May 25 03:32:09 oleg425-client systemd[1]: session-123.scope: Succeeded. May 25 03:32:09 oleg425-client systemd-logind[1020]: Session 123 logged out. Waiting for processes to exit. May 25 03:32:09 oleg425-client systemd-logind[1020]: Removed session 123. May 25 03:32:10 oleg425-client sshd[26783]: Accepted publickey for root from 192.168.204.25 port 45856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:10 oleg425-client systemd-logind[1020]: New session 124 of user root. May 25 03:32:10 oleg425-client systemd[1]: Started Session 124 of user root. May 25 03:32:10 oleg425-client sshd[26783]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:11 oleg425-client sshd[26796]: Received disconnect from 192.168.204.25 port 45856:11: disconnected by user May 25 03:32:11 oleg425-client sshd[26796]: Disconnected from user root 192.168.204.25 port 45856 May 25 03:32:11 oleg425-client sshd[26783]: pam_unix(sshd:session): session closed for user root May 25 03:32:11 oleg425-client systemd[1]: session-124.scope: Succeeded. May 25 03:32:11 oleg425-client systemd-logind[1020]: Session 124 logged out. Waiting for processes to exit. May 25 03:32:11 oleg425-client systemd-logind[1020]: Removed session 124. May 25 03:32:12 oleg425-client sshd[26927]: Accepted publickey for root from 192.168.204.25 port 45870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:12 oleg425-client systemd-logind[1020]: New session 125 of user root. May 25 03:32:12 oleg425-client systemd[1]: Started Session 125 of user root. May 25 03:32:12 oleg425-client sshd[26927]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:13 oleg425-client sshd[26940]: Received disconnect from 192.168.204.25 port 45870:11: disconnected by user May 25 03:32:13 oleg425-client sshd[26940]: Disconnected from user root 192.168.204.25 port 45870 May 25 03:32:13 oleg425-client sshd[26927]: pam_unix(sshd:session): session closed for user root May 25 03:32:13 oleg425-client systemd[1]: session-125.scope: Succeeded. May 25 03:32:13 oleg425-client systemd-logind[1020]: Session 125 logged out. Waiting for processes to exit. May 25 03:32:13 oleg425-client systemd-logind[1020]: Removed session 125. May 25 03:32:14 oleg425-client sshd[27080]: Accepted publickey for root from 192.168.204.25 port 48528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:15 oleg425-client systemd-logind[1020]: New session 126 of user root. May 25 03:32:15 oleg425-client systemd[1]: Started Session 126 of user root. May 25 03:32:15 oleg425-client sshd[27080]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:15 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21a: drop close request while close and open are both in flight ========================================================== 03:32:13 (1779694333) May 25 03:32:15 oleg425-client sshd[27094]: Received disconnect from 192.168.204.25 port 48528:11: disconnected by user May 25 03:32:15 oleg425-client sshd[27094]: Disconnected from user root 192.168.204.25 port 48528 May 25 03:32:15 oleg425-client sshd[27080]: pam_unix(sshd:session): session closed for user root May 25 03:32:15 oleg425-client systemd-logind[1020]: Session 126 logged out. Waiting for processes to exit. May 25 03:32:15 oleg425-client systemd[1]: session-126.scope: Succeeded. May 25 03:32:15 oleg425-client systemd-logind[1020]: Removed session 126. May 25 03:32:38 oleg425-client sshd[27265]: Accepted publickey for root from 192.168.204.25 port 44384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:38 oleg425-client systemd-logind[1020]: New session 127 of user root. May 25 03:32:38 oleg425-client systemd[1]: Started Session 127 of user root. May 25 03:32:38 oleg425-client sshd[27265]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:38 oleg425-client sshd[27278]: Received disconnect from 192.168.204.25 port 44384:11: disconnected by user May 25 03:32:38 oleg425-client sshd[27278]: Disconnected from user root 192.168.204.25 port 44384 May 25 03:32:38 oleg425-client sshd[27265]: pam_unix(sshd:session): session closed for user root May 25 03:32:39 oleg425-client systemd[1]: session-127.scope: Succeeded. May 25 03:32:39 oleg425-client systemd-logind[1020]: Session 127 logged out. Waiting for processes to exit. May 25 03:32:39 oleg425-client systemd-logind[1020]: Removed session 127. May 25 03:32:39 oleg425-client sshd[27402]: Accepted publickey for root from 192.168.204.25 port 44394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:39 oleg425-client systemd-logind[1020]: New session 128 of user root. May 25 03:32:39 oleg425-client systemd[1]: Started Session 128 of user root. May 25 03:32:39 oleg425-client sshd[27402]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:40 oleg425-client sshd[27415]: Received disconnect from 192.168.204.25 port 44394:11: disconnected by user May 25 03:32:40 oleg425-client sshd[27415]: Disconnected from user root 192.168.204.25 port 44394 May 25 03:32:40 oleg425-client sshd[27402]: pam_unix(sshd:session): session closed for user root May 25 03:32:40 oleg425-client systemd-logind[1020]: Session 128 logged out. Waiting for processes to exit. May 25 03:32:40 oleg425-client systemd[1]: session-128.scope: Succeeded. May 25 03:32:40 oleg425-client systemd-logind[1020]: Removed session 128. May 25 03:32:41 oleg425-client sshd[27546]: Accepted publickey for root from 192.168.204.25 port 44410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:41 oleg425-client systemd[1]: Started Session 129 of user root. May 25 03:32:41 oleg425-client systemd-logind[1020]: New session 129 of user root. May 25 03:32:41 oleg425-client sshd[27546]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:41 oleg425-client sshd[27559]: Received disconnect from 192.168.204.25 port 44410:11: disconnected by user May 25 03:32:41 oleg425-client sshd[27559]: Disconnected from user root 192.168.204.25 port 44410 May 25 03:32:41 oleg425-client sshd[27546]: pam_unix(sshd:session): session closed for user root May 25 03:32:42 oleg425-client systemd[1]: session-129.scope: Succeeded. May 25 03:32:42 oleg425-client systemd-logind[1020]: Session 129 logged out. Waiting for processes to exit. May 25 03:32:42 oleg425-client systemd-logind[1020]: Removed session 129. May 25 03:32:43 oleg425-client sshd[27699]: Accepted publickey for root from 192.168.204.25 port 44412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:43 oleg425-client systemd-logind[1020]: New session 130 of user root. May 25 03:32:43 oleg425-client systemd[1]: Started Session 130 of user root. May 25 03:32:43 oleg425-client sshd[27699]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:43 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21b: drop open request while close and open are both in flight ========================================================== 03:32:42 (1779694362) May 25 03:32:43 oleg425-client sshd[27712]: Received disconnect from 192.168.204.25 port 44412:11: disconnected by user May 25 03:32:43 oleg425-client sshd[27712]: Disconnected from user root 192.168.204.25 port 44412 May 25 03:32:43 oleg425-client sshd[27699]: pam_unix(sshd:session): session closed for user root May 25 03:32:43 oleg425-client systemd[1]: session-130.scope: Succeeded. May 25 03:32:43 oleg425-client systemd-logind[1020]: Session 130 logged out. Waiting for processes to exit. May 25 03:32:43 oleg425-client systemd-logind[1020]: Removed session 130. May 25 03:35:04 oleg425-client sshd[27882]: Accepted publickey for root from 192.168.204.25 port 48324 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:04 oleg425-client systemd[1]: Started Session 131 of user root. May 25 03:35:04 oleg425-client systemd-logind[1020]: New session 131 of user root. May 25 03:35:04 oleg425-client sshd[27882]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:05 oleg425-client sshd[27895]: Received disconnect from 192.168.204.25 port 48324:11: disconnected by user May 25 03:35:05 oleg425-client sshd[27895]: Disconnected from user root 192.168.204.25 port 48324 May 25 03:35:05 oleg425-client sshd[27882]: pam_unix(sshd:session): session closed for user root May 25 03:35:05 oleg425-client systemd-logind[1020]: Session 131 logged out. Waiting for processes to exit. May 25 03:35:05 oleg425-client systemd[1]: session-131.scope: Succeeded. May 25 03:35:05 oleg425-client systemd-logind[1020]: Removed session 131. May 25 03:35:07 oleg425-client sshd[28020]: Accepted publickey for root from 192.168.204.25 port 48328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:07 oleg425-client systemd-logind[1020]: New session 132 of user root. May 25 03:35:07 oleg425-client systemd[1]: Started Session 132 of user root. May 25 03:35:07 oleg425-client sshd[28020]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:07 oleg425-client sshd[28033]: Received disconnect from 192.168.204.25 port 48328:11: disconnected by user May 25 03:35:07 oleg425-client sshd[28033]: Disconnected from user root 192.168.204.25 port 48328 May 25 03:35:07 oleg425-client sshd[28020]: pam_unix(sshd:session): session closed for user root May 25 03:35:07 oleg425-client systemd[1]: session-132.scope: Succeeded. May 25 03:35:07 oleg425-client systemd-logind[1020]: Session 132 logged out. Waiting for processes to exit. May 25 03:35:07 oleg425-client systemd-logind[1020]: Removed session 132. May 25 03:35:08 oleg425-client sshd[28164]: Accepted publickey for root from 192.168.204.25 port 48334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:08 oleg425-client systemd[1]: Started Session 133 of user root. May 25 03:35:08 oleg425-client systemd-logind[1020]: New session 133 of user root. May 25 03:35:08 oleg425-client sshd[28164]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:09 oleg425-client sshd[28177]: Received disconnect from 192.168.204.25 port 48334:11: disconnected by user May 25 03:35:09 oleg425-client sshd[28177]: Disconnected from user root 192.168.204.25 port 48334 May 25 03:35:09 oleg425-client sshd[28164]: pam_unix(sshd:session): session closed for user root May 25 03:35:09 oleg425-client systemd[1]: session-133.scope: Succeeded. May 25 03:35:09 oleg425-client systemd-logind[1020]: Session 133 logged out. Waiting for processes to exit. May 25 03:35:09 oleg425-client systemd-logind[1020]: Removed session 133. May 25 03:35:10 oleg425-client sshd[28317]: Accepted publickey for root from 192.168.204.25 port 48342 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:10 oleg425-client systemd-logind[1020]: New session 134 of user root. May 25 03:35:10 oleg425-client systemd[1]: Started Session 134 of user root. May 25 03:35:10 oleg425-client sshd[28317]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21c: drop both request while close and open are both in flight ========================================================== 03:35:09 (1779694509) May 25 03:35:11 oleg425-client sshd[28330]: Received disconnect from 192.168.204.25 port 48342:11: disconnected by user May 25 03:35:11 oleg425-client sshd[28330]: Disconnected from user root 192.168.204.25 port 48342 May 25 03:35:11 oleg425-client sshd[28317]: pam_unix(sshd:session): session closed for user root May 25 03:35:11 oleg425-client systemd[1]: session-134.scope: Succeeded. May 25 03:35:11 oleg425-client systemd-logind[1020]: Session 134 logged out. Waiting for processes to exit. May 25 03:35:11 oleg425-client systemd-logind[1020]: Removed session 134. May 25 03:35:33 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab14000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:35:33 oleg425-client kernel: Lustre: Skipped 18 previous similar messages May 25 03:35:33 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab14000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:35:33 oleg425-client kernel: Lustre: Skipped 16 previous similar messages May 25 03:35:36 oleg425-client sshd[28500]: Accepted publickey for root from 192.168.204.25 port 58992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:37 oleg425-client systemd-logind[1020]: New session 135 of user root. May 25 03:35:37 oleg425-client systemd[1]: Started Session 135 of user root. May 25 03:35:37 oleg425-client sshd[28500]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:37 oleg425-client sshd[28513]: Received disconnect from 192.168.204.25 port 58992:11: disconnected by user May 25 03:35:37 oleg425-client sshd[28513]: Disconnected from user root 192.168.204.25 port 58992 May 25 03:35:37 oleg425-client sshd[28500]: pam_unix(sshd:session): session closed for user root May 25 03:35:37 oleg425-client systemd[1]: session-135.scope: Succeeded. May 25 03:35:37 oleg425-client systemd-logind[1020]: Session 135 logged out. Waiting for processes to exit. May 25 03:35:37 oleg425-client systemd-logind[1020]: Removed session 135. May 25 03:35:38 oleg425-client sshd[28638]: Accepted publickey for root from 192.168.204.25 port 59000 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:38 oleg425-client systemd-logind[1020]: New session 136 of user root. May 25 03:35:38 oleg425-client systemd[1]: Started Session 136 of user root. May 25 03:35:38 oleg425-client sshd[28638]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:39 oleg425-client sshd[28651]: Received disconnect from 192.168.204.25 port 59000:11: disconnected by user May 25 03:35:39 oleg425-client sshd[28651]: Disconnected from user root 192.168.204.25 port 59000 May 25 03:35:39 oleg425-client sshd[28638]: pam_unix(sshd:session): session closed for user root May 25 03:35:39 oleg425-client systemd-logind[1020]: Session 136 logged out. Waiting for processes to exit. May 25 03:35:39 oleg425-client systemd[1]: session-136.scope: Succeeded. May 25 03:35:39 oleg425-client systemd-logind[1020]: Removed session 136. May 25 03:35:40 oleg425-client sshd[28782]: Accepted publickey for root from 192.168.204.25 port 59008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:40 oleg425-client systemd-logind[1020]: New session 137 of user root. May 25 03:35:40 oleg425-client systemd[1]: Started Session 137 of user root. May 25 03:35:40 oleg425-client sshd[28782]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:40 oleg425-client sshd[28795]: Received disconnect from 192.168.204.25 port 59008:11: disconnected by user May 25 03:35:40 oleg425-client sshd[28795]: Disconnected from user root 192.168.204.25 port 59008 May 25 03:35:40 oleg425-client sshd[28782]: pam_unix(sshd:session): session closed for user root May 25 03:35:41 oleg425-client systemd[1]: session-137.scope: Succeeded. May 25 03:35:41 oleg425-client systemd-logind[1020]: Session 137 logged out. Waiting for processes to exit. May 25 03:35:41 oleg425-client systemd-logind[1020]: Removed session 137. May 25 03:35:42 oleg425-client sshd[28935]: Accepted publickey for root from 192.168.204.25 port 59024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:42 oleg425-client systemd-logind[1020]: New session 138 of user root. May 25 03:35:42 oleg425-client systemd[1]: Started Session 138 of user root. May 25 03:35:42 oleg425-client sshd[28935]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:42 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21d: drop close reply while close and open are both in flight ========================================================== 03:35:41 (1779694541) May 25 03:35:42 oleg425-client sshd[28948]: Received disconnect from 192.168.204.25 port 59024:11: disconnected by user May 25 03:35:42 oleg425-client sshd[28948]: Disconnected from user root 192.168.204.25 port 59024 May 25 03:35:42 oleg425-client sshd[28935]: pam_unix(sshd:session): session closed for user root May 25 03:35:42 oleg425-client systemd[1]: session-138.scope: Succeeded. May 25 03:35:42 oleg425-client systemd-logind[1020]: Session 138 logged out. Waiting for processes to exit. May 25 03:35:42 oleg425-client systemd-logind[1020]: Removed session 138. May 25 03:36:05 oleg425-client sshd[29118]: Accepted publickey for root from 192.168.204.25 port 60218 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:05 oleg425-client systemd-logind[1020]: New session 139 of user root. May 25 03:36:05 oleg425-client systemd[1]: Started Session 139 of user root. May 25 03:36:05 oleg425-client sshd[29118]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:06 oleg425-client sshd[29131]: Received disconnect from 192.168.204.25 port 60218:11: disconnected by user May 25 03:36:06 oleg425-client sshd[29131]: Disconnected from user root 192.168.204.25 port 60218 May 25 03:36:06 oleg425-client sshd[29118]: pam_unix(sshd:session): session closed for user root May 25 03:36:06 oleg425-client systemd-logind[1020]: Session 139 logged out. Waiting for processes to exit. May 25 03:36:06 oleg425-client systemd[1]: session-139.scope: Succeeded. May 25 03:36:06 oleg425-client systemd-logind[1020]: Removed session 139. May 25 03:36:07 oleg425-client sshd[29255]: Accepted publickey for root from 192.168.204.25 port 60226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:07 oleg425-client systemd[1]: Started Session 140 of user root. May 25 03:36:07 oleg425-client systemd-logind[1020]: New session 140 of user root. May 25 03:36:07 oleg425-client sshd[29255]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:07 oleg425-client sshd[29268]: Received disconnect from 192.168.204.25 port 60226:11: disconnected by user May 25 03:36:07 oleg425-client sshd[29268]: Disconnected from user root 192.168.204.25 port 60226 May 25 03:36:07 oleg425-client sshd[29255]: pam_unix(sshd:session): session closed for user root May 25 03:36:07 oleg425-client systemd[1]: session-140.scope: Succeeded. May 25 03:36:07 oleg425-client systemd-logind[1020]: Session 140 logged out. Waiting for processes to exit. May 25 03:36:07 oleg425-client systemd-logind[1020]: Removed session 140. May 25 03:36:09 oleg425-client sshd[29399]: Accepted publickey for root from 192.168.204.25 port 60228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:09 oleg425-client systemd-logind[1020]: New session 141 of user root. May 25 03:36:09 oleg425-client systemd[1]: Started Session 141 of user root. May 25 03:36:09 oleg425-client sshd[29399]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:09 oleg425-client sshd[29412]: Received disconnect from 192.168.204.25 port 60228:11: disconnected by user May 25 03:36:09 oleg425-client sshd[29412]: Disconnected from user root 192.168.204.25 port 60228 May 25 03:36:09 oleg425-client sshd[29399]: pam_unix(sshd:session): session closed for user root May 25 03:36:09 oleg425-client systemd-logind[1020]: Session 141 logged out. Waiting for processes to exit. May 25 03:36:09 oleg425-client systemd[1]: session-141.scope: Succeeded. May 25 03:36:09 oleg425-client systemd-logind[1020]: Removed session 141. May 25 03:36:11 oleg425-client sshd[29553]: Accepted publickey for root from 192.168.204.25 port 60240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:11 oleg425-client systemd[1]: Started Session 142 of user root. May 25 03:36:11 oleg425-client systemd-logind[1020]: New session 142 of user root. May 25 03:36:11 oleg425-client sshd[29553]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:12 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21e: drop open reply while close and open are both in flight ========================================================== 03:36:10 (1779694570) May 25 03:36:12 oleg425-client sshd[29566]: Received disconnect from 192.168.204.25 port 60240:11: disconnected by user May 25 03:36:12 oleg425-client sshd[29566]: Disconnected from user root 192.168.204.25 port 60240 May 25 03:36:12 oleg425-client sshd[29553]: pam_unix(sshd:session): session closed for user root May 25 03:36:12 oleg425-client systemd[1]: session-142.scope: Succeeded. May 25 03:36:12 oleg425-client systemd-logind[1020]: Session 142 logged out. Waiting for processes to exit. May 25 03:36:12 oleg425-client systemd-logind[1020]: Removed session 142. May 25 03:36:37 oleg425-client sshd[29721]: Accepted publickey for root from 192.168.204.25 port 39264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:37 oleg425-client systemd[1]: Started Session 143 of user root. May 25 03:36:37 oleg425-client systemd-logind[1020]: New session 143 of user root. May 25 03:36:37 oleg425-client sshd[29721]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:38 oleg425-client sshd[29734]: Received disconnect from 192.168.204.25 port 39264:11: disconnected by user May 25 03:36:38 oleg425-client sshd[29734]: Disconnected from user root 192.168.204.25 port 39264 May 25 03:36:38 oleg425-client sshd[29721]: pam_unix(sshd:session): session closed for user root May 25 03:36:38 oleg425-client systemd[1]: session-143.scope: Succeeded. May 25 03:36:38 oleg425-client systemd-logind[1020]: Session 143 logged out. Waiting for processes to exit. May 25 03:36:38 oleg425-client systemd-logind[1020]: Removed session 143. May 25 03:36:40 oleg425-client sshd[29858]: Accepted publickey for root from 192.168.204.25 port 39278 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:40 oleg425-client systemd-logind[1020]: New session 144 of user root. May 25 03:36:40 oleg425-client systemd[1]: Started Session 144 of user root. May 25 03:36:40 oleg425-client sshd[29858]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:40 oleg425-client sshd[29871]: Received disconnect from 192.168.204.25 port 39278:11: disconnected by user May 25 03:36:40 oleg425-client sshd[29871]: Disconnected from user root 192.168.204.25 port 39278 May 25 03:36:40 oleg425-client sshd[29858]: pam_unix(sshd:session): session closed for user root May 25 03:36:41 oleg425-client systemd[1]: session-144.scope: Succeeded. May 25 03:36:41 oleg425-client systemd-logind[1020]: Session 144 logged out. Waiting for processes to exit. May 25 03:36:41 oleg425-client systemd-logind[1020]: Removed session 144. May 25 03:36:42 oleg425-client sshd[30003]: Accepted publickey for root from 192.168.204.25 port 39284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:36:42 oleg425-client systemd-logind[1020]: New session 145 of user root. May 25 03:36:42 oleg425-client systemd[1]: Started Session 145 of user root. May 25 03:36:42 oleg425-client sshd[30003]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:36:42 oleg425-client sshd[30016]: Received disconnect from 192.168.204.25 port 39284:11: disconnected by user May 25 03:36:42 oleg425-client sshd[30016]: Disconnected from user root 192.168.204.25 port 39284 May 25 03:36:42 oleg425-client sshd[30003]: pam_unix(sshd:session): session closed for user root May 25 03:36:42 oleg425-client systemd[1]: session-145.scope: Succeeded. May 25 03:36:42 oleg425-client systemd-logind[1020]: Session 145 logged out. Waiting for processes to exit. May 25 03:36:42 oleg425-client systemd-logind[1020]: Removed session 145. May 25 03:38:31 oleg425-client kernel: Lustre: 29615:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694573/real 1779694573] req@ffffa09b061b2680 x1866143414632448/t0(0) o36->lustre-MDT0000-mdc-ffffa09b0ab14000@192.168.204.125@tcp:12/10 lens 488/512 e 0 to 1 dl 1779694711 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 May 25 03:38:31 oleg425-client kernel: Lustre: 29615:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 15 previous similar messages May 25 03:38:33 oleg425-client sshd[30172]: Accepted publickey for root from 192.168.204.25 port 43978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:33 oleg425-client systemd-logind[1020]: New session 146 of user root. May 25 03:38:33 oleg425-client systemd[1]: Started Session 146 of user root. May 25 03:38:33 oleg425-client sshd[30172]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:34 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21f: drop both reply while close and open are both in flight ========================================================== 03:38:31 (1779694711) May 25 03:38:34 oleg425-client sshd[30185]: Received disconnect from 192.168.204.25 port 43978:11: disconnected by user May 25 03:38:34 oleg425-client sshd[30185]: Disconnected from user root 192.168.204.25 port 43978 May 25 03:38:34 oleg425-client sshd[30172]: pam_unix(sshd:session): session closed for user root May 25 03:38:34 oleg425-client systemd[1]: session-146.scope: Succeeded. May 25 03:38:34 oleg425-client systemd-logind[1020]: Session 146 logged out. Waiting for processes to exit. May 25 03:38:34 oleg425-client systemd-logind[1020]: Removed session 146. May 25 03:38:56 oleg425-client sshd[30358]: Accepted publickey for root from 192.168.204.25 port 45968 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:56 oleg425-client systemd-logind[1020]: New session 147 of user root. May 25 03:38:56 oleg425-client systemd[1]: Started Session 147 of user root. May 25 03:38:56 oleg425-client sshd[30358]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:56 oleg425-client sshd[30371]: Received disconnect from 192.168.204.25 port 45968:11: disconnected by user May 25 03:38:56 oleg425-client sshd[30371]: Disconnected from user root 192.168.204.25 port 45968 May 25 03:38:56 oleg425-client sshd[30358]: pam_unix(sshd:session): session closed for user root May 25 03:38:56 oleg425-client systemd[1]: session-147.scope: Succeeded. May 25 03:38:56 oleg425-client systemd-logind[1020]: Session 147 logged out. Waiting for processes to exit. May 25 03:38:56 oleg425-client systemd-logind[1020]: Removed session 147. May 25 03:38:58 oleg425-client sshd[30496]: Accepted publickey for root from 192.168.204.25 port 45980 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:58 oleg425-client systemd-logind[1020]: New session 148 of user root. May 25 03:38:58 oleg425-client systemd[1]: Started Session 148 of user root. May 25 03:38:58 oleg425-client sshd[30496]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:58 oleg425-client sshd[30509]: Received disconnect from 192.168.204.25 port 45980:11: disconnected by user May 25 03:38:58 oleg425-client sshd[30509]: Disconnected from user root 192.168.204.25 port 45980 May 25 03:38:58 oleg425-client sshd[30496]: pam_unix(sshd:session): session closed for user root May 25 03:38:58 oleg425-client systemd[1]: session-148.scope: Succeeded. May 25 03:38:58 oleg425-client systemd-logind[1020]: Session 148 logged out. Waiting for processes to exit. May 25 03:38:58 oleg425-client systemd-logind[1020]: Removed session 148. May 25 03:38:59 oleg425-client sshd[30640]: Accepted publickey for root from 192.168.204.25 port 45986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:59 oleg425-client systemd-logind[1020]: New session 149 of user root. May 25 03:38:59 oleg425-client systemd[1]: Started Session 149 of user root. May 25 03:38:59 oleg425-client sshd[30640]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:00 oleg425-client sshd[30653]: Received disconnect from 192.168.204.25 port 45986:11: disconnected by user May 25 03:39:00 oleg425-client sshd[30653]: Disconnected from user root 192.168.204.25 port 45986 May 25 03:39:00 oleg425-client sshd[30640]: pam_unix(sshd:session): session closed for user root May 25 03:39:00 oleg425-client systemd[1]: session-149.scope: Succeeded. May 25 03:39:00 oleg425-client systemd-logind[1020]: Session 149 logged out. Waiting for processes to exit. May 25 03:39:00 oleg425-client systemd-logind[1020]: Removed session 149. May 25 03:39:02 oleg425-client sshd[30793]: Accepted publickey for root from 192.168.204.25 port 45992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:02 oleg425-client systemd-logind[1020]: New session 150 of user root. May 25 03:39:02 oleg425-client systemd[1]: Started Session 150 of user root. May 25 03:39:02 oleg425-client sshd[30793]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:02 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21g: drop open reply and close request while close and open are both in flight ========================================================== 03:39:00 (1779694740) May 25 03:39:02 oleg425-client sshd[30806]: Received disconnect from 192.168.204.25 port 45992:11: disconnected by user May 25 03:39:02 oleg425-client sshd[30806]: Disconnected from user root 192.168.204.25 port 45992 May 25 03:39:02 oleg425-client sshd[30793]: pam_unix(sshd:session): session closed for user root May 25 03:39:02 oleg425-client systemd-logind[1020]: Session 150 logged out. Waiting for processes to exit. May 25 03:39:02 oleg425-client systemd[1]: session-150.scope: Succeeded. May 25 03:39:02 oleg425-client systemd-logind[1020]: Removed session 150. May 25 03:39:24 oleg425-client sshd[30977]: Accepted publickey for root from 192.168.204.25 port 38800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:24 oleg425-client systemd-logind[1020]: New session 151 of user root. May 25 03:39:24 oleg425-client systemd[1]: Started Session 151 of user root. May 25 03:39:24 oleg425-client sshd[30977]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:24 oleg425-client sshd[30990]: Received disconnect from 192.168.204.25 port 38800:11: disconnected by user May 25 03:39:24 oleg425-client sshd[30990]: Disconnected from user root 192.168.204.25 port 38800 May 25 03:39:24 oleg425-client sshd[30977]: pam_unix(sshd:session): session closed for user root May 25 03:39:24 oleg425-client systemd[1]: session-151.scope: Succeeded. May 25 03:39:24 oleg425-client systemd-logind[1020]: Session 151 logged out. Waiting for processes to exit. May 25 03:39:25 oleg425-client systemd-logind[1020]: Removed session 151. May 25 03:39:25 oleg425-client sshd[31114]: Accepted publickey for root from 192.168.204.25 port 40896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:26 oleg425-client systemd[1]: Started Session 152 of user root. May 25 03:39:26 oleg425-client systemd-logind[1020]: New session 152 of user root. May 25 03:39:26 oleg425-client sshd[31114]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:26 oleg425-client sshd[31127]: Received disconnect from 192.168.204.25 port 40896:11: disconnected by user May 25 03:39:26 oleg425-client sshd[31127]: Disconnected from user root 192.168.204.25 port 40896 May 25 03:39:26 oleg425-client sshd[31114]: pam_unix(sshd:session): session closed for user root May 25 03:39:26 oleg425-client systemd[1]: session-152.scope: Succeeded. May 25 03:39:26 oleg425-client systemd-logind[1020]: Session 152 logged out. Waiting for processes to exit. May 25 03:39:26 oleg425-client systemd-logind[1020]: Removed session 152. May 25 03:39:27 oleg425-client sshd[31258]: Accepted publickey for root from 192.168.204.25 port 40904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:27 oleg425-client systemd-logind[1020]: New session 153 of user root. May 25 03:39:27 oleg425-client systemd[1]: Started Session 153 of user root. May 25 03:39:27 oleg425-client sshd[31258]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:28 oleg425-client sshd[31271]: Received disconnect from 192.168.204.25 port 40904:11: disconnected by user May 25 03:39:28 oleg425-client sshd[31271]: Disconnected from user root 192.168.204.25 port 40904 May 25 03:39:28 oleg425-client sshd[31258]: pam_unix(sshd:session): session closed for user root May 25 03:39:28 oleg425-client systemd[1]: session-153.scope: Succeeded. May 25 03:39:28 oleg425-client systemd-logind[1020]: Session 153 logged out. Waiting for processes to exit. May 25 03:39:28 oleg425-client systemd-logind[1020]: Removed session 153. May 25 03:39:29 oleg425-client sshd[31412]: Accepted publickey for root from 192.168.204.25 port 40916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:29 oleg425-client systemd-logind[1020]: New session 154 of user root. May 25 03:39:29 oleg425-client systemd[1]: Started Session 154 of user root. May 25 03:39:29 oleg425-client sshd[31412]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:30 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21h: drop open request and close reply while close and open are both in flight ========================================================== 03:39:28 (1779694768) May 25 03:39:30 oleg425-client sshd[31426]: Received disconnect from 192.168.204.25 port 40916:11: disconnected by user May 25 03:39:30 oleg425-client sshd[31426]: Disconnected from user root 192.168.204.25 port 40916 May 25 03:39:30 oleg425-client sshd[31412]: pam_unix(sshd:session): session closed for user root May 25 03:39:30 oleg425-client systemd-logind[1020]: Session 154 logged out. Waiting for processes to exit. May 25 03:39:30 oleg425-client systemd[1]: session-154.scope: Succeeded. May 25 03:39:30 oleg425-client systemd-logind[1020]: Removed session 154. May 25 03:39:50 oleg425-client sshd[31595]: Accepted publickey for root from 192.168.204.25 port 57486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:51 oleg425-client systemd-logind[1020]: New session 155 of user root. May 25 03:39:51 oleg425-client systemd[1]: Started Session 155 of user root. May 25 03:39:51 oleg425-client sshd[31595]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:51 oleg425-client sshd[31608]: Received disconnect from 192.168.204.25 port 57486:11: disconnected by user May 25 03:39:51 oleg425-client sshd[31608]: Disconnected from user root 192.168.204.25 port 57486 May 25 03:39:51 oleg425-client sshd[31595]: pam_unix(sshd:session): session closed for user root May 25 03:39:51 oleg425-client systemd[1]: session-155.scope: Succeeded. May 25 03:39:51 oleg425-client systemd-logind[1020]: Session 155 logged out. Waiting for processes to exit. May 25 03:39:51 oleg425-client systemd-logind[1020]: Removed session 155. May 25 03:39:52 oleg425-client sshd[31733]: Accepted publickey for root from 192.168.204.25 port 57494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:52 oleg425-client systemd-logind[1020]: New session 156 of user root. May 25 03:39:52 oleg425-client systemd[1]: Started Session 156 of user root. May 25 03:39:52 oleg425-client sshd[31733]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:53 oleg425-client sshd[31747]: Received disconnect from 192.168.204.25 port 57494:11: disconnected by user May 25 03:39:53 oleg425-client sshd[31747]: Disconnected from user root 192.168.204.25 port 57494 May 25 03:39:53 oleg425-client sshd[31733]: pam_unix(sshd:session): session closed for user root May 25 03:39:53 oleg425-client systemd-logind[1020]: Session 156 logged out. Waiting for processes to exit. May 25 03:39:53 oleg425-client systemd[1]: session-156.scope: Succeeded. May 25 03:39:53 oleg425-client systemd-logind[1020]: Removed session 156. May 25 03:39:54 oleg425-client sshd[31878]: Accepted publickey for root from 192.168.204.25 port 33562 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:54 oleg425-client systemd-logind[1020]: New session 157 of user root. May 25 03:39:54 oleg425-client systemd[1]: Started Session 157 of user root. May 25 03:39:54 oleg425-client sshd[31878]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:55 oleg425-client sshd[31891]: Received disconnect from 192.168.204.25 port 33562:11: disconnected by user May 25 03:39:55 oleg425-client sshd[31891]: Disconnected from user root 192.168.204.25 port 33562 May 25 03:39:55 oleg425-client sshd[31878]: pam_unix(sshd:session): session closed for user root May 25 03:39:55 oleg425-client systemd[1]: session-157.scope: Succeeded. May 25 03:39:55 oleg425-client systemd-logind[1020]: Session 157 logged out. Waiting for processes to exit. May 25 03:39:55 oleg425-client systemd-logind[1020]: Removed session 157. May 25 03:39:56 oleg425-client sshd[32031]: Accepted publickey for root from 192.168.204.25 port 33572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:39:56 oleg425-client systemd[1]: Started Session 158 of user root. May 25 03:39:56 oleg425-client systemd-logind[1020]: New session 158 of user root. May 25 03:39:56 oleg425-client sshd[32031]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:39:57 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 22: drop close request and do mknod ========================================================== 03:39:55 (1779694795) May 25 03:39:57 oleg425-client sshd[32044]: Received disconnect from 192.168.204.25 port 33572:11: disconnected by user May 25 03:39:57 oleg425-client sshd[32044]: Disconnected from user root 192.168.204.25 port 33572 May 25 03:39:57 oleg425-client sshd[32031]: pam_unix(sshd:session): session closed for user root May 25 03:39:57 oleg425-client systemd-logind[1020]: Session 158 logged out. Waiting for processes to exit. May 25 03:39:57 oleg425-client systemd[1]: session-158.scope: Succeeded. May 25 03:39:57 oleg425-client systemd-logind[1020]: Removed session 158. May 25 03:40:16 oleg425-client sshd[32193]: Accepted publickey for root from 192.168.204.25 port 33978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:40:16 oleg425-client systemd-logind[1020]: New session 159 of user root. May 25 03:40:16 oleg425-client systemd[1]: Started Session 159 of user root. May 25 03:40:16 oleg425-client sshd[32193]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:40:17 oleg425-client sshd[32206]: Received disconnect from 192.168.204.25 port 33978:11: disconnected by user May 25 03:40:17 oleg425-client sshd[32206]: Disconnected from user root 192.168.204.25 port 33978 May 25 03:40:17 oleg425-client sshd[32193]: pam_unix(sshd:session): session closed for user root May 25 03:40:17 oleg425-client systemd-logind[1020]: Session 159 logged out. Waiting for processes to exit. May 25 03:40:17 oleg425-client systemd[1]: session-159.scope: Succeeded. May 25 03:40:17 oleg425-client systemd-logind[1020]: Removed session 159. May 25 03:40:18 oleg425-client sshd[32330]: Accepted publickey for root from 192.168.204.25 port 33994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:40:18 oleg425-client systemd-logind[1020]: New session 160 of user root. May 25 03:40:18 oleg425-client systemd[1]: Started Session 160 of user root. May 25 03:40:18 oleg425-client sshd[32330]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:40:19 oleg425-client sshd[32344]: Received disconnect from 192.168.204.25 port 33994:11: disconnected by user May 25 03:40:19 oleg425-client sshd[32344]: Disconnected from user root 192.168.204.25 port 33994 May 25 03:40:19 oleg425-client sshd[32330]: pam_unix(sshd:session): session closed for user root May 25 03:40:19 oleg425-client systemd-logind[1020]: Session 160 logged out. Waiting for processes to exit. May 25 03:40:19 oleg425-client systemd[1]: session-160.scope: Succeeded. May 25 03:40:19 oleg425-client systemd-logind[1020]: Removed session 160. May 25 03:40:20 oleg425-client sshd[32475]: Accepted publickey for root from 192.168.204.25 port 34002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:40:20 oleg425-client systemd[1]: Started Session 161 of user root. May 25 03:40:20 oleg425-client systemd-logind[1020]: New session 161 of user root. May 25 03:40:20 oleg425-client sshd[32475]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:40:21 oleg425-client sshd[32488]: Received disconnect from 192.168.204.25 port 34002:11: disconnected by user May 25 03:40:21 oleg425-client sshd[32488]: Disconnected from user root 192.168.204.25 port 34002 May 25 03:40:21 oleg425-client sshd[32475]: pam_unix(sshd:session): session closed for user root May 25 03:40:21 oleg425-client systemd-logind[1020]: Session 161 logged out. Waiting for processes to exit. May 25 03:40:21 oleg425-client systemd[1]: session-161.scope: Succeeded. May 25 03:40:21 oleg425-client systemd-logind[1020]: Removed session 161. May 25 03:40:22 oleg425-client sshd[32628]: Accepted publickey for root from 192.168.204.25 port 34006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:40:23 oleg425-client systemd[1]: Started Session 162 of user root. May 25 03:40:23 oleg425-client systemd-logind[1020]: New session 162 of user root. May 25 03:40:23 oleg425-client sshd[32628]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:40:23 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 23: client hang when close a file after mds crash ========================================================== 03:40:21 (1779694821) May 25 03:40:23 oleg425-client sshd[32641]: Received disconnect from 192.168.204.25 port 34006:11: disconnected by user May 25 03:40:23 oleg425-client sshd[32641]: Disconnected from user root 192.168.204.25 port 34006 May 25 03:40:23 oleg425-client sshd[32628]: pam_unix(sshd:session): session closed for user root May 25 03:40:23 oleg425-client systemd[1]: session-162.scope: Succeeded. May 25 03:40:23 oleg425-client systemd-logind[1020]: Session 162 logged out. Waiting for processes to exit. May 25 03:40:23 oleg425-client systemd-logind[1020]: Removed session 162. May 25 03:40:51 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:41:02 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008b40a9 to 0x799e3d1c008b66e3 May 25 03:41:02 oleg425-client sshd[32970]: Accepted publickey for root from 192.168.204.25 port 59686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:02 oleg425-client systemd[1]: Started Session 163 of user root. May 25 03:41:02 oleg425-client systemd-logind[1020]: New session 163 of user root. May 25 03:41:02 oleg425-client sshd[32970]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:03 oleg425-client sshd[32983]: Received disconnect from 192.168.204.25 port 59686:11: disconnected by user May 25 03:41:03 oleg425-client sshd[32983]: Disconnected from user root 192.168.204.25 port 59686 May 25 03:41:03 oleg425-client sshd[32970]: pam_unix(sshd:session): session closed for user root May 25 03:41:03 oleg425-client systemd-logind[1020]: Session 163 logged out. Waiting for processes to exit. May 25 03:41:03 oleg425-client systemd[1]: session-163.scope: Succeeded. May 25 03:41:03 oleg425-client systemd-logind[1020]: Removed session 163. May 25 03:41:07 oleg425-client sshd[33206]: Accepted publickey for root from 192.168.204.25 port 58252 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:07 oleg425-client systemd[1]: Started Session 164 of user root. May 25 03:41:07 oleg425-client systemd-logind[1020]: New session 164 of user root. May 25 03:41:07 oleg425-client sshd[33206]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:07 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:41:07 oleg425-client sshd[33219]: Received disconnect from 192.168.204.25 port 58252:11: disconnected by user May 25 03:41:07 oleg425-client sshd[33219]: Disconnected from user root 192.168.204.25 port 58252 May 25 03:41:07 oleg425-client sshd[33206]: pam_unix(sshd:session): session closed for user root May 25 03:41:07 oleg425-client systemd[1]: session-164.scope: Succeeded. May 25 03:41:07 oleg425-client systemd-logind[1020]: Session 164 logged out. Waiting for processes to exit. May 25 03:41:07 oleg425-client systemd-logind[1020]: Removed session 164. May 25 03:41:08 oleg425-client sshd[33361]: Accepted publickey for root from 192.168.204.25 port 58260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:09 oleg425-client systemd[1]: Started Session 165 of user root. May 25 03:41:09 oleg425-client systemd-logind[1020]: New session 165 of user root. May 25 03:41:09 oleg425-client sshd[33361]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:09 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:41:09 oleg425-client sshd[33374]: Received disconnect from 192.168.204.25 port 58260:11: disconnected by user May 25 03:41:09 oleg425-client sshd[33374]: Disconnected from user root 192.168.204.25 port 58260 May 25 03:41:09 oleg425-client sshd[33361]: pam_unix(sshd:session): session closed for user root May 25 03:41:09 oleg425-client systemd[1]: session-165.scope: Succeeded. May 25 03:41:09 oleg425-client systemd-logind[1020]: Session 165 logged out. Waiting for processes to exit. May 25 03:41:09 oleg425-client systemd-logind[1020]: Removed session 165. May 25 03:41:11 oleg425-client sshd[33415]: Accepted publickey for root from 192.168.204.25 port 58264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:11 oleg425-client systemd-logind[1020]: New session 166 of user root. May 25 03:41:11 oleg425-client systemd[1]: Started Session 166 of user root. May 25 03:41:11 oleg425-client sshd[33415]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:11 oleg425-client sshd[33428]: Received disconnect from 192.168.204.25 port 58264:11: disconnected by user May 25 03:41:11 oleg425-client sshd[33428]: Disconnected from user root 192.168.204.25 port 58264 May 25 03:41:11 oleg425-client sshd[33415]: pam_unix(sshd:session): session closed for user root May 25 03:41:11 oleg425-client systemd-logind[1020]: Session 166 logged out. Waiting for processes to exit. May 25 03:41:11 oleg425-client systemd[1]: session-166.scope: Succeeded. May 25 03:41:11 oleg425-client systemd-logind[1020]: Removed session 166. May 25 03:41:12 oleg425-client sshd[33545]: Accepted publickey for root from 192.168.204.25 port 58270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:12 oleg425-client systemd[1]: Started Session 167 of user root. May 25 03:41:12 oleg425-client systemd-logind[1020]: New session 167 of user root. May 25 03:41:12 oleg425-client sshd[33545]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:13 oleg425-client sshd[33558]: Received disconnect from 192.168.204.25 port 58270:11: disconnected by user May 25 03:41:13 oleg425-client sshd[33558]: Disconnected from user root 192.168.204.25 port 58270 May 25 03:41:13 oleg425-client sshd[33545]: pam_unix(sshd:session): session closed for user root May 25 03:41:13 oleg425-client systemd-logind[1020]: Session 167 logged out. Waiting for processes to exit. May 25 03:41:13 oleg425-client systemd[1]: session-167.scope: Succeeded. May 25 03:41:13 oleg425-client systemd-logind[1020]: Removed session 167. May 25 03:41:14 oleg425-client sshd[33683]: Accepted publickey for root from 192.168.204.25 port 54708 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:14 oleg425-client systemd[1]: Started Session 168 of user root. May 25 03:41:14 oleg425-client systemd-logind[1020]: New session 168 of user root. May 25 03:41:14 oleg425-client sshd[33683]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:15 oleg425-client sshd[33696]: Received disconnect from 192.168.204.25 port 54708:11: disconnected by user May 25 03:41:15 oleg425-client sshd[33696]: Disconnected from user root 192.168.204.25 port 54708 May 25 03:41:15 oleg425-client sshd[33683]: pam_unix(sshd:session): session closed for user root May 25 03:41:15 oleg425-client systemd[1]: session-168.scope: Succeeded. May 25 03:41:15 oleg425-client systemd-logind[1020]: Session 168 logged out. Waiting for processes to exit. May 25 03:41:15 oleg425-client systemd-logind[1020]: Removed session 168. May 25 03:41:17 oleg425-client sshd[33827]: Accepted publickey for root from 192.168.204.25 port 54724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:17 oleg425-client systemd-logind[1020]: New session 169 of user root. May 25 03:41:17 oleg425-client systemd[1]: Started Session 169 of user root. May 25 03:41:17 oleg425-client sshd[33827]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:17 oleg425-client sshd[33840]: Received disconnect from 192.168.204.25 port 54724:11: disconnected by user May 25 03:41:17 oleg425-client sshd[33840]: Disconnected from user root 192.168.204.25 port 54724 May 25 03:41:17 oleg425-client sshd[33827]: pam_unix(sshd:session): session closed for user root May 25 03:41:17 oleg425-client systemd[1]: session-169.scope: Succeeded. May 25 03:41:17 oleg425-client systemd-logind[1020]: Session 169 logged out. Waiting for processes to exit. May 25 03:41:17 oleg425-client systemd-logind[1020]: Removed session 169. May 25 03:41:19 oleg425-client sshd[33981]: Accepted publickey for root from 192.168.204.25 port 54738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:19 oleg425-client systemd-logind[1020]: New session 170 of user root. May 25 03:41:19 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:41:19 oleg425-client systemd[1]: Started Session 170 of user root. May 25 03:41:19 oleg425-client sshd[33981]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:19 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24a: fsync error (should return error) ========================================================== 03:41:18 (1779694878) May 25 03:41:19 oleg425-client sshd[33996]: Received disconnect from 192.168.204.25 port 54738:11: disconnected by user May 25 03:41:19 oleg425-client sshd[33996]: Disconnected from user root 192.168.204.25 port 54738 May 25 03:41:19 oleg425-client sshd[33981]: pam_unix(sshd:session): session closed for user root May 25 03:41:19 oleg425-client systemd[1]: session-170.scope: Succeeded. May 25 03:41:19 oleg425-client systemd-logind[1020]: Session 170 logged out. Waiting for processes to exit. May 25 03:41:19 oleg425-client systemd-logind[1020]: Removed session 170. May 25 03:41:22 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ost_write to node 192.168.204.125@tcp failed: rc = -107 May 25 03:41:22 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:41:22 oleg425-client kernel: Lustre: 2373:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.125@tcp:/lustre/fid: [0x200000404:0x30:0x0]// may get corrupted (rc -5) May 25 03:41:23 oleg425-client sshd[34179]: Accepted publickey for root from 192.168.204.25 port 54746 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:23 oleg425-client systemd-logind[1020]: New session 171 of user root. May 25 03:41:23 oleg425-client systemd[1]: Started Session 171 of user root. May 25 03:41:23 oleg425-client sshd[34179]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:24 oleg425-client sshd[34192]: Received disconnect from 192.168.204.25 port 54746:11: disconnected by user May 25 03:41:24 oleg425-client sshd[34192]: Disconnected from user root 192.168.204.25 port 54746 May 25 03:41:24 oleg425-client sshd[34179]: pam_unix(sshd:session): session closed for user root May 25 03:41:24 oleg425-client systemd[1]: session-171.scope: Succeeded. May 25 03:41:24 oleg425-client systemd-logind[1020]: Session 171 logged out. Waiting for processes to exit. May 25 03:41:24 oleg425-client systemd-logind[1020]: Removed session 171. May 25 03:41:25 oleg425-client sshd[34317]: Accepted publickey for root from 192.168.204.25 port 44910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:26 oleg425-client systemd[1]: Started Session 172 of user root. May 25 03:41:26 oleg425-client systemd-logind[1020]: New session 172 of user root. May 25 03:41:26 oleg425-client sshd[34317]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:26 oleg425-client sshd[34330]: Received disconnect from 192.168.204.25 port 44910:11: disconnected by user May 25 03:41:26 oleg425-client sshd[34330]: Disconnected from user root 192.168.204.25 port 44910 May 25 03:41:26 oleg425-client sshd[34317]: pam_unix(sshd:session): session closed for user root May 25 03:41:26 oleg425-client systemd[1]: session-172.scope: Succeeded. May 25 03:41:26 oleg425-client systemd-logind[1020]: Session 172 logged out. Waiting for processes to exit. May 25 03:41:26 oleg425-client systemd-logind[1020]: Removed session 172. May 25 03:41:28 oleg425-client sshd[34461]: Accepted publickey for root from 192.168.204.25 port 44914 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:28 oleg425-client systemd[1]: Started Session 173 of user root. May 25 03:41:28 oleg425-client sshd[34461]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:28 oleg425-client systemd-logind[1020]: New session 173 of user root. May 25 03:41:29 oleg425-client sshd[34474]: Received disconnect from 192.168.204.25 port 44914:11: disconnected by user May 25 03:41:29 oleg425-client sshd[34474]: Disconnected from user root 192.168.204.25 port 44914 May 25 03:41:29 oleg425-client sshd[34461]: pam_unix(sshd:session): session closed for user root May 25 03:41:29 oleg425-client systemd-logind[1020]: Session 173 logged out. Waiting for processes to exit. May 25 03:41:29 oleg425-client systemd[1]: session-173.scope: Succeeded. May 25 03:41:29 oleg425-client systemd-logind[1020]: Removed session 173. May 25 03:41:31 oleg425-client sshd[34614]: Accepted publickey for root from 192.168.204.25 port 44916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:31 oleg425-client systemd-logind[1020]: New session 174 of user root. May 25 03:41:31 oleg425-client systemd[1]: Started Session 174 of user root. May 25 03:41:31 oleg425-client sshd[34614]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:32 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 03:41:30 (1779694890) May 25 03:41:32 oleg425-client sshd[34627]: Received disconnect from 192.168.204.25 port 44916:11: disconnected by user May 25 03:41:32 oleg425-client sshd[34627]: Disconnected from user root 192.168.204.25 port 44916 May 25 03:41:32 oleg425-client sshd[34614]: pam_unix(sshd:session): session closed for user root May 25 03:41:32 oleg425-client systemd-logind[1020]: Session 174 logged out. Waiting for processes to exit. May 25 03:41:32 oleg425-client systemd[1]: session-174.scope: Succeeded. May 25 03:41:32 oleg425-client systemd-logind[1020]: Removed session 174. May 25 03:41:34 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:41:35 oleg425-client kernel: Lustre: 2374:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.125@tcp:/lustre/fid: [0x200000404:0x35:0x0]// may get corrupted (rc -108) May 25 03:41:37 oleg425-client sshd[34817]: Accepted publickey for root from 192.168.204.25 port 42286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:37 oleg425-client systemd-logind[1020]: New session 175 of user root. May 25 03:41:37 oleg425-client systemd[1]: Started Session 175 of user root. May 25 03:41:37 oleg425-client sshd[34817]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:37 oleg425-client sshd[34830]: Received disconnect from 192.168.204.25 port 42286:11: disconnected by user May 25 03:41:37 oleg425-client sshd[34830]: Disconnected from user root 192.168.204.25 port 42286 May 25 03:41:37 oleg425-client sshd[34817]: pam_unix(sshd:session): session closed for user root May 25 03:41:38 oleg425-client systemd-logind[1020]: Session 175 logged out. Waiting for processes to exit. May 25 03:41:38 oleg425-client systemd[1]: session-175.scope: Succeeded. May 25 03:41:38 oleg425-client systemd-logind[1020]: Removed session 175. May 25 03:41:39 oleg425-client sshd[34955]: Accepted publickey for root from 192.168.204.25 port 42290 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:39 oleg425-client systemd-logind[1020]: New session 176 of user root. May 25 03:41:39 oleg425-client systemd[1]: Started Session 176 of user root. May 25 03:41:39 oleg425-client sshd[34955]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:40 oleg425-client sshd[34968]: Received disconnect from 192.168.204.25 port 42290:11: disconnected by user May 25 03:41:40 oleg425-client sshd[34968]: Disconnected from user root 192.168.204.25 port 42290 May 25 03:41:40 oleg425-client sshd[34955]: pam_unix(sshd:session): session closed for user root May 25 03:41:40 oleg425-client systemd[1]: session-176.scope: Succeeded. May 25 03:41:40 oleg425-client systemd-logind[1020]: Session 176 logged out. Waiting for processes to exit. May 25 03:41:40 oleg425-client systemd-logind[1020]: Removed session 176. May 25 03:41:42 oleg425-client sshd[35099]: Accepted publickey for root from 192.168.204.25 port 42300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:42 oleg425-client systemd-logind[1020]: New session 177 of user root. May 25 03:41:42 oleg425-client systemd[1]: Started Session 177 of user root. May 25 03:41:42 oleg425-client sshd[35099]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:43 oleg425-client sshd[35112]: Received disconnect from 192.168.204.25 port 42300:11: disconnected by user May 25 03:41:43 oleg425-client sshd[35112]: Disconnected from user root 192.168.204.25 port 42300 May 25 03:41:43 oleg425-client sshd[35099]: pam_unix(sshd:session): session closed for user root May 25 03:41:43 oleg425-client systemd[1]: session-177.scope: Succeeded. May 25 03:41:43 oleg425-client systemd-logind[1020]: Session 177 logged out. Waiting for processes to exit. May 25 03:41:43 oleg425-client systemd-logind[1020]: Removed session 177. May 25 03:41:45 oleg425-client sshd[35253]: Accepted publickey for root from 192.168.204.25 port 32776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:45 oleg425-client systemd[1]: Started Session 178 of user root. May 25 03:41:45 oleg425-client systemd-logind[1020]: New session 178 of user root. May 25 03:41:45 oleg425-client sshd[35253]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:45 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 03:41:43 (1779694903) May 25 03:41:45 oleg425-client sshd[35266]: Received disconnect from 192.168.204.25 port 32776:11: disconnected by user May 25 03:41:45 oleg425-client sshd[35266]: Disconnected from user root 192.168.204.25 port 32776 May 25 03:41:46 oleg425-client sshd[35253]: pam_unix(sshd:session): session closed for user root May 25 03:41:46 oleg425-client systemd-logind[1020]: Session 178 logged out. Waiting for processes to exit. May 25 03:41:46 oleg425-client systemd[1]: session-178.scope: Succeeded. May 25 03:41:46 oleg425-client systemd-logind[1020]: Removed session 178. May 25 03:41:48 oleg425-client sshd[35482]: Accepted publickey for root from 192.168.204.25 port 32792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:48 oleg425-client systemd-logind[1020]: New session 179 of user root. May 25 03:41:48 oleg425-client systemd[1]: Started Session 179 of user root. May 25 03:41:48 oleg425-client sshd[35482]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:48 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node May 25 03:41:48 oleg425-client sshd[35495]: Received disconnect from 192.168.204.25 port 32792:11: disconnected by user May 25 03:41:49 oleg425-client sshd[35495]: Disconnected from user root 192.168.204.25 port 32792 May 25 03:41:49 oleg425-client sshd[35482]: pam_unix(sshd:session): session closed for user root May 25 03:41:49 oleg425-client systemd[1]: session-179.scope: Succeeded. May 25 03:41:49 oleg425-client systemd-logind[1020]: Session 179 logged out. Waiting for processes to exit. May 25 03:41:49 oleg425-client systemd-logind[1020]: Removed session 179. May 25 03:41:50 oleg425-client sshd[35634]: Accepted publickey for root from 192.168.204.25 port 32800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:50 oleg425-client systemd-logind[1020]: New session 180 of user root. May 25 03:41:50 oleg425-client systemd[1]: Started Session 180 of user root. May 25 03:41:51 oleg425-client sshd[35634]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:51 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 03:41:49 (1779694909) May 25 03:41:51 oleg425-client sshd[35648]: Received disconnect from 192.168.204.25 port 32800:11: disconnected by user May 25 03:41:51 oleg425-client sshd[35648]: Disconnected from user root 192.168.204.25 port 32800 May 25 03:41:51 oleg425-client sshd[35634]: pam_unix(sshd:session): session closed for user root May 25 03:41:51 oleg425-client systemd[1]: session-180.scope: Succeeded. May 25 03:41:51 oleg425-client systemd-logind[1020]: Session 180 logged out. Waiting for processes to exit. May 25 03:41:51 oleg425-client systemd-logind[1020]: Removed session 180. May 25 03:41:52 oleg425-client sshd[35804]: Accepted publickey for root from 192.168.204.25 port 32814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:52 oleg425-client systemd-logind[1020]: New session 181 of user root. May 25 03:41:52 oleg425-client systemd[1]: Started Session 181 of user root. May 25 03:41:52 oleg425-client sshd[35804]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:53 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node May 25 03:41:53 oleg425-client sshd[35817]: Received disconnect from 192.168.204.25 port 32814:11: disconnected by user May 25 03:41:53 oleg425-client sshd[35817]: Disconnected from user root 192.168.204.25 port 32814 May 25 03:41:53 oleg425-client sshd[35804]: pam_unix(sshd:session): session closed for user root May 25 03:41:53 oleg425-client systemd[1]: session-181.scope: Succeeded. May 25 03:41:53 oleg425-client systemd-logind[1020]: Session 181 logged out. Waiting for processes to exit. May 25 03:41:53 oleg425-client systemd-logind[1020]: Removed session 181. May 25 03:41:55 oleg425-client sshd[35956]: Accepted publickey for root from 192.168.204.25 port 56224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:55 oleg425-client systemd-logind[1020]: New session 182 of user root. May 25 03:41:55 oleg425-client systemd[1]: Started Session 182 of user root. May 25 03:41:55 oleg425-client sshd[35956]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:55 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 03:41:53 (1779694913) May 25 03:41:55 oleg425-client sshd[35969]: Received disconnect from 192.168.204.25 port 56224:11: disconnected by user May 25 03:41:55 oleg425-client sshd[35969]: Disconnected from user root 192.168.204.25 port 56224 May 25 03:41:55 oleg425-client sshd[35956]: pam_unix(sshd:session): session closed for user root May 25 03:41:55 oleg425-client systemd[1]: session-182.scope: Succeeded. May 25 03:41:55 oleg425-client systemd-logind[1020]: Session 182 logged out. Waiting for processes to exit. May 25 03:41:55 oleg425-client systemd-logind[1020]: Removed session 182. May 25 03:41:59 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -19 May 25 03:41:59 oleg425-client kernel: LustreError: Skipped 1 previous similar message May 25 03:42:19 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:42:19 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008b66e3 to 0x799e3d1c008b7e8a May 25 03:44:04 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: operation mds_reint to node 192.168.204.125@tcp failed: rc = -19 May 25 03:44:04 oleg425-client kernel: LustreError: Skipped 1 previous similar message May 25 03:44:21 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:44:32 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008b7e8a to 0x799e3d1c008d4f70 May 25 03:44:33 oleg425-client sshd[36950]: Accepted publickey for root from 192.168.204.25 port 42062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:44:33 oleg425-client systemd-logind[1020]: New session 183 of user root. May 25 03:44:33 oleg425-client systemd[1]: Started Session 183 of user root. May 25 03:44:33 oleg425-client sshd[36950]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:44:33 oleg425-client sshd[36963]: Received disconnect from 192.168.204.25 port 42062:11: disconnected by user May 25 03:44:33 oleg425-client sshd[36963]: Disconnected from user root 192.168.204.25 port 42062 May 25 03:44:33 oleg425-client sshd[36950]: pam_unix(sshd:session): session closed for user root May 25 03:44:33 oleg425-client systemd[1]: session-183.scope: Succeeded. May 25 03:44:33 oleg425-client systemd-logind[1020]: Session 183 logged out. Waiting for processes to exit. May 25 03:44:33 oleg425-client systemd-logind[1020]: Removed session 183. May 25 03:44:35 oleg425-client sshd[37090]: Accepted publickey for root from 192.168.204.25 port 49840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:44:35 oleg425-client systemd[1]: Started Session 184 of user root. May 25 03:44:35 oleg425-client systemd-logind[1020]: New session 184 of user root. May 25 03:44:35 oleg425-client sshd[37090]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:44:35 oleg425-client sshd[37103]: Received disconnect from 192.168.204.25 port 49840:11: disconnected by user May 25 03:44:35 oleg425-client sshd[37103]: Disconnected from user root 192.168.204.25 port 49840 May 25 03:44:35 oleg425-client sshd[37090]: pam_unix(sshd:session): session closed for user root May 25 03:44:35 oleg425-client systemd[1]: session-184.scope: Succeeded. May 25 03:44:35 oleg425-client systemd-logind[1020]: Session 184 logged out. Waiting for processes to exit. May 25 03:44:35 oleg425-client systemd-logind[1020]: Removed session 184. May 25 03:44:36 oleg425-client sshd[37234]: Accepted publickey for root from 192.168.204.25 port 49854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:44:36 oleg425-client systemd-logind[1020]: New session 185 of user root. May 25 03:44:36 oleg425-client systemd[1]: Started Session 185 of user root. May 25 03:44:36 oleg425-client sshd[37234]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:44:37 oleg425-client sshd[37247]: Received disconnect from 192.168.204.25 port 49854:11: disconnected by user May 25 03:44:37 oleg425-client sshd[37247]: Disconnected from user root 192.168.204.25 port 49854 May 25 03:44:37 oleg425-client sshd[37234]: pam_unix(sshd:session): session closed for user root May 25 03:44:37 oleg425-client systemd[1]: session-185.scope: Succeeded. May 25 03:44:37 oleg425-client systemd-logind[1020]: Session 185 logged out. Waiting for processes to exit. May 25 03:44:37 oleg425-client systemd-logind[1020]: Removed session 185. May 25 03:44:38 oleg425-client sshd[37388]: Accepted publickey for root from 192.168.204.25 port 49858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:44:38 oleg425-client systemd[1]: Started Session 186 of user root. May 25 03:44:38 oleg425-client systemd-logind[1020]: New session 186 of user root. May 25 03:44:38 oleg425-client sshd[37388]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:44:39 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 03:44:37 (1779695077) May 25 03:44:39 oleg425-client sshd[37402]: Received disconnect from 192.168.204.25 port 49858:11: disconnected by user May 25 03:44:39 oleg425-client sshd[37402]: Disconnected from user root 192.168.204.25 port 49858 May 25 03:44:39 oleg425-client sshd[37388]: pam_unix(sshd:session): session closed for user root May 25 03:44:39 oleg425-client systemd-logind[1020]: Session 186 logged out. Waiting for processes to exit. May 25 03:44:39 oleg425-client systemd[1]: session-186.scope: Succeeded. May 25 03:44:39 oleg425-client systemd-logind[1020]: Removed session 186. May 25 03:44:39 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:44:39 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:44:58 oleg425-client sshd[37495]: Accepted publickey for root from 192.168.204.25 port 44606 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:44:58 oleg425-client systemd-logind[1020]: New session 187 of user root. May 25 03:44:58 oleg425-client systemd[1]: Started Session 187 of user root. May 25 03:44:58 oleg425-client sshd[37495]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:02 oleg425-client sshd[37508]: Received disconnect from 192.168.204.25 port 44606:11: disconnected by user May 25 03:45:02 oleg425-client sshd[37508]: Disconnected from user root 192.168.204.25 port 44606 May 25 03:45:02 oleg425-client sshd[37495]: pam_unix(sshd:session): session closed for user root May 25 03:45:02 oleg425-client systemd[1]: session-187.scope: Succeeded. May 25 03:45:02 oleg425-client systemd-logind[1020]: Session 187 logged out. Waiting for processes to exit. May 25 03:45:02 oleg425-client systemd-logind[1020]: Removed session 187. May 25 03:45:23 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:45:23 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008d4f70 to 0x799e3d1c008d528e May 25 03:45:31 oleg425-client sshd[37811]: Accepted publickey for root from 192.168.204.25 port 45634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:31 oleg425-client systemd-logind[1020]: New session 188 of user root. May 25 03:45:31 oleg425-client systemd[1]: Started Session 188 of user root. May 25 03:45:31 oleg425-client sshd[37811]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:32 oleg425-client sshd[37824]: Received disconnect from 192.168.204.25 port 45634:11: disconnected by user May 25 03:45:32 oleg425-client sshd[37824]: Disconnected from user root 192.168.204.25 port 45634 May 25 03:45:32 oleg425-client sshd[37811]: pam_unix(sshd:session): session closed for user root May 25 03:45:32 oleg425-client systemd[1]: session-188.scope: Succeeded. May 25 03:45:32 oleg425-client systemd-logind[1020]: Session 188 logged out. Waiting for processes to exit. May 25 03:45:32 oleg425-client systemd-logind[1020]: Removed session 188. May 25 03:45:34 oleg425-client sshd[38045]: Accepted publickey for root from 192.168.204.25 port 39510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:34 oleg425-client systemd-logind[1020]: New session 189 of user root. May 25 03:45:34 oleg425-client systemd[1]: Started Session 189 of user root. May 25 03:45:34 oleg425-client sshd[38045]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:35 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:45:35 oleg425-client sshd[38058]: Received disconnect from 192.168.204.25 port 39510:11: disconnected by user May 25 03:45:35 oleg425-client sshd[38058]: Disconnected from user root 192.168.204.25 port 39510 May 25 03:45:35 oleg425-client sshd[38045]: pam_unix(sshd:session): session closed for user root May 25 03:45:35 oleg425-client systemd[1]: session-189.scope: Succeeded. May 25 03:45:35 oleg425-client systemd-logind[1020]: Session 189 logged out. Waiting for processes to exit. May 25 03:45:35 oleg425-client systemd-logind[1020]: Removed session 189. May 25 03:45:36 oleg425-client sshd[38200]: Accepted publickey for root from 192.168.204.25 port 39518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:36 oleg425-client systemd[1]: Started Session 190 of user root. May 25 03:45:36 oleg425-client systemd-logind[1020]: New session 190 of user root. May 25 03:45:36 oleg425-client sshd[38200]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:36 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:45:36 oleg425-client sshd[38213]: Received disconnect from 192.168.204.25 port 39518:11: disconnected by user May 25 03:45:36 oleg425-client sshd[38213]: Disconnected from user root 192.168.204.25 port 39518 May 25 03:45:36 oleg425-client sshd[38200]: pam_unix(sshd:session): session closed for user root May 25 03:45:37 oleg425-client systemd-logind[1020]: Session 190 logged out. Waiting for processes to exit. May 25 03:45:37 oleg425-client systemd[1]: session-190.scope: Succeeded. May 25 03:45:37 oleg425-client systemd-logind[1020]: Removed session 190. May 25 03:45:38 oleg425-client sshd[38254]: Accepted publickey for root from 192.168.204.25 port 39520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:38 oleg425-client systemd-logind[1020]: New session 191 of user root. May 25 03:45:38 oleg425-client systemd[1]: Started Session 191 of user root. May 25 03:45:38 oleg425-client sshd[38254]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:38 oleg425-client sshd[38267]: Received disconnect from 192.168.204.25 port 39520:11: disconnected by user May 25 03:45:38 oleg425-client sshd[38267]: Disconnected from user root 192.168.204.25 port 39520 May 25 03:45:39 oleg425-client sshd[38254]: pam_unix(sshd:session): session closed for user root May 25 03:45:39 oleg425-client systemd[1]: session-191.scope: Succeeded. May 25 03:45:39 oleg425-client systemd-logind[1020]: Session 191 logged out. Waiting for processes to exit. May 25 03:45:39 oleg425-client systemd-logind[1020]: Removed session 191. May 25 03:45:39 oleg425-client sshd[38385]: Accepted publickey for root from 192.168.204.25 port 39534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:40 oleg425-client systemd-logind[1020]: New session 192 of user root. May 25 03:45:40 oleg425-client systemd[1]: Started Session 192 of user root. May 25 03:45:40 oleg425-client sshd[38385]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:40 oleg425-client sshd[38398]: Received disconnect from 192.168.204.25 port 39534:11: disconnected by user May 25 03:45:40 oleg425-client sshd[38398]: Disconnected from user root 192.168.204.25 port 39534 May 25 03:45:40 oleg425-client sshd[38385]: pam_unix(sshd:session): session closed for user root May 25 03:45:40 oleg425-client systemd-logind[1020]: Session 192 logged out. Waiting for processes to exit. May 25 03:45:40 oleg425-client systemd[1]: session-192.scope: Succeeded. May 25 03:45:40 oleg425-client systemd-logind[1020]: Removed session 192. May 25 03:45:41 oleg425-client sshd[38522]: Accepted publickey for root from 192.168.204.25 port 39540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:41 oleg425-client systemd-logind[1020]: New session 193 of user root. May 25 03:45:41 oleg425-client systemd[1]: Started Session 193 of user root. May 25 03:45:41 oleg425-client sshd[38522]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:42 oleg425-client sshd[38535]: Received disconnect from 192.168.204.25 port 39540:11: disconnected by user May 25 03:45:42 oleg425-client sshd[38535]: Disconnected from user root 192.168.204.25 port 39540 May 25 03:45:42 oleg425-client sshd[38522]: pam_unix(sshd:session): session closed for user root May 25 03:45:42 oleg425-client systemd-logind[1020]: Session 193 logged out. Waiting for processes to exit. May 25 03:45:42 oleg425-client systemd[1]: session-193.scope: Succeeded. May 25 03:45:42 oleg425-client systemd-logind[1020]: Removed session 193. May 25 03:45:43 oleg425-client sshd[38666]: Accepted publickey for root from 192.168.204.25 port 39550 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:43 oleg425-client systemd-logind[1020]: New session 194 of user root. May 25 03:45:43 oleg425-client systemd[1]: Started Session 194 of user root. May 25 03:45:43 oleg425-client sshd[38666]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:43 oleg425-client sshd[38679]: Received disconnect from 192.168.204.25 port 39550:11: disconnected by user May 25 03:45:43 oleg425-client sshd[38679]: Disconnected from user root 192.168.204.25 port 39550 May 25 03:45:43 oleg425-client sshd[38666]: pam_unix(sshd:session): session closed for user root May 25 03:45:43 oleg425-client systemd[1]: session-194.scope: Succeeded. May 25 03:45:43 oleg425-client systemd-logind[1020]: Session 194 logged out. Waiting for processes to exit. May 25 03:45:43 oleg425-client systemd-logind[1020]: Removed session 194. May 25 03:45:44 oleg425-client sshd[38820]: Accepted publickey for root from 192.168.204.25 port 33580 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:45:44 oleg425-client systemd[1]: Started Session 195 of user root. May 25 03:45:44 oleg425-client systemd-logind[1020]: New session 195 of user root. May 25 03:45:44 oleg425-client sshd[38820]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:45:45 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 03:45:43 (1779695143) May 25 03:45:45 oleg425-client sshd[38833]: Received disconnect from 192.168.204.25 port 33580:11: disconnected by user May 25 03:45:45 oleg425-client sshd[38833]: Disconnected from user root 192.168.204.25 port 33580 May 25 03:45:45 oleg425-client sshd[38820]: pam_unix(sshd:session): session closed for user root May 25 03:45:45 oleg425-client systemd[1]: session-195.scope: Succeeded. May 25 03:45:45 oleg425-client systemd-logind[1020]: Session 195 logged out. Waiting for processes to exit. May 25 03:45:45 oleg425-client systemd-logind[1020]: Removed session 195. May 25 03:45:59 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab14000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:45:59 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:45:59 oleg425-client kernel: Lustre: Skipped 12 previous similar messages May 25 03:45:59 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008d528e to 0x799e3d1c008d591e May 25 03:45:59 oleg425-client kernel: Lustre: MGC192.168.204.125@tcp: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:45:59 oleg425-client kernel: Lustre: Skipped 15 previous similar messages May 25 03:45:59 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:46:07 oleg425-client sshd[39133]: Accepted publickey for root from 192.168.204.25 port 46356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:07 oleg425-client systemd-logind[1020]: New session 196 of user root. May 25 03:46:07 oleg425-client systemd[1]: Started Session 196 of user root. May 25 03:46:07 oleg425-client sshd[39133]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:08 oleg425-client sshd[39146]: Received disconnect from 192.168.204.25 port 46356:11: disconnected by user May 25 03:46:08 oleg425-client sshd[39146]: Disconnected from user root 192.168.204.25 port 46356 May 25 03:46:08 oleg425-client sshd[39133]: pam_unix(sshd:session): session closed for user root May 25 03:46:08 oleg425-client systemd[1]: session-196.scope: Succeeded. May 25 03:46:08 oleg425-client systemd-logind[1020]: Session 196 logged out. Waiting for processes to exit. May 25 03:46:08 oleg425-client systemd-logind[1020]: Removed session 196. May 25 03:46:09 oleg425-client sshd[39185]: Accepted publickey for root from 192.168.204.25 port 46368 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:09 oleg425-client systemd-logind[1020]: New session 197 of user root. May 25 03:46:09 oleg425-client systemd[1]: Started Session 197 of user root. May 25 03:46:09 oleg425-client sshd[39185]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:10 oleg425-client sshd[39198]: Received disconnect from 192.168.204.25 port 46368:11: disconnected by user May 25 03:46:10 oleg425-client sshd[39198]: Disconnected from user root 192.168.204.25 port 46368 May 25 03:46:10 oleg425-client sshd[39185]: pam_unix(sshd:session): session closed for user root May 25 03:46:10 oleg425-client systemd-logind[1020]: Session 197 logged out. Waiting for processes to exit. May 25 03:46:10 oleg425-client systemd[1]: session-197.scope: Succeeded. May 25 03:46:10 oleg425-client systemd-logind[1020]: Removed session 197. May 25 03:46:11 oleg425-client sshd[39237]: Accepted publickey for root from 192.168.204.25 port 46384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:11 oleg425-client systemd-logind[1020]: New session 198 of user root. May 25 03:46:11 oleg425-client systemd[1]: Started Session 198 of user root. May 25 03:46:11 oleg425-client sshd[39237]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:12 oleg425-client sshd[39251]: Received disconnect from 192.168.204.25 port 46384:11: disconnected by user May 25 03:46:12 oleg425-client sshd[39251]: Disconnected from user root 192.168.204.25 port 46384 May 25 03:46:12 oleg425-client sshd[39237]: pam_unix(sshd:session): session closed for user root May 25 03:46:12 oleg425-client systemd-logind[1020]: Session 198 logged out. Waiting for processes to exit. May 25 03:46:12 oleg425-client systemd[1]: session-198.scope: Succeeded. May 25 03:46:12 oleg425-client systemd-logind[1020]: Removed session 198. May 25 03:46:18 oleg425-client sshd[39426]: Accepted publickey for root from 192.168.204.25 port 56704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:19 oleg425-client systemd[1]: Started Session 199 of user root. May 25 03:46:19 oleg425-client systemd-logind[1020]: New session 199 of user root. May 25 03:46:19 oleg425-client sshd[39426]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:19 oleg425-client sshd[39440]: Received disconnect from 192.168.204.25 port 56704:11: disconnected by user May 25 03:46:19 oleg425-client sshd[39440]: Disconnected from user root 192.168.204.25 port 56704 May 25 03:46:19 oleg425-client sshd[39426]: pam_unix(sshd:session): session closed for user root May 25 03:46:19 oleg425-client systemd[1]: session-199.scope: Succeeded. May 25 03:46:19 oleg425-client systemd-logind[1020]: Session 199 logged out. Waiting for processes to exit. May 25 03:46:19 oleg425-client systemd-logind[1020]: Removed session 199. May 25 03:46:21 oleg425-client sshd[39564]: Accepted publickey for root from 192.168.204.25 port 56714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:21 oleg425-client systemd[1]: Started Session 200 of user root. May 25 03:46:21 oleg425-client systemd-logind[1020]: New session 200 of user root. May 25 03:46:21 oleg425-client sshd[39564]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:21 oleg425-client sshd[39577]: Received disconnect from 192.168.204.25 port 56714:11: disconnected by user May 25 03:46:21 oleg425-client sshd[39577]: Disconnected from user root 192.168.204.25 port 56714 May 25 03:46:21 oleg425-client sshd[39564]: pam_unix(sshd:session): session closed for user root May 25 03:46:21 oleg425-client systemd[1]: session-200.scope: Succeeded. May 25 03:46:21 oleg425-client systemd-logind[1020]: Session 200 logged out. Waiting for processes to exit. May 25 03:46:21 oleg425-client systemd-logind[1020]: Removed session 200. May 25 03:46:22 oleg425-client sshd[39708]: Accepted publickey for root from 192.168.204.25 port 56718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:22 oleg425-client systemd[1]: Started Session 201 of user root. May 25 03:46:22 oleg425-client systemd-logind[1020]: New session 201 of user root. May 25 03:46:22 oleg425-client sshd[39708]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:23 oleg425-client sshd[39721]: Received disconnect from 192.168.204.25 port 56718:11: disconnected by user May 25 03:46:23 oleg425-client sshd[39721]: Disconnected from user root 192.168.204.25 port 56718 May 25 03:46:23 oleg425-client sshd[39708]: pam_unix(sshd:session): session closed for user root May 25 03:46:23 oleg425-client systemd[1]: session-201.scope: Succeeded. May 25 03:46:23 oleg425-client systemd-logind[1020]: Session 201 logged out. Waiting for processes to exit. May 25 03:46:23 oleg425-client systemd-logind[1020]: Removed session 201. May 25 03:46:25 oleg425-client sshd[39862]: Accepted publickey for root from 192.168.204.25 port 51272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:25 oleg425-client systemd-logind[1020]: New session 202 of user root. May 25 03:46:25 oleg425-client systemd[1]: Started Session 202 of user root. May 25 03:46:25 oleg425-client sshd[39862]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:25 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 03:46:23 (1779695183) May 25 03:46:25 oleg425-client sshd[39876]: Received disconnect from 192.168.204.25 port 51272:11: disconnected by user May 25 03:46:25 oleg425-client sshd[39876]: Disconnected from user root 192.168.204.25 port 51272 May 25 03:46:25 oleg425-client sshd[39862]: pam_unix(sshd:session): session closed for user root May 25 03:46:25 oleg425-client systemd-logind[1020]: Session 202 logged out. Waiting for processes to exit. May 25 03:46:26 oleg425-client systemd[1]: session-202.scope: Succeeded. May 25 03:46:26 oleg425-client systemd-logind[1020]: Removed session 202. May 25 03:46:40 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:46:51 oleg425-client sshd[40176]: Accepted publickey for root from 192.168.204.25 port 36688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:51 oleg425-client systemd-logind[1020]: New session 203 of user root. May 25 03:46:51 oleg425-client systemd[1]: Started Session 203 of user root. May 25 03:46:51 oleg425-client sshd[40176]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:52 oleg425-client sshd[40189]: Received disconnect from 192.168.204.25 port 36688:11: disconnected by user May 25 03:46:52 oleg425-client sshd[40189]: Disconnected from user root 192.168.204.25 port 36688 May 25 03:46:52 oleg425-client sshd[40176]: pam_unix(sshd:session): session closed for user root May 25 03:46:52 oleg425-client systemd[1]: session-203.scope: Succeeded. May 25 03:46:52 oleg425-client systemd-logind[1020]: Session 203 logged out. Waiting for processes to exit. May 25 03:46:52 oleg425-client systemd-logind[1020]: Removed session 203. May 25 03:46:53 oleg425-client sshd[40228]: Accepted publickey for root from 192.168.204.25 port 36702 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:53 oleg425-client systemd-logind[1020]: New session 204 of user root. May 25 03:46:53 oleg425-client systemd[1]: Started Session 204 of user root. May 25 03:46:53 oleg425-client sshd[40228]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:54 oleg425-client sshd[40241]: Received disconnect from 192.168.204.25 port 36702:11: disconnected by user May 25 03:46:54 oleg425-client sshd[40241]: Disconnected from user root 192.168.204.25 port 36702 May 25 03:46:54 oleg425-client sshd[40228]: pam_unix(sshd:session): session closed for user root May 25 03:46:54 oleg425-client systemd-logind[1020]: Session 204 logged out. Waiting for processes to exit. May 25 03:46:54 oleg425-client systemd[1]: session-204.scope: Succeeded. May 25 03:46:54 oleg425-client systemd-logind[1020]: Removed session 204. May 25 03:46:55 oleg425-client sshd[40280]: Accepted publickey for root from 192.168.204.25 port 50524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:55 oleg425-client systemd-logind[1020]: New session 205 of user root. May 25 03:46:55 oleg425-client systemd[1]: Started Session 205 of user root. May 25 03:46:55 oleg425-client sshd[40280]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:55 oleg425-client sshd[40293]: Received disconnect from 192.168.204.25 port 50524:11: disconnected by user May 25 03:46:55 oleg425-client sshd[40293]: Disconnected from user root 192.168.204.25 port 50524 May 25 03:46:55 oleg425-client sshd[40280]: pam_unix(sshd:session): session closed for user root May 25 03:46:56 oleg425-client systemd-logind[1020]: Session 205 logged out. Waiting for processes to exit. May 25 03:46:56 oleg425-client systemd[1]: session-205.scope: Succeeded. May 25 03:46:56 oleg425-client systemd-logind[1020]: Removed session 205. May 25 03:46:56 oleg425-client sshd[40411]: Accepted publickey for root from 192.168.204.25 port 50532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:56 oleg425-client systemd-logind[1020]: New session 206 of user root. May 25 03:46:56 oleg425-client systemd[1]: Started Session 206 of user root. May 25 03:46:56 oleg425-client sshd[40411]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:57 oleg425-client sshd[40424]: Received disconnect from 192.168.204.25 port 50532:11: disconnected by user May 25 03:46:57 oleg425-client sshd[40424]: Disconnected from user root 192.168.204.25 port 50532 May 25 03:46:57 oleg425-client sshd[40411]: pam_unix(sshd:session): session closed for user root May 25 03:46:57 oleg425-client systemd[1]: session-206.scope: Succeeded. May 25 03:46:57 oleg425-client systemd-logind[1020]: Session 206 logged out. Waiting for processes to exit. May 25 03:46:57 oleg425-client systemd-logind[1020]: Removed session 206. May 25 03:46:58 oleg425-client sshd[40549]: Accepted publickey for root from 192.168.204.25 port 50538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:58 oleg425-client systemd[1]: Started Session 207 of user root. May 25 03:46:58 oleg425-client systemd-logind[1020]: New session 207 of user root. May 25 03:46:58 oleg425-client sshd[40549]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:58 oleg425-client sshd[40562]: Received disconnect from 192.168.204.25 port 50538:11: disconnected by user May 25 03:46:58 oleg425-client sshd[40562]: Disconnected from user root 192.168.204.25 port 50538 May 25 03:46:58 oleg425-client sshd[40549]: pam_unix(sshd:session): session closed for user root May 25 03:46:59 oleg425-client systemd[1]: session-207.scope: Succeeded. May 25 03:46:59 oleg425-client systemd-logind[1020]: Session 207 logged out. Waiting for processes to exit. May 25 03:46:59 oleg425-client systemd-logind[1020]: Removed session 207. May 25 03:47:00 oleg425-client sshd[40693]: Accepted publickey for root from 192.168.204.25 port 50540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:00 oleg425-client systemd-logind[1020]: New session 208 of user root. May 25 03:47:00 oleg425-client systemd[1]: Started Session 208 of user root. May 25 03:47:00 oleg425-client sshd[40693]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:00 oleg425-client sshd[40706]: Received disconnect from 192.168.204.25 port 50540:11: disconnected by user May 25 03:47:00 oleg425-client sshd[40706]: Disconnected from user root 192.168.204.25 port 50540 May 25 03:47:00 oleg425-client sshd[40693]: pam_unix(sshd:session): session closed for user root May 25 03:47:00 oleg425-client systemd[1]: session-208.scope: Succeeded. May 25 03:47:00 oleg425-client systemd-logind[1020]: Session 208 logged out. Waiting for processes to exit. May 25 03:47:00 oleg425-client systemd-logind[1020]: Removed session 208. May 25 03:47:01 oleg425-client sshd[40847]: Accepted publickey for root from 192.168.204.25 port 50550 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:01 oleg425-client systemd-logind[1020]: New session 209 of user root. May 25 03:47:01 oleg425-client systemd[1]: Started Session 209 of user root. May 25 03:47:01 oleg425-client sshd[40847]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:02 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 03:47:00 (1779695220) May 25 03:47:02 oleg425-client sshd[40860]: Received disconnect from 192.168.204.25 port 50550:11: disconnected by user May 25 03:47:02 oleg425-client sshd[40860]: Disconnected from user root 192.168.204.25 port 50550 May 25 03:47:02 oleg425-client sshd[40847]: pam_unix(sshd:session): session closed for user root May 25 03:47:02 oleg425-client systemd[1]: session-209.scope: Succeeded. May 25 03:47:02 oleg425-client systemd-logind[1020]: Session 209 logged out. Waiting for processes to exit. May 25 03:47:02 oleg425-client systemd-logind[1020]: Removed session 209. May 25 03:47:16 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -19 May 25 03:47:16 oleg425-client kernel: LustreError: Skipped 3 previous similar messages May 25 03:47:36 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:47:36 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008d591e to 0x799e3d1c008dac22 May 25 03:47:45 oleg425-client sshd[41170]: Accepted publickey for root from 192.168.204.25 port 57684 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:45 oleg425-client systemd-logind[1020]: New session 210 of user root. May 25 03:47:45 oleg425-client systemd[1]: Started Session 210 of user root. May 25 03:47:45 oleg425-client sshd[41170]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:55 oleg425-client sshd[41183]: Received disconnect from 192.168.204.25 port 57684:11: disconnected by user May 25 03:47:55 oleg425-client sshd[41183]: Disconnected from user root 192.168.204.25 port 57684 May 25 03:47:55 oleg425-client sshd[41170]: pam_unix(sshd:session): session closed for user root May 25 03:47:56 oleg425-client systemd[1]: session-210.scope: Succeeded. May 25 03:47:56 oleg425-client systemd-logind[1020]: Session 210 logged out. Waiting for processes to exit. May 25 03:47:56 oleg425-client systemd-logind[1020]: Removed session 210. May 25 03:48:00 oleg425-client sshd[41408]: Accepted publickey for root from 192.168.204.25 port 37026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:00 oleg425-client systemd-logind[1020]: New session 211 of user root. May 25 03:48:00 oleg425-client systemd[1]: Started Session 211 of user root. May 25 03:48:00 oleg425-client sshd[41408]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:01 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:48:01 oleg425-client sshd[41421]: Received disconnect from 192.168.204.25 port 37026:11: disconnected by user May 25 03:48:01 oleg425-client sshd[41421]: Disconnected from user root 192.168.204.25 port 37026 May 25 03:48:01 oleg425-client sshd[41408]: pam_unix(sshd:session): session closed for user root May 25 03:48:01 oleg425-client systemd-logind[1020]: Session 211 logged out. Waiting for processes to exit. May 25 03:48:01 oleg425-client systemd[1]: session-211.scope: Succeeded. May 25 03:48:01 oleg425-client systemd-logind[1020]: Removed session 211. May 25 03:48:02 oleg425-client sshd[41563]: Accepted publickey for root from 192.168.204.25 port 37030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:03 oleg425-client systemd-logind[1020]: New session 212 of user root. May 25 03:48:03 oleg425-client systemd[1]: Started Session 212 of user root. May 25 03:48:03 oleg425-client sshd[41563]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:03 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:48:03 oleg425-client sshd[41576]: Received disconnect from 192.168.204.25 port 37030:11: disconnected by user May 25 03:48:03 oleg425-client sshd[41576]: Disconnected from user root 192.168.204.25 port 37030 May 25 03:48:03 oleg425-client sshd[41563]: pam_unix(sshd:session): session closed for user root May 25 03:48:03 oleg425-client systemd[1]: session-212.scope: Succeeded. May 25 03:48:03 oleg425-client systemd-logind[1020]: Session 212 logged out. Waiting for processes to exit. May 25 03:48:03 oleg425-client systemd-logind[1020]: Removed session 212. May 25 03:48:04 oleg425-client sshd[41617]: Accepted publickey for root from 192.168.204.25 port 48618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:05 oleg425-client systemd-logind[1020]: New session 213 of user root. May 25 03:48:05 oleg425-client systemd[1]: Started Session 213 of user root. May 25 03:48:05 oleg425-client sshd[41617]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:05 oleg425-client sshd[41630]: Received disconnect from 192.168.204.25 port 48618:11: disconnected by user May 25 03:48:05 oleg425-client sshd[41630]: Disconnected from user root 192.168.204.25 port 48618 May 25 03:48:05 oleg425-client sshd[41617]: pam_unix(sshd:session): session closed for user root May 25 03:48:05 oleg425-client systemd[1]: session-213.scope: Succeeded. May 25 03:48:05 oleg425-client systemd-logind[1020]: Session 213 logged out. Waiting for processes to exit. May 25 03:48:05 oleg425-client systemd-logind[1020]: Removed session 213. May 25 03:49:28 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779695352/real 1779695352] req@ffffa09b0770ca80 x1866143418101632/t0(0) o400->MGC192.168.204.125@tcp@192.168.204.125@tcp:26/25 lens 224/224 e 0 to 1 dl 1779695368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 03:49:28 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 14 previous similar messages May 25 03:49:28 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:49:37 oleg425-client sshd[41937]: Accepted publickey for root from 192.168.204.25 port 44350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:37 oleg425-client systemd[1]: Started Session 214 of user root. May 25 03:49:37 oleg425-client systemd-logind[1020]: New session 214 of user root. May 25 03:49:37 oleg425-client sshd[41937]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:38 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008dac22 to 0x799e3d1c008f5d50 May 25 03:49:47 oleg425-client sshd[41951]: Received disconnect from 192.168.204.25 port 44350:11: disconnected by user May 25 03:49:47 oleg425-client sshd[41951]: Disconnected from user root 192.168.204.25 port 44350 May 25 03:49:47 oleg425-client sshd[41937]: pam_unix(sshd:session): session closed for user root May 25 03:49:47 oleg425-client systemd[1]: session-214.scope: Succeeded. May 25 03:49:47 oleg425-client systemd-logind[1020]: Session 214 logged out. Waiting for processes to exit. May 25 03:49:47 oleg425-client systemd-logind[1020]: Removed session 214. May 25 03:49:51 oleg425-client sshd[42177]: Accepted publickey for root from 192.168.204.25 port 38756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:51 oleg425-client systemd-logind[1020]: New session 215 of user root. May 25 03:49:51 oleg425-client systemd[1]: Started Session 215 of user root. May 25 03:49:51 oleg425-client sshd[42177]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:52 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:49:52 oleg425-client sshd[42191]: Received disconnect from 192.168.204.25 port 38756:11: disconnected by user May 25 03:49:52 oleg425-client sshd[42191]: Disconnected from user root 192.168.204.25 port 38756 May 25 03:49:52 oleg425-client sshd[42177]: pam_unix(sshd:session): session closed for user root May 25 03:49:52 oleg425-client systemd[1]: session-215.scope: Succeeded. May 25 03:49:52 oleg425-client systemd-logind[1020]: Session 215 logged out. Waiting for processes to exit. May 25 03:49:52 oleg425-client systemd-logind[1020]: Removed session 215. May 25 03:49:54 oleg425-client sshd[42332]: Accepted publickey for root from 192.168.204.25 port 38766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:54 oleg425-client systemd-logind[1020]: New session 216 of user root. May 25 03:49:54 oleg425-client systemd[1]: Started Session 216 of user root. May 25 03:49:54 oleg425-client sshd[42332]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:54 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:49:54 oleg425-client sshd[42345]: Received disconnect from 192.168.204.25 port 38766:11: disconnected by user May 25 03:49:54 oleg425-client sshd[42345]: Disconnected from user root 192.168.204.25 port 38766 May 25 03:49:54 oleg425-client sshd[42332]: pam_unix(sshd:session): session closed for user root May 25 03:49:54 oleg425-client systemd[1]: session-216.scope: Succeeded. May 25 03:49:54 oleg425-client systemd-logind[1020]: Session 216 logged out. Waiting for processes to exit. May 25 03:49:54 oleg425-client systemd-logind[1020]: Removed session 216. May 25 03:49:56 oleg425-client sshd[42386]: Accepted publickey for root from 192.168.204.25 port 50570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:56 oleg425-client systemd-logind[1020]: New session 217 of user root. May 25 03:49:56 oleg425-client systemd[1]: Started Session 217 of user root. May 25 03:49:56 oleg425-client sshd[42386]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:56 oleg425-client sshd[42399]: Received disconnect from 192.168.204.25 port 50570:11: disconnected by user May 25 03:49:56 oleg425-client sshd[42399]: Disconnected from user root 192.168.204.25 port 50570 May 25 03:49:56 oleg425-client sshd[42386]: pam_unix(sshd:session): session closed for user root May 25 03:49:57 oleg425-client systemd-logind[1020]: Session 217 logged out. Waiting for processes to exit. May 25 03:49:57 oleg425-client systemd[1]: session-217.scope: Succeeded. May 25 03:49:57 oleg425-client systemd-logind[1020]: Removed session 217. May 25 03:51:20 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:51:20 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c008f5d50 to 0x799e3d1c0091064a May 25 03:51:21 oleg425-client kernel: Lustre: 15900:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.125@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 03:51:40 oleg425-client sshd[42711]: Accepted publickey for root from 192.168.204.25 port 40400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:51:40 oleg425-client systemd[1]: Started Session 218 of user root. May 25 03:51:40 oleg425-client systemd-logind[1020]: New session 218 of user root. May 25 03:51:40 oleg425-client sshd[42711]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:51:41 oleg425-client sshd[42724]: Received disconnect from 192.168.204.25 port 40400:11: disconnected by user May 25 03:51:41 oleg425-client sshd[42724]: Disconnected from user root 192.168.204.25 port 40400 May 25 03:51:41 oleg425-client sshd[42711]: pam_unix(sshd:session): session closed for user root May 25 03:51:41 oleg425-client systemd-logind[1020]: Session 218 logged out. Waiting for processes to exit. May 25 03:51:41 oleg425-client systemd[1]: session-218.scope: Succeeded. May 25 03:51:41 oleg425-client systemd-logind[1020]: Removed session 218. May 25 03:51:46 oleg425-client sshd[42945]: Accepted publickey for root from 192.168.204.25 port 39040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:51:46 oleg425-client systemd-logind[1020]: New session 219 of user root. May 25 03:51:46 oleg425-client systemd[1]: Started Session 219 of user root. May 25 03:51:46 oleg425-client sshd[42945]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:51:46 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:51:46 oleg425-client sshd[42958]: Received disconnect from 192.168.204.25 port 39040:11: disconnected by user May 25 03:51:46 oleg425-client sshd[42958]: Disconnected from user root 192.168.204.25 port 39040 May 25 03:51:46 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:51:46 oleg425-client sshd[42945]: pam_unix(sshd:session): session closed for user root May 25 03:51:47 oleg425-client systemd-logind[1020]: Session 219 logged out. Waiting for processes to exit. May 25 03:51:47 oleg425-client systemd[1]: session-219.scope: Succeeded. May 25 03:51:47 oleg425-client systemd-logind[1020]: Removed session 219. May 25 03:51:49 oleg425-client sshd[43101]: Accepted publickey for root from 192.168.204.25 port 39046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:51:49 oleg425-client systemd-logind[1020]: New session 220 of user root. May 25 03:51:49 oleg425-client systemd[1]: Started Session 220 of user root. May 25 03:51:49 oleg425-client sshd[43101]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:51:50 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:51:50 oleg425-client sshd[43115]: Received disconnect from 192.168.204.25 port 39046:11: disconnected by user May 25 03:51:50 oleg425-client sshd[43115]: Disconnected from user root 192.168.204.25 port 39046 May 25 03:51:50 oleg425-client sshd[43101]: pam_unix(sshd:session): session closed for user root May 25 03:51:50 oleg425-client systemd[1]: session-220.scope: Succeeded. May 25 03:51:50 oleg425-client systemd-logind[1020]: Session 220 logged out. Waiting for processes to exit. May 25 03:51:50 oleg425-client systemd-logind[1020]: Removed session 220. May 25 03:51:52 oleg425-client sshd[43156]: Accepted publickey for root from 192.168.204.25 port 39048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:51:52 oleg425-client systemd-logind[1020]: New session 221 of user root. May 25 03:51:52 oleg425-client systemd[1]: Started Session 221 of user root. May 25 03:51:52 oleg425-client sshd[43156]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:51:52 oleg425-client sshd[43169]: Received disconnect from 192.168.204.25 port 39048:11: disconnected by user May 25 03:51:52 oleg425-client sshd[43169]: Disconnected from user root 192.168.204.25 port 39048 May 25 03:51:52 oleg425-client sshd[43156]: pam_unix(sshd:session): session closed for user root May 25 03:51:53 oleg425-client systemd-logind[1020]: Session 221 logged out. Waiting for processes to exit. May 25 03:51:53 oleg425-client systemd[1]: session-221.scope: Succeeded. May 25 03:51:53 oleg425-client systemd-logind[1020]: Removed session 221. May 25 03:52:14 oleg425-client sshd[43290]: Accepted publickey for root from 192.168.204.25 port 55304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:14 oleg425-client systemd-logind[1020]: New session 222 of user root. May 25 03:52:14 oleg425-client systemd[1]: Started Session 222 of user root. May 25 03:52:14 oleg425-client sshd[43290]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:14 oleg425-client sshd[43303]: Received disconnect from 192.168.204.25 port 55304:11: disconnected by user May 25 03:52:14 oleg425-client sshd[43303]: Disconnected from user root 192.168.204.25 port 55304 May 25 03:52:14 oleg425-client sshd[43290]: pam_unix(sshd:session): session closed for user root May 25 03:52:14 oleg425-client systemd[1]: session-222.scope: Succeeded. May 25 03:52:14 oleg425-client systemd-logind[1020]: Session 222 logged out. Waiting for processes to exit. May 25 03:52:14 oleg425-client systemd-logind[1020]: Removed session 222. May 25 03:52:16 oleg425-client sshd[43427]: Accepted publickey for root from 192.168.204.25 port 48250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:16 oleg425-client systemd[1]: Started Session 223 of user root. May 25 03:52:16 oleg425-client systemd-logind[1020]: New session 223 of user root. May 25 03:52:16 oleg425-client sshd[43427]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:16 oleg425-client sshd[43440]: Received disconnect from 192.168.204.25 port 48250:11: disconnected by user May 25 03:52:16 oleg425-client sshd[43440]: Disconnected from user root 192.168.204.25 port 48250 May 25 03:52:16 oleg425-client sshd[43427]: pam_unix(sshd:session): session closed for user root May 25 03:52:17 oleg425-client systemd[1]: session-223.scope: Succeeded. May 25 03:52:17 oleg425-client systemd-logind[1020]: Session 223 logged out. Waiting for processes to exit. May 25 03:52:17 oleg425-client systemd-logind[1020]: Removed session 223. May 25 03:52:17 oleg425-client sshd[43571]: Accepted publickey for root from 192.168.204.25 port 48258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:18 oleg425-client systemd-logind[1020]: New session 224 of user root. May 25 03:52:18 oleg425-client systemd[1]: Started Session 224 of user root. May 25 03:52:18 oleg425-client sshd[43571]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:18 oleg425-client sshd[43584]: Received disconnect from 192.168.204.25 port 48258:11: disconnected by user May 25 03:52:18 oleg425-client sshd[43584]: Disconnected from user root 192.168.204.25 port 48258 May 25 03:52:18 oleg425-client sshd[43571]: pam_unix(sshd:session): session closed for user root May 25 03:52:18 oleg425-client systemd-logind[1020]: Session 224 logged out. Waiting for processes to exit. May 25 03:52:18 oleg425-client systemd[1]: session-224.scope: Succeeded. May 25 03:52:18 oleg425-client systemd-logind[1020]: Removed session 224. May 25 03:52:19 oleg425-client sshd[43726]: Accepted publickey for root from 192.168.204.25 port 48264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:19 oleg425-client systemd[1]: Started Session 225 of user root. May 25 03:52:19 oleg425-client systemd-logind[1020]: New session 225 of user root. May 25 03:52:19 oleg425-client sshd[43726]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:20 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 03:52:18 (1779695538) May 25 03:52:20 oleg425-client sshd[43739]: Received disconnect from 192.168.204.25 port 48264:11: disconnected by user May 25 03:52:20 oleg425-client sshd[43739]: Disconnected from user root 192.168.204.25 port 48264 May 25 03:52:20 oleg425-client sshd[43726]: pam_unix(sshd:session): session closed for user root May 25 03:52:20 oleg425-client systemd-logind[1020]: Session 225 logged out. Waiting for processes to exit. May 25 03:52:20 oleg425-client systemd[1]: session-225.scope: Succeeded. May 25 03:52:20 oleg425-client systemd-logind[1020]: Removed session 225. May 25 03:52:24 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab14000: operation mds_reint to node 192.168.204.125@tcp failed: rc = -19 May 25 03:52:24 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 03:52:41 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:52:51 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c0091064a to 0x799e3d1c0091cd6f May 25 03:52:53 oleg425-client sshd[44137]: Accepted publickey for root from 192.168.204.25 port 54682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:53 oleg425-client systemd-logind[1020]: New session 226 of user root. May 25 03:52:53 oleg425-client systemd[1]: Started Session 226 of user root. May 25 03:52:53 oleg425-client sshd[44137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:53 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 1 sec May 25 03:52:53 oleg425-client sshd[44152]: Received disconnect from 192.168.204.25 port 54682:11: disconnected by user May 25 03:52:53 oleg425-client sshd[44152]: Disconnected from user root 192.168.204.25 port 54682 May 25 03:52:53 oleg425-client sshd[44137]: pam_unix(sshd:session): session closed for user root May 25 03:52:53 oleg425-client systemd-logind[1020]: Session 226 logged out. Waiting for processes to exit. May 25 03:52:53 oleg425-client systemd[1]: session-226.scope: Succeeded. May 25 03:52:53 oleg425-client systemd-logind[1020]: Removed session 226. May 25 03:53:24 oleg425-client sshd[44536]: Accepted publickey for root from 192.168.204.25 port 53358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:53:24 oleg425-client systemd-logind[1020]: New session 227 of user root. May 25 03:53:24 oleg425-client systemd[1]: Started Session 227 of user root. May 25 03:53:24 oleg425-client sshd[44536]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:53:24 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 5 sec May 25 03:53:24 oleg425-client sshd[44549]: Received disconnect from 192.168.204.25 port 53358:11: disconnected by user May 25 03:53:24 oleg425-client sshd[44549]: Disconnected from user root 192.168.204.25 port 53358 May 25 03:53:24 oleg425-client sshd[44536]: pam_unix(sshd:session): session closed for user root May 25 03:53:24 oleg425-client systemd-logind[1020]: Session 227 logged out. Waiting for processes to exit. May 25 03:53:24 oleg425-client systemd[1]: session-227.scope: Succeeded. May 25 03:53:24 oleg425-client systemd-logind[1020]: Removed session 227. May 25 03:53:53 oleg425-client kernel: Lustre: 15900:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.125@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 03:54:09 oleg425-client sshd[44939]: Accepted publickey for root from 192.168.204.25 port 50984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:09 oleg425-client systemd-logind[1020]: New session 228 of user root. May 25 03:54:09 oleg425-client systemd[1]: Started Session 228 of user root. May 25 03:54:09 oleg425-client sshd[44939]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:10 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 10 sec May 25 03:54:10 oleg425-client sshd[44952]: Received disconnect from 192.168.204.25 port 50984:11: disconnected by user May 25 03:54:10 oleg425-client sshd[44952]: Disconnected from user root 192.168.204.25 port 50984 May 25 03:54:10 oleg425-client sshd[44939]: pam_unix(sshd:session): session closed for user root May 25 03:54:10 oleg425-client systemd[1]: session-228.scope: Succeeded. May 25 03:54:10 oleg425-client systemd-logind[1020]: Session 228 logged out. Waiting for processes to exit. May 25 03:54:10 oleg425-client systemd-logind[1020]: Removed session 228. May 25 03:54:51 oleg425-client sshd[45342]: Accepted publickey for root from 192.168.204.25 port 45856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:51 oleg425-client systemd-logind[1020]: New session 229 of user root. May 25 03:54:51 oleg425-client systemd[1]: Started Session 229 of user root. May 25 03:54:51 oleg425-client sshd[45342]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:52 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 20 sec May 25 03:54:52 oleg425-client sshd[45355]: Received disconnect from 192.168.204.25 port 45856:11: disconnected by user May 25 03:54:52 oleg425-client sshd[45355]: Disconnected from user root 192.168.204.25 port 45856 May 25 03:54:52 oleg425-client sshd[45342]: pam_unix(sshd:session): session closed for user root May 25 03:54:52 oleg425-client systemd[1]: session-229.scope: Succeeded. May 25 03:54:52 oleg425-client systemd-logind[1020]: Session 229 logged out. Waiting for processes to exit. May 25 03:54:52 oleg425-client systemd-logind[1020]: Removed session 229. May 25 03:55:34 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 03:55:34 oleg425-client kernel: LustreError: Skipped 3 previous similar messages May 25 03:55:34 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00923692 to 0x799e3d1c0092f583 May 25 03:55:34 oleg425-client kernel: Lustre: Skipped 3 previous similar messages May 25 03:55:36 oleg425-client kernel: Lustre: 15900:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.125@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 03:55:54 oleg425-client sshd[45748]: Accepted publickey for root from 192.168.204.25 port 43672 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:54 oleg425-client systemd-logind[1020]: New session 230 of user root. May 25 03:55:54 oleg425-client systemd[1]: Started Session 230 of user root. May 25 03:55:54 oleg425-client sshd[45748]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:54 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 25 sec May 25 03:55:54 oleg425-client sshd[45761]: Received disconnect from 192.168.204.25 port 43672:11: disconnected by user May 25 03:55:54 oleg425-client sshd[45761]: Disconnected from user root 192.168.204.25 port 43672 May 25 03:55:54 oleg425-client sshd[45748]: pam_unix(sshd:session): session closed for user root May 25 03:55:54 oleg425-client systemd[1]: session-230.scope: Succeeded. May 25 03:55:54 oleg425-client systemd-logind[1020]: Session 230 logged out. Waiting for processes to exit. May 25 03:55:54 oleg425-client systemd-logind[1020]: Removed session 230. May 25 03:56:22 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab14000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:56:22 oleg425-client kernel: Lustre: Skipped 8 previous similar messages May 25 03:56:50 oleg425-client kernel: Lustre: MGC192.168.204.125@tcp: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 03:56:50 oleg425-client kernel: Lustre: Skipped 17 previous similar messages May 25 03:57:00 oleg425-client sshd[46150]: Accepted publickey for root from 192.168.204.25 port 45042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:57:00 oleg425-client systemd-logind[1020]: New session 231 of user root. May 25 03:57:00 oleg425-client systemd[1]: Started Session 231 of user root. May 25 03:57:00 oleg425-client sshd[46150]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:57:00 oleg425-client kernel: Lustre: DEBUG MARKER: test_51: failover in 30 sec May 25 03:57:00 oleg425-client sshd[46165]: Received disconnect from 192.168.204.25 port 45042:11: disconnected by user May 25 03:57:00 oleg425-client sshd[46165]: Disconnected from user root 192.168.204.25 port 45042 May 25 03:57:00 oleg425-client sshd[46150]: pam_unix(sshd:session): session closed for user root May 25 03:57:00 oleg425-client systemd-logind[1020]: Session 231 logged out. Waiting for processes to exit. May 25 03:57:00 oleg425-client systemd[1]: session-231.scope: Succeeded. May 25 03:57:00 oleg425-client systemd-logind[1020]: Removed session 231. May 25 03:58:20 oleg425-client sshd[46557]: Accepted publickey for root from 192.168.204.25 port 47868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:58:20 oleg425-client systemd-logind[1020]: New session 232 of user root. May 25 03:58:20 oleg425-client systemd[1]: Started Session 232 of user root. May 25 03:58:20 oleg425-client sshd[46557]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:58:20 oleg425-client sshd[46570]: Received disconnect from 192.168.204.25 port 47868:11: disconnected by user May 25 03:58:20 oleg425-client sshd[46570]: Disconnected from user root 192.168.204.25 port 47868 May 25 03:58:20 oleg425-client sshd[46557]: pam_unix(sshd:session): session closed for user root May 25 03:58:20 oleg425-client systemd-logind[1020]: Session 232 logged out. Waiting for processes to exit. May 25 03:58:20 oleg425-client systemd[1]: session-232.scope: Succeeded. May 25 03:58:20 oleg425-client systemd-logind[1020]: Removed session 232. May 25 03:58:22 oleg425-client sshd[46694]: Accepted publickey for root from 192.168.204.25 port 47874 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:58:22 oleg425-client systemd-logind[1020]: New session 233 of user root. May 25 03:58:22 oleg425-client systemd[1]: Started Session 233 of user root. May 25 03:58:22 oleg425-client sshd[46694]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:58:22 oleg425-client sshd[46707]: Received disconnect from 192.168.204.25 port 47874:11: disconnected by user May 25 03:58:22 oleg425-client sshd[46707]: Disconnected from user root 192.168.204.25 port 47874 May 25 03:58:22 oleg425-client sshd[46694]: pam_unix(sshd:session): session closed for user root May 25 03:58:22 oleg425-client systemd[1]: session-233.scope: Succeeded. May 25 03:58:22 oleg425-client systemd-logind[1020]: Session 233 logged out. Waiting for processes to exit. May 25 03:58:22 oleg425-client systemd-logind[1020]: Removed session 233. May 25 03:58:24 oleg425-client sshd[46839]: Accepted publickey for root from 192.168.204.25 port 47888 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:58:24 oleg425-client systemd[1]: Started Session 234 of user root. May 25 03:58:24 oleg425-client systemd-logind[1020]: New session 234 of user root. May 25 03:58:24 oleg425-client sshd[46839]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:58:24 oleg425-client sshd[46852]: Received disconnect from 192.168.204.25 port 47888:11: disconnected by user May 25 03:58:24 oleg425-client sshd[46852]: Disconnected from user root 192.168.204.25 port 47888 May 25 03:58:24 oleg425-client sshd[46839]: pam_unix(sshd:session): session closed for user root May 25 03:58:24 oleg425-client systemd[1]: session-234.scope: Succeeded. May 25 03:58:24 oleg425-client systemd-logind[1020]: Session 234 logged out. Waiting for processes to exit. May 25 03:58:24 oleg425-client systemd-logind[1020]: Removed session 234. May 25 03:58:25 oleg425-client sshd[46993]: Accepted publickey for root from 192.168.204.25 port 57088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:58:26 oleg425-client systemd-logind[1020]: New session 235 of user root. May 25 03:58:26 oleg425-client systemd[1]: Started Session 235 of user root. May 25 03:58:26 oleg425-client sshd[46993]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:58:26 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 03:58:24 (1779695904) May 25 03:58:26 oleg425-client sshd[47006]: Received disconnect from 192.168.204.25 port 57088:11: disconnected by user May 25 03:58:26 oleg425-client sshd[47006]: Disconnected from user root 192.168.204.25 port 57088 May 25 03:58:26 oleg425-client sshd[46993]: pam_unix(sshd:session): session closed for user root May 25 03:58:26 oleg425-client systemd-logind[1020]: Session 235 logged out. Waiting for processes to exit. May 25 03:58:26 oleg425-client systemd[1]: session-235.scope: Succeeded. May 25 03:58:26 oleg425-client systemd-logind[1020]: Removed session 235. May 25 03:59:14 oleg425-client sshd[47360]: Accepted publickey for root from 192.168.204.25 port 34974 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:14 oleg425-client systemd-logind[1020]: New session 236 of user root. May 25 03:59:14 oleg425-client systemd[1]: Started Session 236 of user root. May 25 03:59:14 oleg425-client sshd[47360]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:14 oleg425-client sshd[47373]: Received disconnect from 192.168.204.25 port 34974:11: disconnected by user May 25 03:59:14 oleg425-client sshd[47373]: Disconnected from user root 192.168.204.25 port 34974 May 25 03:59:14 oleg425-client sshd[47360]: pam_unix(sshd:session): session closed for user root May 25 03:59:14 oleg425-client systemd[1]: session-236.scope: Succeeded. May 25 03:59:14 oleg425-client systemd-logind[1020]: Session 236 logged out. Waiting for processes to exit. May 25 03:59:14 oleg425-client systemd-logind[1020]: Removed session 236. May 25 03:59:18 oleg425-client sshd[47595]: Accepted publickey for root from 192.168.204.25 port 50738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:18 oleg425-client systemd-logind[1020]: New session 237 of user root. May 25 03:59:18 oleg425-client systemd[1]: Started Session 237 of user root. May 25 03:59:18 oleg425-client sshd[47595]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:19 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 03:59:19 oleg425-client sshd[47608]: Received disconnect from 192.168.204.25 port 50738:11: disconnected by user May 25 03:59:19 oleg425-client sshd[47608]: Disconnected from user root 192.168.204.25 port 50738 May 25 03:59:19 oleg425-client sshd[47595]: pam_unix(sshd:session): session closed for user root May 25 03:59:19 oleg425-client systemd-logind[1020]: Session 237 logged out. Waiting for processes to exit. May 25 03:59:19 oleg425-client systemd[1]: session-237.scope: Succeeded. May 25 03:59:19 oleg425-client systemd-logind[1020]: Removed session 237. May 25 03:59:21 oleg425-client sshd[47750]: Accepted publickey for root from 192.168.204.25 port 50754 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:21 oleg425-client systemd-logind[1020]: New session 238 of user root. May 25 03:59:21 oleg425-client systemd[1]: Started Session 238 of user root. May 25 03:59:21 oleg425-client sshd[47750]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:21 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 03:59:21 oleg425-client sshd[47763]: Received disconnect from 192.168.204.25 port 50754:11: disconnected by user May 25 03:59:21 oleg425-client sshd[47763]: Disconnected from user root 192.168.204.25 port 50754 May 25 03:59:21 oleg425-client sshd[47750]: pam_unix(sshd:session): session closed for user root May 25 03:59:22 oleg425-client systemd[1]: session-238.scope: Succeeded. May 25 03:59:22 oleg425-client systemd-logind[1020]: Session 238 logged out. Waiting for processes to exit. May 25 03:59:22 oleg425-client systemd-logind[1020]: Removed session 238. May 25 03:59:23 oleg425-client sshd[47804]: Accepted publickey for root from 192.168.204.25 port 50762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:23 oleg425-client systemd-logind[1020]: New session 239 of user root. May 25 03:59:23 oleg425-client systemd[1]: Started Session 239 of user root. May 25 03:59:23 oleg425-client sshd[47804]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:24 oleg425-client sshd[47817]: Received disconnect from 192.168.204.25 port 50762:11: disconnected by user May 25 03:59:24 oleg425-client sshd[47817]: Disconnected from user root 192.168.204.25 port 50762 May 25 03:59:24 oleg425-client sshd[47804]: pam_unix(sshd:session): session closed for user root May 25 03:59:24 oleg425-client systemd[1]: session-239.scope: Succeeded. May 25 03:59:24 oleg425-client systemd-logind[1020]: Session 239 logged out. Waiting for processes to exit. May 25 03:59:24 oleg425-client systemd-logind[1020]: Removed session 239. May 25 04:00:36 oleg425-client systemd[1]: Starting dnf makecache... May 25 04:00:45 oleg425-client dnf[47861]: Failed determining last makecache time. May 25 04:00:46 oleg425-client dnf[47861]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' May 25 04:00:46 oleg425-client dnf[47861]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' May 25 04:00:46 oleg425-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE May 25 04:00:46 oleg425-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. May 25 04:00:46 oleg425-client systemd[1]: Failed to start dnf makecache. May 25 04:01:01 oleg425-client CROND[47869]: (root) CMD (run-parts /etc/cron.hourly) May 25 04:01:01 oleg425-client run-parts[47869]: (/etc/cron.hourly) starting 0anacron May 25 04:01:01 oleg425-client anacron[47878]: Anacron started on 2026-05-25 May 25 04:01:01 oleg425-client anacron[47878]: Will run job `cron.daily' in 14 min. May 25 04:01:01 oleg425-client anacron[47878]: Will run job `cron.weekly' in 34 min. May 25 04:01:01 oleg425-client anacron[47878]: Will run job `cron.monthly' in 54 min. May 25 04:01:01 oleg425-client anacron[47878]: Jobs will be executed sequentially May 25 04:01:01 oleg425-client run-parts[47869]: (/etc/cron.hourly) finished 0anacron May 25 04:04:11 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab14000: operation ost_write to node 192.168.204.125@tcp failed: rc = -19 May 25 04:04:11 oleg425-client kernel: LustreError: Skipped 11 previous similar messages May 25 04:04:46 oleg425-client sshd[48199]: Accepted publickey for root from 192.168.204.25 port 33248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:04:47 oleg425-client systemd-logind[1020]: New session 240 of user root. May 25 04:04:47 oleg425-client systemd[1]: Started Session 240 of user root. May 25 04:04:47 oleg425-client sshd[48199]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:04:47 oleg425-client sshd[48212]: Received disconnect from 192.168.204.25 port 33248:11: disconnected by user May 25 04:04:47 oleg425-client sshd[48212]: Disconnected from user root 192.168.204.25 port 33248 May 25 04:04:47 oleg425-client sshd[48199]: pam_unix(sshd:session): session closed for user root May 25 04:04:47 oleg425-client systemd-logind[1020]: Session 240 logged out. Waiting for processes to exit. May 25 04:04:47 oleg425-client systemd[1]: session-240.scope: Succeeded. May 25 04:04:47 oleg425-client systemd-logind[1020]: Removed session 240. May 25 04:04:52 oleg425-client sshd[48435]: Accepted publickey for root from 192.168.204.25 port 33264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:04:52 oleg425-client systemd-logind[1020]: New session 241 of user root. May 25 04:04:52 oleg425-client systemd[1]: Started Session 241 of user root. May 25 04:04:52 oleg425-client sshd[48435]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:04:52 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:04:52 oleg425-client sshd[48448]: Received disconnect from 192.168.204.25 port 33264:11: disconnected by user May 25 04:04:52 oleg425-client sshd[48448]: Disconnected from user root 192.168.204.25 port 33264 May 25 04:04:52 oleg425-client sshd[48435]: pam_unix(sshd:session): session closed for user root May 25 04:04:53 oleg425-client systemd-logind[1020]: Session 241 logged out. Waiting for processes to exit. May 25 04:04:53 oleg425-client systemd[1]: session-241.scope: Succeeded. May 25 04:04:53 oleg425-client systemd-logind[1020]: Removed session 241. May 25 04:04:54 oleg425-client sshd[48590]: Accepted publickey for root from 192.168.204.25 port 45996 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:04:55 oleg425-client systemd-logind[1020]: New session 242 of user root. May 25 04:04:55 oleg425-client systemd[1]: Started Session 242 of user root. May 25 04:04:55 oleg425-client sshd[48590]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:04:55 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:04:55 oleg425-client sshd[48603]: Received disconnect from 192.168.204.25 port 45996:11: disconnected by user May 25 04:04:55 oleg425-client sshd[48603]: Disconnected from user root 192.168.204.25 port 45996 May 25 04:04:55 oleg425-client sshd[48590]: pam_unix(sshd:session): session closed for user root May 25 04:04:55 oleg425-client systemd[1]: session-242.scope: Succeeded. May 25 04:04:55 oleg425-client systemd-logind[1020]: Session 242 logged out. Waiting for processes to exit. May 25 04:04:55 oleg425-client systemd-logind[1020]: Removed session 242. May 25 04:04:57 oleg425-client sshd[48644]: Accepted publickey for root from 192.168.204.25 port 46012 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:04:57 oleg425-client systemd[1]: Started Session 243 of user root. May 25 04:04:57 oleg425-client systemd-logind[1020]: New session 243 of user root. May 25 04:04:57 oleg425-client sshd[48644]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:04:58 oleg425-client sshd[48657]: Received disconnect from 192.168.204.25 port 46012:11: disconnected by user May 25 04:04:58 oleg425-client sshd[48657]: Disconnected from user root 192.168.204.25 port 46012 May 25 04:04:58 oleg425-client sshd[48644]: pam_unix(sshd:session): session closed for user root May 25 04:04:58 oleg425-client systemd[1]: session-243.scope: Succeeded. May 25 04:04:58 oleg425-client systemd-logind[1020]: Session 243 logged out. Waiting for processes to exit. May 25 04:04:58 oleg425-client systemd-logind[1020]: Removed session 243. May 25 04:09:42 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab14000: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:09:42 oleg425-client kernel: Lustre: Skipped 3 previous similar messages May 25 04:10:07 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab14000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 04:10:07 oleg425-client kernel: Lustre: Skipped 5 previous similar messages May 25 04:10:16 oleg425-client sshd[49022]: Accepted publickey for root from 192.168.204.25 port 46886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:10:16 oleg425-client systemd-logind[1020]: New session 244 of user root. May 25 04:10:16 oleg425-client systemd[1]: Started Session 244 of user root. May 25 04:10:16 oleg425-client sshd[49022]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:10:17 oleg425-client sshd[49037]: Received disconnect from 192.168.204.25 port 46886:11: disconnected by user May 25 04:10:17 oleg425-client sshd[49037]: Disconnected from user root 192.168.204.25 port 46886 May 25 04:10:17 oleg425-client sshd[49022]: pam_unix(sshd:session): session closed for user root May 25 04:10:17 oleg425-client systemd[1]: session-244.scope: Succeeded. May 25 04:10:17 oleg425-client systemd-logind[1020]: Session 244 logged out. Waiting for processes to exit. May 25 04:10:17 oleg425-client systemd-logind[1020]: Removed session 244. May 25 04:10:21 oleg425-client sshd[49260]: Accepted publickey for root from 192.168.204.25 port 46898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:10:21 oleg425-client systemd-logind[1020]: New session 245 of user root. May 25 04:10:21 oleg425-client systemd[1]: Started Session 245 of user root. May 25 04:10:21 oleg425-client sshd[49260]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:10:22 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:10:22 oleg425-client sshd[49273]: Received disconnect from 192.168.204.25 port 46898:11: disconnected by user May 25 04:10:22 oleg425-client sshd[49273]: Disconnected from user root 192.168.204.25 port 46898 May 25 04:10:22 oleg425-client sshd[49260]: pam_unix(sshd:session): session closed for user root May 25 04:10:22 oleg425-client systemd[1]: session-245.scope: Succeeded. May 25 04:10:22 oleg425-client systemd-logind[1020]: Session 245 logged out. Waiting for processes to exit. May 25 04:10:22 oleg425-client systemd-logind[1020]: Removed session 245. May 25 04:10:23 oleg425-client sshd[49414]: Accepted publickey for root from 192.168.204.25 port 46910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:10:23 oleg425-client systemd-logind[1020]: New session 246 of user root. May 25 04:10:23 oleg425-client systemd[1]: Started Session 246 of user root. May 25 04:10:23 oleg425-client sshd[49414]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:10:24 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:10:24 oleg425-client sshd[49428]: Received disconnect from 192.168.204.25 port 46910:11: disconnected by user May 25 04:10:24 oleg425-client sshd[49428]: Disconnected from user root 192.168.204.25 port 46910 May 25 04:10:24 oleg425-client sshd[49414]: pam_unix(sshd:session): session closed for user root May 25 04:10:24 oleg425-client systemd-logind[1020]: Session 246 logged out. Waiting for processes to exit. May 25 04:10:24 oleg425-client systemd[1]: session-246.scope: Succeeded. May 25 04:10:24 oleg425-client systemd-logind[1020]: Removed session 246. May 25 04:10:26 oleg425-client sshd[49469]: Accepted publickey for root from 192.168.204.25 port 43506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:10:26 oleg425-client systemd-logind[1020]: New session 247 of user root. May 25 04:10:26 oleg425-client systemd[1]: Started Session 247 of user root. May 25 04:10:26 oleg425-client sshd[49469]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:10:26 oleg425-client sshd[49482]: Received disconnect from 192.168.204.25 port 43506:11: disconnected by user May 25 04:10:26 oleg425-client sshd[49482]: Disconnected from user root 192.168.204.25 port 43506 May 25 04:10:26 oleg425-client sshd[49469]: pam_unix(sshd:session): session closed for user root May 25 04:10:27 oleg425-client systemd[1]: session-247.scope: Succeeded. May 25 04:10:27 oleg425-client systemd-logind[1020]: Session 247 logged out. Waiting for processes to exit. May 25 04:10:27 oleg425-client systemd-logind[1020]: Removed session 247. May 25 04:14:32 oleg425-client sshd[49644]: Accepted publickey for root from 192.168.204.25 port 56462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:14:32 oleg425-client systemd-logind[1020]: New session 248 of user root. May 25 04:14:32 oleg425-client systemd[1]: Started Session 248 of user root. May 25 04:14:32 oleg425-client sshd[49644]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:14:33 oleg425-client sshd[49657]: Received disconnect from 192.168.204.25 port 56462:11: disconnected by user May 25 04:14:33 oleg425-client sshd[49657]: Disconnected from user root 192.168.204.25 port 56462 May 25 04:14:33 oleg425-client sshd[49644]: pam_unix(sshd:session): session closed for user root May 25 04:14:33 oleg425-client systemd-logind[1020]: Session 248 logged out. Waiting for processes to exit. May 25 04:14:33 oleg425-client systemd[1]: session-248.scope: Succeeded. May 25 04:14:33 oleg425-client systemd-logind[1020]: Removed session 248. May 25 04:14:34 oleg425-client sshd[49782]: Accepted publickey for root from 192.168.204.25 port 47710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:14:34 oleg425-client systemd[1]: Started Session 249 of user root. May 25 04:14:34 oleg425-client systemd-logind[1020]: New session 249 of user root. May 25 04:14:34 oleg425-client sshd[49782]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:14:35 oleg425-client sshd[49795]: Received disconnect from 192.168.204.25 port 47710:11: disconnected by user May 25 04:14:35 oleg425-client sshd[49795]: Disconnected from user root 192.168.204.25 port 47710 May 25 04:14:35 oleg425-client sshd[49782]: pam_unix(sshd:session): session closed for user root May 25 04:14:35 oleg425-client systemd[1]: session-249.scope: Succeeded. May 25 04:14:35 oleg425-client systemd-logind[1020]: Session 249 logged out. Waiting for processes to exit. May 25 04:14:35 oleg425-client systemd-logind[1020]: Removed session 249. May 25 04:14:36 oleg425-client sshd[49926]: Accepted publickey for root from 192.168.204.25 port 47722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:14:36 oleg425-client systemd-logind[1020]: New session 250 of user root. May 25 04:14:36 oleg425-client systemd[1]: Started Session 250 of user root. May 25 04:14:36 oleg425-client sshd[49926]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:14:36 oleg425-client sshd[49939]: Received disconnect from 192.168.204.25 port 47722:11: disconnected by user May 25 04:14:36 oleg425-client sshd[49939]: Disconnected from user root 192.168.204.25 port 47722 May 25 04:14:36 oleg425-client sshd[49926]: pam_unix(sshd:session): session closed for user root May 25 04:14:37 oleg425-client systemd[1]: session-250.scope: Succeeded. May 25 04:14:37 oleg425-client systemd-logind[1020]: Session 250 logged out. Waiting for processes to exit. May 25 04:14:37 oleg425-client systemd-logind[1020]: Removed session 250. May 25 04:14:38 oleg425-client sshd[50080]: Accepted publickey for root from 192.168.204.25 port 47732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:14:38 oleg425-client systemd[1]: Started Session 251 of user root. May 25 04:14:38 oleg425-client systemd-logind[1020]: New session 251 of user root. May 25 04:14:38 oleg425-client sshd[50080]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:14:38 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 04:14:37 (1779696877) May 25 04:14:38 oleg425-client sshd[50093]: Received disconnect from 192.168.204.25 port 47732:11: disconnected by user May 25 04:14:38 oleg425-client sshd[50093]: Disconnected from user root 192.168.204.25 port 47732 May 25 04:14:38 oleg425-client sshd[50080]: pam_unix(sshd:session): session closed for user root May 25 04:14:38 oleg425-client systemd[1]: session-251.scope: Succeeded. May 25 04:14:38 oleg425-client systemd-logind[1020]: Session 251 logged out. Waiting for processes to exit. May 25 04:14:38 oleg425-client systemd-logind[1020]: Removed session 251. May 25 04:14:56 oleg425-client kernel: Lustre: 50194:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779696880/real 1779696880] req@ffffa09b06a54000 x1866143441104640/t0(0) o101->lustre-MDT0000-mdc-ffffa09b0ab14000@192.168.204.125@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779696896 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'openfile.0' uid:0 gid:0 projid:0 May 25 04:14:56 oleg425-client kernel: Lustre: 50194:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 4 previous similar messages May 25 04:14:59 oleg425-client sshd[50318]: Accepted publickey for root from 192.168.204.25 port 40208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:14:59 oleg425-client systemd[1]: Started Session 252 of user root. May 25 04:14:59 oleg425-client systemd-logind[1020]: New session 252 of user root. May 25 04:14:59 oleg425-client sshd[50318]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:00 oleg425-client sshd[50331]: Received disconnect from 192.168.204.25 port 40208:11: disconnected by user May 25 04:15:00 oleg425-client sshd[50331]: Disconnected from user root 192.168.204.25 port 40208 May 25 04:15:00 oleg425-client sshd[50318]: pam_unix(sshd:session): session closed for user root May 25 04:15:00 oleg425-client systemd[1]: session-252.scope: Succeeded. May 25 04:15:00 oleg425-client systemd-logind[1020]: Session 252 logged out. Waiting for processes to exit. May 25 04:15:00 oleg425-client systemd-logind[1020]: Removed session 252. May 25 04:15:01 oleg425-client sshd[50456]: Accepted publickey for root from 192.168.204.25 port 40210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:01 oleg425-client systemd-logind[1020]: New session 253 of user root. May 25 04:15:01 oleg425-client systemd[1]: Started Session 253 of user root. May 25 04:15:01 oleg425-client sshd[50456]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:01 oleg425-client anacron[47878]: Job `cron.daily' started May 25 04:15:01 oleg425-client sshd[50469]: Received disconnect from 192.168.204.25 port 40210:11: disconnected by user May 25 04:15:01 oleg425-client sshd[50469]: Disconnected from user root 192.168.204.25 port 40210 May 25 04:15:01 oleg425-client sshd[50456]: pam_unix(sshd:session): session closed for user root May 25 04:15:01 oleg425-client run-parts[50494]: (/etc/cron.daily) starting logrotate May 25 04:15:02 oleg425-client run-parts[50494]: (/etc/cron.daily) finished logrotate May 25 04:15:02 oleg425-client anacron[47878]: Job `cron.daily' terminated May 25 04:15:02 oleg425-client systemd-logind[1020]: Session 253 logged out. Waiting for processes to exit. May 25 04:15:02 oleg425-client systemd[1]: session-253.scope: Succeeded. May 25 04:15:02 oleg425-client systemd-logind[1020]: Removed session 253. May 25 04:15:03 oleg425-client sshd[50609]: Accepted publickey for root from 192.168.204.25 port 40224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:03 oleg425-client systemd[1]: Started Session 254 of user root. May 25 04:15:03 oleg425-client systemd-logind[1020]: New session 254 of user root. May 25 04:15:03 oleg425-client sshd[50609]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:03 oleg425-client sshd[50622]: Received disconnect from 192.168.204.25 port 40224:11: disconnected by user May 25 04:15:03 oleg425-client sshd[50622]: Disconnected from user root 192.168.204.25 port 40224 May 25 04:15:03 oleg425-client sshd[50609]: pam_unix(sshd:session): session closed for user root May 25 04:15:04 oleg425-client systemd[1]: session-254.scope: Succeeded. May 25 04:15:04 oleg425-client systemd-logind[1020]: Session 254 logged out. Waiting for processes to exit. May 25 04:15:04 oleg425-client systemd-logind[1020]: Removed session 254. May 25 04:15:05 oleg425-client sshd[50763]: Accepted publickey for root from 192.168.204.25 port 33512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:05 oleg425-client systemd-logind[1020]: New session 255 of user root. May 25 04:15:05 oleg425-client systemd[1]: Started Session 255 of user root. May 25 04:15:05 oleg425-client sshd[50763]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:05 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 04:15:04 (1779696904) May 25 04:15:05 oleg425-client sshd[50776]: Received disconnect from 192.168.204.25 port 33512:11: disconnected by user May 25 04:15:05 oleg425-client sshd[50776]: Disconnected from user root 192.168.204.25 port 33512 May 25 04:15:05 oleg425-client sshd[50763]: pam_unix(sshd:session): session closed for user root May 25 04:15:06 oleg425-client systemd[1]: session-255.scope: Succeeded. May 25 04:15:06 oleg425-client systemd-logind[1020]: Session 255 logged out. Waiting for processes to exit. May 25 04:15:06 oleg425-client systemd-logind[1020]: Removed session 255. May 25 04:15:26 oleg425-client sshd[51003]: Accepted publickey for root from 192.168.204.25 port 34870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:26 oleg425-client systemd-logind[1020]: New session 256 of user root. May 25 04:15:26 oleg425-client systemd[1]: Started Session 256 of user root. May 25 04:15:26 oleg425-client sshd[51003]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:26 oleg425-client sshd[51016]: Received disconnect from 192.168.204.25 port 34870:11: disconnected by user May 25 04:15:26 oleg425-client sshd[51016]: Disconnected from user root 192.168.204.25 port 34870 May 25 04:15:26 oleg425-client sshd[51003]: pam_unix(sshd:session): session closed for user root May 25 04:15:27 oleg425-client systemd[1]: session-256.scope: Succeeded. May 25 04:15:27 oleg425-client systemd-logind[1020]: Session 256 logged out. Waiting for processes to exit. May 25 04:15:27 oleg425-client systemd-logind[1020]: Removed session 256. May 25 04:15:28 oleg425-client sshd[51142]: Accepted publickey for root from 192.168.204.25 port 34880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:28 oleg425-client systemd[1]: Started Session 257 of user root. May 25 04:15:28 oleg425-client systemd-logind[1020]: New session 257 of user root. May 25 04:15:28 oleg425-client sshd[51142]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:28 oleg425-client sshd[51155]: Received disconnect from 192.168.204.25 port 34880:11: disconnected by user May 25 04:15:28 oleg425-client sshd[51155]: Disconnected from user root 192.168.204.25 port 34880 May 25 04:15:28 oleg425-client sshd[51142]: pam_unix(sshd:session): session closed for user root May 25 04:15:28 oleg425-client systemd[1]: session-257.scope: Succeeded. May 25 04:15:28 oleg425-client systemd-logind[1020]: Session 257 logged out. Waiting for processes to exit. May 25 04:15:28 oleg425-client systemd-logind[1020]: Removed session 257. May 25 04:15:30 oleg425-client sshd[51286]: Accepted publickey for root from 192.168.204.25 port 34888 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:30 oleg425-client systemd-logind[1020]: New session 258 of user root. May 25 04:15:30 oleg425-client systemd[1]: Started Session 258 of user root. May 25 04:15:30 oleg425-client sshd[51286]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:30 oleg425-client sshd[51299]: Received disconnect from 192.168.204.25 port 34888:11: disconnected by user May 25 04:15:30 oleg425-client sshd[51299]: Disconnected from user root 192.168.204.25 port 34888 May 25 04:15:30 oleg425-client sshd[51286]: pam_unix(sshd:session): session closed for user root May 25 04:15:31 oleg425-client systemd[1]: session-258.scope: Succeeded. May 25 04:15:31 oleg425-client systemd-logind[1020]: Session 258 logged out. Waiting for processes to exit. May 25 04:15:31 oleg425-client systemd-logind[1020]: Removed session 258. May 25 04:15:32 oleg425-client sshd[51440]: Accepted publickey for root from 192.168.204.25 port 34896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:32 oleg425-client systemd-logind[1020]: New session 259 of user root. May 25 04:15:32 oleg425-client systemd[1]: Started Session 259 of user root. May 25 04:15:32 oleg425-client sshd[51440]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:32 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 04:15:31 (1779696931) May 25 04:15:32 oleg425-client sshd[51453]: Received disconnect from 192.168.204.25 port 34896:11: disconnected by user May 25 04:15:32 oleg425-client sshd[51453]: Disconnected from user root 192.168.204.25 port 34896 May 25 04:15:32 oleg425-client sshd[51440]: pam_unix(sshd:session): session closed for user root May 25 04:15:33 oleg425-client systemd[1]: session-259.scope: Succeeded. May 25 04:15:33 oleg425-client systemd-logind[1020]: Session 259 logged out. Waiting for processes to exit. May 25 04:15:33 oleg425-client systemd-logind[1020]: Removed session 259. May 25 04:15:54 oleg425-client sshd[51679]: Accepted publickey for root from 192.168.204.25 port 47972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:54 oleg425-client systemd-logind[1020]: New session 260 of user root. May 25 04:15:54 oleg425-client systemd[1]: Started Session 260 of user root. May 25 04:15:54 oleg425-client sshd[51679]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:54 oleg425-client sshd[51692]: Received disconnect from 192.168.204.25 port 47972:11: disconnected by user May 25 04:15:54 oleg425-client sshd[51692]: Disconnected from user root 192.168.204.25 port 47972 May 25 04:15:54 oleg425-client sshd[51679]: pam_unix(sshd:session): session closed for user root May 25 04:15:55 oleg425-client systemd[1]: session-260.scope: Succeeded. May 25 04:15:55 oleg425-client systemd-logind[1020]: Session 260 logged out. Waiting for processes to exit. May 25 04:15:55 oleg425-client systemd-logind[1020]: Removed session 260. May 25 04:15:56 oleg425-client sshd[51816]: Accepted publickey for root from 192.168.204.25 port 47984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:56 oleg425-client systemd-logind[1020]: New session 261 of user root. May 25 04:15:56 oleg425-client systemd[1]: Started Session 261 of user root. May 25 04:15:56 oleg425-client sshd[51816]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:56 oleg425-client sshd[51829]: Received disconnect from 192.168.204.25 port 47984:11: disconnected by user May 25 04:15:56 oleg425-client sshd[51829]: Disconnected from user root 192.168.204.25 port 47984 May 25 04:15:56 oleg425-client sshd[51816]: pam_unix(sshd:session): session closed for user root May 25 04:15:56 oleg425-client systemd[1]: session-261.scope: Succeeded. May 25 04:15:56 oleg425-client systemd-logind[1020]: Session 261 logged out. Waiting for processes to exit. May 25 04:15:56 oleg425-client systemd-logind[1020]: Removed session 261. May 25 04:15:57 oleg425-client sshd[51961]: Accepted publickey for root from 192.168.204.25 port 47994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:57 oleg425-client systemd-logind[1020]: New session 262 of user root. May 25 04:15:57 oleg425-client systemd[1]: Started Session 262 of user root. May 25 04:15:57 oleg425-client sshd[51961]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:15:58 oleg425-client sshd[51974]: Received disconnect from 192.168.204.25 port 47994:11: disconnected by user May 25 04:15:58 oleg425-client sshd[51974]: Disconnected from user root 192.168.204.25 port 47994 May 25 04:15:58 oleg425-client sshd[51961]: pam_unix(sshd:session): session closed for user root May 25 04:15:58 oleg425-client systemd-logind[1020]: Session 262 logged out. Waiting for processes to exit. May 25 04:15:58 oleg425-client systemd[1]: session-262.scope: Succeeded. May 25 04:15:58 oleg425-client systemd-logind[1020]: Removed session 262. May 25 04:15:59 oleg425-client sshd[52114]: Accepted publickey for root from 192.168.204.25 port 48010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:15:59 oleg425-client systemd-logind[1020]: New session 263 of user root. May 25 04:15:59 oleg425-client systemd[1]: Started Session 263 of user root. May 25 04:15:59 oleg425-client sshd[52114]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:00 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 04:15:58 (1779696958) May 25 04:16:00 oleg425-client sshd[52128]: Received disconnect from 192.168.204.25 port 48010:11: disconnected by user May 25 04:16:00 oleg425-client sshd[52128]: Disconnected from user root 192.168.204.25 port 48010 May 25 04:16:00 oleg425-client sshd[52114]: pam_unix(sshd:session): session closed for user root May 25 04:16:00 oleg425-client systemd[1]: session-263.scope: Succeeded. May 25 04:16:00 oleg425-client systemd-logind[1020]: Session 263 logged out. Waiting for processes to exit. May 25 04:16:00 oleg425-client systemd-logind[1020]: Removed session 263. May 25 04:16:00 oleg425-client systemd-udevd[52181]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:16:00 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:16:32 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779696976/real 1779696976] req@ffffa09b06a54e00 x1866143441124480/t0(0) o400->lustre-MDT0000-mdc-ffffa09b0ab14000@192.168.204.125@tcp:12/10 lens 224/224 e 0 to 1 dl 1779696992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:16:32 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 04:16:32 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:16:32 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:16:32 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00948c9b to 0x799e3d1c00aa3543 May 25 04:16:32 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 04:16:40 oleg425-client sshd[52473]: Accepted publickey for root from 192.168.204.25 port 55840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:40 oleg425-client systemd-logind[1020]: New session 264 of user root. May 25 04:16:40 oleg425-client systemd[1]: Started Session 264 of user root. May 25 04:16:40 oleg425-client sshd[52473]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:40 oleg425-client sshd[52486]: Received disconnect from 192.168.204.25 port 55840:11: disconnected by user May 25 04:16:40 oleg425-client sshd[52486]: Disconnected from user root 192.168.204.25 port 55840 May 25 04:16:40 oleg425-client sshd[52473]: pam_unix(sshd:session): session closed for user root May 25 04:16:40 oleg425-client systemd[1]: session-264.scope: Succeeded. May 25 04:16:40 oleg425-client systemd-logind[1020]: Session 264 logged out. Waiting for processes to exit. May 25 04:16:40 oleg425-client systemd-logind[1020]: Removed session 264. May 25 04:16:43 oleg425-client sshd[52707]: Accepted publickey for root from 192.168.204.25 port 55842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:43 oleg425-client systemd-logind[1020]: New session 265 of user root. May 25 04:16:43 oleg425-client systemd[1]: Started Session 265 of user root. May 25 04:16:43 oleg425-client sshd[52707]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:44 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:16:44 oleg425-client sshd[52720]: Received disconnect from 192.168.204.25 port 55842:11: disconnected by user May 25 04:16:44 oleg425-client sshd[52720]: Disconnected from user root 192.168.204.25 port 55842 May 25 04:16:44 oleg425-client sshd[52707]: pam_unix(sshd:session): session closed for user root May 25 04:16:44 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:16:44 oleg425-client systemd-logind[1020]: Session 265 logged out. Waiting for processes to exit. May 25 04:16:44 oleg425-client systemd[1]: session-265.scope: Succeeded. May 25 04:16:44 oleg425-client systemd-logind[1020]: Removed session 265. May 25 04:16:45 oleg425-client sshd[52862]: Accepted publickey for root from 192.168.204.25 port 34054 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:45 oleg425-client systemd[1]: Started Session 266 of user root. May 25 04:16:45 oleg425-client systemd-logind[1020]: New session 266 of user root. May 25 04:16:45 oleg425-client sshd[52862]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:45 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:16:45 oleg425-client sshd[52875]: Received disconnect from 192.168.204.25 port 34054:11: disconnected by user May 25 04:16:45 oleg425-client sshd[52875]: Disconnected from user root 192.168.204.25 port 34054 May 25 04:16:45 oleg425-client sshd[52862]: pam_unix(sshd:session): session closed for user root May 25 04:16:46 oleg425-client systemd-logind[1020]: Session 266 logged out. Waiting for processes to exit. May 25 04:16:46 oleg425-client systemd[1]: session-266.scope: Succeeded. May 25 04:16:46 oleg425-client systemd-logind[1020]: Removed session 266. May 25 04:16:47 oleg425-client sshd[52917]: Accepted publickey for root from 192.168.204.25 port 34066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:47 oleg425-client systemd[1]: Started Session 267 of user root. May 25 04:16:47 oleg425-client systemd-logind[1020]: New session 267 of user root. May 25 04:16:47 oleg425-client sshd[52917]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:47 oleg425-client sshd[52930]: Received disconnect from 192.168.204.25 port 34066:11: disconnected by user May 25 04:16:47 oleg425-client sshd[52930]: Disconnected from user root 192.168.204.25 port 34066 May 25 04:16:48 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:16:48 oleg425-client sshd[52917]: pam_unix(sshd:session): session closed for user root May 25 04:16:48 oleg425-client kernel: LustreError: 52953:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b07228000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:16:48 oleg425-client kernel: LustreError: 52953:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:16:48 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:16:48 oleg425-client systemd[1]: session-267.scope: Succeeded. May 25 04:16:48 oleg425-client systemd-logind[1020]: Session 267 logged out. Waiting for processes to exit. May 25 04:16:48 oleg425-client systemd-logind[1020]: Removed session 267. May 25 04:16:49 oleg425-client sshd[53054]: Accepted publickey for root from 192.168.204.25 port 34072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:49 oleg425-client systemd[1]: Started Session 268 of user root. May 25 04:16:49 oleg425-client systemd-logind[1020]: New session 268 of user root. May 25 04:16:49 oleg425-client sshd[53054]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:49 oleg425-client sshd[53067]: Received disconnect from 192.168.204.25 port 34072:11: disconnected by user May 25 04:16:49 oleg425-client sshd[53067]: Disconnected from user root 192.168.204.25 port 34072 May 25 04:16:49 oleg425-client sshd[53054]: pam_unix(sshd:session): session closed for user root May 25 04:16:49 oleg425-client systemd[1]: session-268.scope: Succeeded. May 25 04:16:49 oleg425-client systemd-logind[1020]: Session 268 logged out. Waiting for processes to exit. May 25 04:16:49 oleg425-client systemd-logind[1020]: Removed session 268. May 25 04:16:50 oleg425-client sshd[53191]: Accepted publickey for root from 192.168.204.25 port 34074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:50 oleg425-client systemd-logind[1020]: New session 269 of user root. May 25 04:16:50 oleg425-client systemd[1]: Started Session 269 of user root. May 25 04:16:50 oleg425-client sshd[53191]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:51 oleg425-client sshd[53204]: Received disconnect from 192.168.204.25 port 34074:11: disconnected by user May 25 04:16:51 oleg425-client sshd[53204]: Disconnected from user root 192.168.204.25 port 34074 May 25 04:16:51 oleg425-client sshd[53191]: pam_unix(sshd:session): session closed for user root May 25 04:16:51 oleg425-client systemd[1]: session-269.scope: Succeeded. May 25 04:16:51 oleg425-client systemd-logind[1020]: Session 269 logged out. Waiting for processes to exit. May 25 04:16:51 oleg425-client systemd-logind[1020]: Removed session 269. May 25 04:16:52 oleg425-client sshd[53335]: Accepted publickey for root from 192.168.204.25 port 34078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:52 oleg425-client systemd-logind[1020]: New session 270 of user root. May 25 04:16:52 oleg425-client systemd[1]: Started Session 270 of user root. May 25 04:16:52 oleg425-client sshd[53335]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:52 oleg425-client sshd[53348]: Received disconnect from 192.168.204.25 port 34078:11: disconnected by user May 25 04:16:52 oleg425-client sshd[53348]: Disconnected from user root 192.168.204.25 port 34078 May 25 04:16:52 oleg425-client sshd[53335]: pam_unix(sshd:session): session closed for user root May 25 04:16:52 oleg425-client systemd-logind[1020]: Session 270 logged out. Waiting for processes to exit. May 25 04:16:52 oleg425-client systemd[1]: session-270.scope: Succeeded. May 25 04:16:53 oleg425-client systemd-logind[1020]: Removed session 270. May 25 04:16:53 oleg425-client sshd[53489]: Accepted publickey for root from 192.168.204.25 port 34092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:53 oleg425-client systemd-logind[1020]: New session 271 of user root. May 25 04:16:53 oleg425-client systemd[1]: Started Session 271 of user root. May 25 04:16:53 oleg425-client sshd[53489]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:54 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 04:16:53 (1779697013) May 25 04:16:54 oleg425-client sshd[53502]: Received disconnect from 192.168.204.25 port 34092:11: disconnected by user May 25 04:16:54 oleg425-client sshd[53502]: Disconnected from user root 192.168.204.25 port 34092 May 25 04:16:54 oleg425-client sshd[53489]: pam_unix(sshd:session): session closed for user root May 25 04:16:54 oleg425-client systemd-logind[1020]: Session 271 logged out. Waiting for processes to exit. May 25 04:16:54 oleg425-client systemd[1]: session-271.scope: Succeeded. May 25 04:16:54 oleg425-client systemd-logind[1020]: Removed session 271. May 25 04:19:12 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697136/real 1779697136] req@ffffa09b06a54700 x1866143441158400/t0(0) o4->lustre-OST0000-osc-ffffa09b0ab14000@192.168.204.125@tcp:6/4 lens 488/448 e 0 to 1 dl 1779697152 ref 2 fl Rpc:XQr/602/ffffffff rc -11/-1 job:'dd.0' uid:0 gid:0 projid:0 May 25 04:19:12 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 55 previous similar messages May 25 04:19:44 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab14000: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:19:44 oleg425-client kernel: Lustre: Skipped 14 previous similar messages May 25 04:20:16 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab14000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 04:20:16 oleg425-client kernel: Lustre: Skipped 17 previous similar messages May 25 04:21:43 oleg425-client sshd[54003]: Accepted publickey for root from 192.168.204.25 port 34014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:21:43 oleg425-client systemd-logind[1020]: New session 272 of user root. May 25 04:21:43 oleg425-client systemd[1]: Started Session 272 of user root. May 25 04:21:43 oleg425-client sshd[54003]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:21:44 oleg425-client sshd[54016]: Received disconnect from 192.168.204.25 port 34014:11: disconnected by user May 25 04:21:44 oleg425-client sshd[54016]: Disconnected from user root 192.168.204.25 port 34014 May 25 04:21:44 oleg425-client sshd[54003]: pam_unix(sshd:session): session closed for user root May 25 04:21:44 oleg425-client systemd[1]: session-272.scope: Succeeded. May 25 04:21:44 oleg425-client systemd-logind[1020]: Session 272 logged out. Waiting for processes to exit. May 25 04:21:44 oleg425-client systemd-logind[1020]: Removed session 272. May 25 04:21:46 oleg425-client sshd[54142]: Accepted publickey for root from 192.168.204.25 port 46802 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:21:46 oleg425-client systemd-logind[1020]: New session 273 of user root. May 25 04:21:46 oleg425-client sshd[54142]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:21:46 oleg425-client systemd[1]: Started Session 273 of user root. May 25 04:21:46 oleg425-client sshd[54155]: Received disconnect from 192.168.204.25 port 46802:11: disconnected by user May 25 04:21:46 oleg425-client sshd[54155]: Disconnected from user root 192.168.204.25 port 46802 May 25 04:21:46 oleg425-client sshd[54142]: pam_unix(sshd:session): session closed for user root May 25 04:21:46 oleg425-client systemd[1]: session-273.scope: Succeeded. May 25 04:21:46 oleg425-client systemd-logind[1020]: Session 273 logged out. Waiting for processes to exit. May 25 04:21:46 oleg425-client systemd-logind[1020]: Removed session 273. May 25 04:21:47 oleg425-client sshd[54286]: Accepted publickey for root from 192.168.204.25 port 46814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:21:48 oleg425-client systemd-logind[1020]: New session 274 of user root. May 25 04:21:48 oleg425-client systemd[1]: Started Session 274 of user root. May 25 04:21:48 oleg425-client sshd[54286]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:21:48 oleg425-client sshd[54299]: Received disconnect from 192.168.204.25 port 46814:11: disconnected by user May 25 04:21:48 oleg425-client sshd[54299]: Disconnected from user root 192.168.204.25 port 46814 May 25 04:21:48 oleg425-client sshd[54286]: pam_unix(sshd:session): session closed for user root May 25 04:21:48 oleg425-client systemd[1]: session-274.scope: Succeeded. May 25 04:21:48 oleg425-client systemd-logind[1020]: Session 274 logged out. Waiting for processes to exit. May 25 04:21:48 oleg425-client systemd-logind[1020]: Removed session 274. May 25 04:21:49 oleg425-client sshd[54441]: Accepted publickey for root from 192.168.204.25 port 46818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:21:49 oleg425-client systemd-logind[1020]: New session 275 of user root. May 25 04:21:49 oleg425-client systemd[1]: Started Session 275 of user root. May 25 04:21:50 oleg425-client sshd[54441]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:21:50 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 04:21:48 (1779697308) May 25 04:21:50 oleg425-client sshd[54454]: Received disconnect from 192.168.204.25 port 46818:11: disconnected by user May 25 04:21:50 oleg425-client sshd[54454]: Disconnected from user root 192.168.204.25 port 46818 May 25 04:21:50 oleg425-client sshd[54441]: pam_unix(sshd:session): session closed for user root May 25 04:21:50 oleg425-client systemd-logind[1020]: Session 275 logged out. Waiting for processes to exit. May 25 04:21:50 oleg425-client systemd[1]: session-275.scope: Succeeded. May 25 04:21:50 oleg425-client systemd-logind[1020]: Removed session 275. May 25 04:22:34 oleg425-client sshd[54602]: Accepted publickey for root from 192.168.204.25 port 49808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:34 oleg425-client systemd[1]: Started Session 276 of user root. May 25 04:22:34 oleg425-client systemd-logind[1020]: New session 276 of user root. May 25 04:22:34 oleg425-client sshd[54602]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:34 oleg425-client sshd[54615]: Received disconnect from 192.168.204.25 port 49808:11: disconnected by user May 25 04:22:34 oleg425-client sshd[54615]: Disconnected from user root 192.168.204.25 port 49808 May 25 04:22:34 oleg425-client sshd[54602]: pam_unix(sshd:session): session closed for user root May 25 04:22:34 oleg425-client systemd[1]: session-276.scope: Succeeded. May 25 04:22:34 oleg425-client systemd-logind[1020]: Session 276 logged out. Waiting for processes to exit. May 25 04:22:34 oleg425-client systemd-logind[1020]: Removed session 276. May 25 04:22:35 oleg425-client sshd[54740]: Accepted publickey for root from 192.168.204.25 port 51480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:35 oleg425-client systemd[1]: Started Session 277 of user root. May 25 04:22:35 oleg425-client systemd-logind[1020]: New session 277 of user root. May 25 04:22:35 oleg425-client sshd[54740]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:35 oleg425-client sshd[54753]: Received disconnect from 192.168.204.25 port 51480:11: disconnected by user May 25 04:22:35 oleg425-client sshd[54753]: Disconnected from user root 192.168.204.25 port 51480 May 25 04:22:35 oleg425-client sshd[54740]: pam_unix(sshd:session): session closed for user root May 25 04:22:35 oleg425-client systemd[1]: session-277.scope: Succeeded. May 25 04:22:35 oleg425-client systemd-logind[1020]: Session 277 logged out. Waiting for processes to exit. May 25 04:22:36 oleg425-client systemd-logind[1020]: Removed session 277. May 25 04:22:37 oleg425-client sshd[54885]: Accepted publickey for root from 192.168.204.25 port 51486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:37 oleg425-client systemd-logind[1020]: New session 278 of user root. May 25 04:22:37 oleg425-client systemd[1]: Started Session 278 of user root. May 25 04:22:37 oleg425-client sshd[54885]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:37 oleg425-client sshd[54898]: Received disconnect from 192.168.204.25 port 51486:11: disconnected by user May 25 04:22:37 oleg425-client sshd[54898]: Disconnected from user root 192.168.204.25 port 51486 May 25 04:22:37 oleg425-client sshd[54885]: pam_unix(sshd:session): session closed for user root May 25 04:22:37 oleg425-client systemd[1]: session-278.scope: Succeeded. May 25 04:22:37 oleg425-client systemd-logind[1020]: Session 278 logged out. Waiting for processes to exit. May 25 04:22:37 oleg425-client systemd-logind[1020]: Removed session 278. May 25 04:22:38 oleg425-client sshd[55038]: Accepted publickey for root from 192.168.204.25 port 51498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:38 oleg425-client systemd-logind[1020]: New session 279 of user root. May 25 04:22:38 oleg425-client systemd[1]: Started Session 279 of user root. May 25 04:22:38 oleg425-client sshd[55038]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:39 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 04:22:37 (1779697357) May 25 04:22:39 oleg425-client sshd[55051]: Received disconnect from 192.168.204.25 port 51498:11: disconnected by user May 25 04:22:39 oleg425-client sshd[55051]: Disconnected from user root 192.168.204.25 port 51498 May 25 04:22:39 oleg425-client sshd[55038]: pam_unix(sshd:session): session closed for user root May 25 04:22:39 oleg425-client systemd-logind[1020]: Session 279 logged out. Waiting for processes to exit. May 25 04:22:39 oleg425-client systemd[1]: session-279.scope: Succeeded. May 25 04:22:39 oleg425-client systemd-logind[1020]: Removed session 279. May 25 04:22:42 oleg425-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 04:22:42 oleg425-client kernel: LustreError: 55109:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b0ab14000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:22:42 oleg425-client kernel: LustreError: 55109:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:22:42 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:23:01 oleg425-client sshd[55366]: Accepted publickey for root from 192.168.204.25 port 44122 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:01 oleg425-client systemd-logind[1020]: New session 280 of user root. May 25 04:23:01 oleg425-client systemd[1]: Started Session 280 of user root. May 25 04:23:01 oleg425-client sshd[55366]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:02 oleg425-client sshd[55379]: Received disconnect from 192.168.204.25 port 44122:11: disconnected by user May 25 04:23:02 oleg425-client sshd[55379]: Disconnected from user root 192.168.204.25 port 44122 May 25 04:23:02 oleg425-client sshd[55366]: pam_unix(sshd:session): session closed for user root May 25 04:23:02 oleg425-client systemd[1]: session-280.scope: Succeeded. May 25 04:23:02 oleg425-client systemd-logind[1020]: Session 280 logged out. Waiting for processes to exit. May 25 04:23:02 oleg425-client systemd-logind[1020]: Removed session 280. May 25 04:23:03 oleg425-client sshd[55419]: Accepted publickey for root from 192.168.204.25 port 44128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:03 oleg425-client systemd[1]: Started Session 281 of user root. May 25 04:23:03 oleg425-client systemd-logind[1020]: New session 281 of user root. May 25 04:23:03 oleg425-client sshd[55419]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:04 oleg425-client sshd[55432]: Received disconnect from 192.168.204.25 port 44128:11: disconnected by user May 25 04:23:04 oleg425-client sshd[55432]: Disconnected from user root 192.168.204.25 port 44128 May 25 04:23:04 oleg425-client sshd[55419]: pam_unix(sshd:session): session closed for user root May 25 04:23:04 oleg425-client systemd[1]: session-281.scope: Succeeded. May 25 04:23:04 oleg425-client systemd-logind[1020]: Session 281 logged out. Waiting for processes to exit. May 25 04:23:04 oleg425-client systemd-logind[1020]: Removed session 281. May 25 04:23:04 oleg425-client systemd-udevd[55499]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:23:04 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:23:05 oleg425-client sshd[55604]: Accepted publickey for root from 192.168.204.25 port 49782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:06 oleg425-client systemd-logind[1020]: New session 282 of user root. May 25 04:23:06 oleg425-client systemd[1]: Started Session 282 of user root. May 25 04:23:06 oleg425-client sshd[55604]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:06 oleg425-client sshd[55617]: Received disconnect from 192.168.204.25 port 49782:11: disconnected by user May 25 04:23:06 oleg425-client sshd[55617]: Disconnected from user root 192.168.204.25 port 49782 May 25 04:23:06 oleg425-client sshd[55604]: pam_unix(sshd:session): session closed for user root May 25 04:23:06 oleg425-client systemd-logind[1020]: Session 282 logged out. Waiting for processes to exit. May 25 04:23:06 oleg425-client systemd[1]: session-282.scope: Succeeded. May 25 04:23:06 oleg425-client systemd-logind[1020]: Removed session 282. May 25 04:23:07 oleg425-client sshd[55742]: Accepted publickey for root from 192.168.204.25 port 49796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:07 oleg425-client systemd-logind[1020]: New session 283 of user root. May 25 04:23:07 oleg425-client systemd[1]: Started Session 283 of user root. May 25 04:23:07 oleg425-client sshd[55742]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:08 oleg425-client sshd[55755]: Received disconnect from 192.168.204.25 port 49796:11: disconnected by user May 25 04:23:08 oleg425-client sshd[55755]: Disconnected from user root 192.168.204.25 port 49796 May 25 04:23:08 oleg425-client sshd[55742]: pam_unix(sshd:session): session closed for user root May 25 04:23:08 oleg425-client systemd[1]: session-283.scope: Succeeded. May 25 04:23:08 oleg425-client systemd-logind[1020]: Session 283 logged out. Waiting for processes to exit. May 25 04:23:08 oleg425-client systemd-logind[1020]: Removed session 283. May 25 04:23:09 oleg425-client sshd[55886]: Accepted publickey for root from 192.168.204.25 port 49800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:09 oleg425-client systemd-logind[1020]: New session 284 of user root. May 25 04:23:09 oleg425-client systemd[1]: Started Session 284 of user root. May 25 04:23:09 oleg425-client sshd[55886]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:09 oleg425-client sshd[55899]: Received disconnect from 192.168.204.25 port 49800:11: disconnected by user May 25 04:23:09 oleg425-client sshd[55899]: Disconnected from user root 192.168.204.25 port 49800 May 25 04:23:09 oleg425-client sshd[55886]: pam_unix(sshd:session): session closed for user root May 25 04:23:09 oleg425-client systemd[1]: session-284.scope: Succeeded. May 25 04:23:09 oleg425-client systemd-logind[1020]: Session 284 logged out. Waiting for processes to exit. May 25 04:23:09 oleg425-client systemd-logind[1020]: Removed session 284. May 25 04:23:11 oleg425-client sshd[56039]: Accepted publickey for root from 192.168.204.25 port 49810 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:11 oleg425-client systemd-logind[1020]: New session 285 of user root. May 25 04:23:11 oleg425-client systemd[1]: Started Session 285 of user root. May 25 04:23:11 oleg425-client sshd[56039]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 04:23:09 (1779697389) May 25 04:23:11 oleg425-client sshd[56052]: Received disconnect from 192.168.204.25 port 49810:11: disconnected by user May 25 04:23:11 oleg425-client sshd[56052]: Disconnected from user root 192.168.204.25 port 49810 May 25 04:23:11 oleg425-client sshd[56039]: pam_unix(sshd:session): session closed for user root May 25 04:23:11 oleg425-client systemd[1]: session-285.scope: Succeeded. May 25 04:23:11 oleg425-client systemd-logind[1020]: Session 285 logged out. Waiting for processes to exit. May 25 04:23:11 oleg425-client systemd-logind[1020]: Removed session 285. May 25 04:23:11 oleg425-client kernel: LustreError: 56090:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout id 801 sleeping for 20000ms May 25 04:23:12 oleg425-client kernel: LustreError: 56090:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout interrupted May 25 04:23:13 oleg425-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 04:23:30 oleg425-client sshd[56222]: Accepted publickey for root from 192.168.204.25 port 38072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:30 oleg425-client systemd[1]: Started Session 286 of user root. May 25 04:23:30 oleg425-client systemd-logind[1020]: New session 286 of user root. May 25 04:23:30 oleg425-client sshd[56222]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:31 oleg425-client sshd[56235]: Received disconnect from 192.168.204.25 port 38072:11: disconnected by user May 25 04:23:31 oleg425-client sshd[56235]: Disconnected from user root 192.168.204.25 port 38072 May 25 04:23:31 oleg425-client sshd[56222]: pam_unix(sshd:session): session closed for user root May 25 04:23:31 oleg425-client systemd-logind[1020]: Session 286 logged out. Waiting for processes to exit. May 25 04:23:31 oleg425-client systemd[1]: session-286.scope: Succeeded. May 25 04:23:31 oleg425-client systemd-logind[1020]: Removed session 286. May 25 04:23:32 oleg425-client sshd[56360]: Accepted publickey for root from 192.168.204.25 port 38074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:32 oleg425-client systemd-logind[1020]: New session 287 of user root. May 25 04:23:32 oleg425-client systemd[1]: Started Session 287 of user root. May 25 04:23:32 oleg425-client sshd[56360]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:33 oleg425-client sshd[56373]: Received disconnect from 192.168.204.25 port 38074:11: disconnected by user May 25 04:23:33 oleg425-client sshd[56373]: Disconnected from user root 192.168.204.25 port 38074 May 25 04:23:33 oleg425-client sshd[56360]: pam_unix(sshd:session): session closed for user root May 25 04:23:33 oleg425-client systemd-logind[1020]: Session 287 logged out. Waiting for processes to exit. May 25 04:23:33 oleg425-client systemd[1]: session-287.scope: Succeeded. May 25 04:23:33 oleg425-client systemd-logind[1020]: Removed session 287. May 25 04:23:34 oleg425-client sshd[56504]: Accepted publickey for root from 192.168.204.25 port 38688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:34 oleg425-client systemd-logind[1020]: New session 288 of user root. May 25 04:23:34 oleg425-client systemd[1]: Started Session 288 of user root. May 25 04:23:34 oleg425-client sshd[56504]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:35 oleg425-client sshd[56517]: Received disconnect from 192.168.204.25 port 38688:11: disconnected by user May 25 04:23:35 oleg425-client sshd[56517]: Disconnected from user root 192.168.204.25 port 38688 May 25 04:23:35 oleg425-client sshd[56504]: pam_unix(sshd:session): session closed for user root May 25 04:23:35 oleg425-client systemd[1]: session-288.scope: Succeeded. May 25 04:23:35 oleg425-client systemd-logind[1020]: Session 288 logged out. Waiting for processes to exit. May 25 04:23:35 oleg425-client systemd-logind[1020]: Removed session 288. May 25 04:23:36 oleg425-client sshd[56657]: Accepted publickey for root from 192.168.204.25 port 38690 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:36 oleg425-client systemd[1]: Started Session 289 of user root. May 25 04:23:36 oleg425-client systemd-logind[1020]: New session 289 of user root. May 25 04:23:36 oleg425-client sshd[56657]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:37 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 04:23:35 (1779697415) May 25 04:23:37 oleg425-client sshd[56670]: Received disconnect from 192.168.204.25 port 38690:11: disconnected by user May 25 04:23:37 oleg425-client sshd[56670]: Disconnected from user root 192.168.204.25 port 38690 May 25 04:23:37 oleg425-client sshd[56657]: pam_unix(sshd:session): session closed for user root May 25 04:23:37 oleg425-client systemd[1]: session-289.scope: Succeeded. May 25 04:23:37 oleg425-client systemd-logind[1020]: Session 289 logged out. Waiting for processes to exit. May 25 04:23:37 oleg425-client systemd-logind[1020]: Removed session 289. May 25 04:23:37 oleg425-client systemd-udevd[56724]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:23:38 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:23:41 oleg425-client kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 25 04:23:51 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:23:51 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:23:53 oleg425-client sshd[56860]: Accepted publickey for root from 192.168.204.25 port 34908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:53 oleg425-client systemd-logind[1020]: New session 290 of user root. May 25 04:23:53 oleg425-client systemd[1]: Started Session 290 of user root. May 25 04:23:53 oleg425-client sshd[56860]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:53 oleg425-client sshd[56874]: Received disconnect from 192.168.204.25 port 34908:11: disconnected by user May 25 04:23:53 oleg425-client sshd[56874]: Disconnected from user root 192.168.204.25 port 34908 May 25 04:23:53 oleg425-client sshd[56860]: pam_unix(sshd:session): session closed for user root May 25 04:23:53 oleg425-client systemd[1]: session-290.scope: Succeeded. May 25 04:23:53 oleg425-client systemd-logind[1020]: Session 290 logged out. Waiting for processes to exit. May 25 04:23:53 oleg425-client systemd-logind[1020]: Removed session 290. May 25 04:23:55 oleg425-client sshd[56998]: Accepted publickey for root from 192.168.204.25 port 33336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:55 oleg425-client systemd-logind[1020]: New session 291 of user root. May 25 04:23:55 oleg425-client systemd[1]: Started Session 291 of user root. May 25 04:23:55 oleg425-client sshd[56998]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:55 oleg425-client sshd[57011]: Received disconnect from 192.168.204.25 port 33336:11: disconnected by user May 25 04:23:55 oleg425-client sshd[57011]: Disconnected from user root 192.168.204.25 port 33336 May 25 04:23:55 oleg425-client sshd[56998]: pam_unix(sshd:session): session closed for user root May 25 04:23:56 oleg425-client systemd[1]: session-291.scope: Succeeded. May 25 04:23:56 oleg425-client systemd-logind[1020]: Session 291 logged out. Waiting for processes to exit. May 25 04:23:56 oleg425-client systemd-logind[1020]: Removed session 291. May 25 04:23:57 oleg425-client sshd[57142]: Accepted publickey for root from 192.168.204.25 port 33344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:57 oleg425-client systemd-logind[1020]: New session 292 of user root. May 25 04:23:57 oleg425-client systemd[1]: Started Session 292 of user root. May 25 04:23:57 oleg425-client sshd[57142]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:23:57 oleg425-client sshd[57155]: Received disconnect from 192.168.204.25 port 33344:11: disconnected by user May 25 04:23:58 oleg425-client sshd[57155]: Disconnected from user root 192.168.204.25 port 33344 May 25 04:23:58 oleg425-client sshd[57142]: pam_unix(sshd:session): session closed for user root May 25 04:23:58 oleg425-client systemd[1]: session-292.scope: Succeeded. May 25 04:23:58 oleg425-client systemd-logind[1020]: Session 292 logged out. Waiting for processes to exit. May 25 04:23:58 oleg425-client systemd-logind[1020]: Removed session 292. May 25 04:23:59 oleg425-client sshd[57295]: Accepted publickey for root from 192.168.204.25 port 33358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:23:59 oleg425-client systemd-logind[1020]: New session 293 of user root. May 25 04:23:59 oleg425-client systemd[1]: Started Session 293 of user root. May 25 04:23:59 oleg425-client sshd[57295]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:24:00 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 04:23:58 (1779697438) May 25 04:24:00 oleg425-client sshd[57308]: Received disconnect from 192.168.204.25 port 33358:11: disconnected by user May 25 04:24:00 oleg425-client sshd[57308]: Disconnected from user root 192.168.204.25 port 33358 May 25 04:24:00 oleg425-client sshd[57295]: pam_unix(sshd:session): session closed for user root May 25 04:24:00 oleg425-client systemd-logind[1020]: Session 293 logged out. Waiting for processes to exit. May 25 04:24:00 oleg425-client systemd[1]: session-293.scope: Succeeded. May 25 04:24:00 oleg425-client systemd-logind[1020]: Removed session 293. May 25 04:24:05 oleg425-client sshd[57463]: Accepted publickey for root from 192.168.204.25 port 60948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:24:05 oleg425-client systemd-logind[1020]: New session 294 of user root. May 25 04:24:05 oleg425-client systemd[1]: Started Session 294 of user root. May 25 04:24:05 oleg425-client sshd[57463]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:24:06 oleg425-client sshd[57476]: Received disconnect from 192.168.204.25 port 60948:11: disconnected by user May 25 04:24:06 oleg425-client sshd[57476]: Disconnected from user root 192.168.204.25 port 60948 May 25 04:24:06 oleg425-client sshd[57463]: pam_unix(sshd:session): session closed for user root May 25 04:24:06 oleg425-client systemd-logind[1020]: Session 294 logged out. Waiting for processes to exit. May 25 04:24:06 oleg425-client systemd[1]: session-294.scope: Succeeded. May 25 04:24:06 oleg425-client systemd-logind[1020]: Removed session 294. May 25 04:25:43 oleg425-client sshd[57691]: Accepted publickey for root from 192.168.204.25 port 51380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:25:44 oleg425-client systemd-logind[1020]: New session 295 of user root. May 25 04:25:44 oleg425-client systemd[1]: Started Session 295 of user root. May 25 04:25:44 oleg425-client sshd[57691]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:25:44 oleg425-client sshd[57705]: Received disconnect from 192.168.204.25 port 51380:11: disconnected by user May 25 04:25:44 oleg425-client sshd[57705]: Disconnected from user root 192.168.204.25 port 51380 May 25 04:25:44 oleg425-client sshd[57691]: pam_unix(sshd:session): session closed for user root May 25 04:25:44 oleg425-client systemd[1]: session-295.scope: Succeeded. May 25 04:25:44 oleg425-client systemd-logind[1020]: Session 295 logged out. Waiting for processes to exit. May 25 04:25:44 oleg425-client systemd-logind[1020]: Removed session 295. May 25 04:25:45 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b18049000: operation mds_reint to node 192.168.204.125@tcp failed: rc = -19 May 25 04:25:45 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:26:02 oleg425-client kernel: Lustre: 2375:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697546/real 1779697546] req@ffffa09b1110c380 x1866143443835008/t0(0) o400->MGC192.168.204.125@tcp@192.168.204.125@tcp:26/25 lens 224/224 e 0 to 1 dl 1779697562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:26:02 oleg425-client kernel: Lustre: 2375:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 73 previous similar messages May 25 04:26:02 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:26:13 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00aa5190 to 0x799e3d1c00ad052b May 25 04:29:01 oleg425-client sshd[58215]: Accepted publickey for root from 192.168.204.25 port 37518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:01 oleg425-client systemd-logind[1020]: New session 296 of user root. May 25 04:29:01 oleg425-client systemd[1]: Started Session 296 of user root. May 25 04:29:01 oleg425-client sshd[58215]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:01 oleg425-client sshd[58228]: Received disconnect from 192.168.204.25 port 37518:11: disconnected by user May 25 04:29:01 oleg425-client sshd[58228]: Disconnected from user root 192.168.204.25 port 37518 May 25 04:29:01 oleg425-client sshd[58215]: pam_unix(sshd:session): session closed for user root May 25 04:29:01 oleg425-client systemd-logind[1020]: Session 296 logged out. Waiting for processes to exit. May 25 04:29:01 oleg425-client systemd[1]: session-296.scope: Succeeded. May 25 04:29:01 oleg425-client systemd-logind[1020]: Removed session 296. May 25 04:29:02 oleg425-client sshd[58352]: Accepted publickey for root from 192.168.204.25 port 37532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:02 oleg425-client systemd-logind[1020]: New session 297 of user root. May 25 04:29:02 oleg425-client systemd[1]: Started Session 297 of user root. May 25 04:29:02 oleg425-client sshd[58352]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:03 oleg425-client sshd[58365]: Received disconnect from 192.168.204.25 port 37532:11: disconnected by user May 25 04:29:03 oleg425-client sshd[58365]: Disconnected from user root 192.168.204.25 port 37532 May 25 04:29:03 oleg425-client sshd[58352]: pam_unix(sshd:session): session closed for user root May 25 04:29:03 oleg425-client systemd-logind[1020]: Session 297 logged out. Waiting for processes to exit. May 25 04:29:03 oleg425-client systemd[1]: session-297.scope: Succeeded. May 25 04:29:03 oleg425-client systemd-logind[1020]: Removed session 297. May 25 04:29:04 oleg425-client sshd[58497]: Accepted publickey for root from 192.168.204.25 port 58162 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:04 oleg425-client systemd-logind[1020]: New session 298 of user root. May 25 04:29:04 oleg425-client systemd[1]: Started Session 298 of user root. May 25 04:29:04 oleg425-client sshd[58497]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:05 oleg425-client sshd[58510]: Received disconnect from 192.168.204.25 port 58162:11: disconnected by user May 25 04:29:05 oleg425-client sshd[58510]: Disconnected from user root 192.168.204.25 port 58162 May 25 04:29:05 oleg425-client sshd[58497]: pam_unix(sshd:session): session closed for user root May 25 04:29:05 oleg425-client systemd[1]: session-298.scope: Succeeded. May 25 04:29:05 oleg425-client systemd-logind[1020]: Session 298 logged out. Waiting for processes to exit. May 25 04:29:05 oleg425-client systemd-logind[1020]: Removed session 298. May 25 04:29:09 oleg425-client sshd[58674]: Accepted publickey for root from 192.168.204.25 port 58170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:09 oleg425-client systemd-logind[1020]: New session 299 of user root. May 25 04:29:09 oleg425-client systemd[1]: Started Session 299 of user root. May 25 04:29:09 oleg425-client sshd[58674]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:09 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 04:29:07 (1779697747) May 25 04:29:09 oleg425-client sshd[58687]: Received disconnect from 192.168.204.25 port 58170:11: disconnected by user May 25 04:29:09 oleg425-client sshd[58687]: Disconnected from user root 192.168.204.25 port 58170 May 25 04:29:09 oleg425-client sshd[58674]: pam_unix(sshd:session): session closed for user root May 25 04:29:09 oleg425-client systemd[1]: session-299.scope: Succeeded. May 25 04:29:09 oleg425-client systemd-logind[1020]: Session 299 logged out. Waiting for processes to exit. May 25 04:29:09 oleg425-client systemd-logind[1020]: Removed session 299. May 25 04:29:16 oleg425-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 04:29:30 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:29:30 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00ad052b to 0x799e3d1c00b1ce78 May 25 04:29:32 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b18049000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:29:39 oleg425-client sshd[59068]: Accepted publickey for root from 192.168.204.25 port 59724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:39 oleg425-client systemd-logind[1020]: New session 300 of user root. May 25 04:29:39 oleg425-client systemd[1]: Started Session 300 of user root. May 25 04:29:39 oleg425-client sshd[59068]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:40 oleg425-client sshd[59082]: Received disconnect from 192.168.204.25 port 59724:11: disconnected by user May 25 04:29:40 oleg425-client sshd[59082]: Disconnected from user root 192.168.204.25 port 59724 May 25 04:29:40 oleg425-client sshd[59068]: pam_unix(sshd:session): session closed for user root May 25 04:29:40 oleg425-client systemd[1]: session-300.scope: Succeeded. May 25 04:29:40 oleg425-client systemd-logind[1020]: Session 300 logged out. Waiting for processes to exit. May 25 04:29:40 oleg425-client systemd-logind[1020]: Removed session 300. May 25 04:29:41 oleg425-client sshd[59121]: Accepted publickey for root from 192.168.204.25 port 59736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:41 oleg425-client systemd[1]: Started Session 301 of user root. May 25 04:29:41 oleg425-client systemd-logind[1020]: New session 301 of user root. May 25 04:29:41 oleg425-client sshd[59121]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:42 oleg425-client sshd[59134]: Received disconnect from 192.168.204.25 port 59736:11: disconnected by user May 25 04:29:42 oleg425-client sshd[59134]: Disconnected from user root 192.168.204.25 port 59736 May 25 04:29:42 oleg425-client sshd[59121]: pam_unix(sshd:session): session closed for user root May 25 04:29:42 oleg425-client systemd[1]: session-301.scope: Succeeded. May 25 04:29:42 oleg425-client systemd-logind[1020]: Session 301 logged out. Waiting for processes to exit. May 25 04:29:42 oleg425-client systemd-logind[1020]: Removed session 301. May 25 04:29:43 oleg425-client sshd[59256]: Accepted publickey for root from 192.168.204.25 port 59752 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:43 oleg425-client systemd[1]: Started Session 302 of user root. May 25 04:29:43 oleg425-client systemd-logind[1020]: New session 302 of user root. May 25 04:29:43 oleg425-client sshd[59256]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:43 oleg425-client sshd[59269]: Received disconnect from 192.168.204.25 port 59752:11: disconnected by user May 25 04:29:43 oleg425-client sshd[59269]: Disconnected from user root 192.168.204.25 port 59752 May 25 04:29:43 oleg425-client sshd[59256]: pam_unix(sshd:session): session closed for user root May 25 04:29:44 oleg425-client systemd[1]: session-302.scope: Succeeded. May 25 04:29:44 oleg425-client systemd-logind[1020]: Session 302 logged out. Waiting for processes to exit. May 25 04:29:44 oleg425-client systemd-logind[1020]: Removed session 302. May 25 04:29:45 oleg425-client sshd[59393]: Accepted publickey for root from 192.168.204.25 port 50948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:45 oleg425-client systemd-logind[1020]: New session 303 of user root. May 25 04:29:45 oleg425-client systemd[1]: Started Session 303 of user root. May 25 04:29:45 oleg425-client sshd[59393]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:45 oleg425-client sshd[59407]: Received disconnect from 192.168.204.25 port 50948:11: disconnected by user May 25 04:29:45 oleg425-client sshd[59407]: Disconnected from user root 192.168.204.25 port 50948 May 25 04:29:45 oleg425-client sshd[59393]: pam_unix(sshd:session): session closed for user root May 25 04:29:46 oleg425-client systemd[1]: session-303.scope: Succeeded. May 25 04:29:46 oleg425-client systemd-logind[1020]: Session 303 logged out. Waiting for processes to exit. May 25 04:29:46 oleg425-client systemd-logind[1020]: Removed session 303. May 25 04:29:47 oleg425-client sshd[59539]: Accepted publickey for root from 192.168.204.25 port 50954 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:47 oleg425-client systemd[1]: Started Session 304 of user root. May 25 04:29:47 oleg425-client systemd-logind[1020]: New session 304 of user root. May 25 04:29:47 oleg425-client sshd[59539]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:47 oleg425-client sshd[59552]: Received disconnect from 192.168.204.25 port 50954:11: disconnected by user May 25 04:29:47 oleg425-client sshd[59552]: Disconnected from user root 192.168.204.25 port 50954 May 25 04:29:47 oleg425-client sshd[59539]: pam_unix(sshd:session): session closed for user root May 25 04:29:47 oleg425-client systemd[1]: session-304.scope: Succeeded. May 25 04:29:47 oleg425-client systemd-logind[1020]: Session 304 logged out. Waiting for processes to exit. May 25 04:29:48 oleg425-client systemd-logind[1020]: Removed session 304. May 25 04:29:49 oleg425-client sshd[59692]: Accepted publickey for root from 192.168.204.25 port 50958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:49 oleg425-client systemd-logind[1020]: New session 305 of user root. May 25 04:29:49 oleg425-client systemd[1]: Started Session 305 of user root. May 25 04:29:49 oleg425-client sshd[59692]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:49 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 04:29:48 (1779697788) May 25 04:29:49 oleg425-client sshd[59705]: Received disconnect from 192.168.204.25 port 50958:11: disconnected by user May 25 04:29:50 oleg425-client sshd[59705]: Disconnected from user root 192.168.204.25 port 50958 May 25 04:29:50 oleg425-client sshd[59692]: pam_unix(sshd:session): session closed for user root May 25 04:29:50 oleg425-client systemd[1]: session-305.scope: Succeeded. May 25 04:29:50 oleg425-client systemd-logind[1020]: Session 305 logged out. Waiting for processes to exit. May 25 04:29:50 oleg425-client systemd-logind[1020]: Removed session 305. May 25 04:29:50 oleg425-client systemd-udevd[59760]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:29:50 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:29:58 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b18049000: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -107 May 25 04:29:58 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b18049000: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:29:58 oleg425-client kernel: Lustre: Skipped 11 previous similar messages May 25 04:29:58 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b18049000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 04:30:10 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:30:10 oleg425-client kernel: LustreError: 59832:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b0ab17800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:30:10 oleg425-client kernel: LustreError: 59832:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:30:11 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:30:12 oleg425-client sshd[59918]: Accepted publickey for root from 192.168.204.25 port 55978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:12 oleg425-client systemd-logind[1020]: New session 306 of user root. May 25 04:30:12 oleg425-client systemd[1]: Started Session 306 of user root. May 25 04:30:12 oleg425-client sshd[59918]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:13 oleg425-client sshd[59931]: Received disconnect from 192.168.204.25 port 55978:11: disconnected by user May 25 04:30:13 oleg425-client sshd[59931]: Disconnected from user root 192.168.204.25 port 55978 May 25 04:30:13 oleg425-client sshd[59918]: pam_unix(sshd:session): session closed for user root May 25 04:30:13 oleg425-client systemd[1]: session-306.scope: Succeeded. May 25 04:30:13 oleg425-client systemd-logind[1020]: Session 306 logged out. Waiting for processes to exit. May 25 04:30:13 oleg425-client systemd-logind[1020]: Removed session 306. May 25 04:30:15 oleg425-client sshd[60056]: Accepted publickey for root from 192.168.204.25 port 46208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:15 oleg425-client systemd[1]: Started Session 307 of user root. May 25 04:30:15 oleg425-client systemd-logind[1020]: New session 307 of user root. May 25 04:30:15 oleg425-client sshd[60056]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:15 oleg425-client sshd[60069]: Received disconnect from 192.168.204.25 port 46208:11: disconnected by user May 25 04:30:15 oleg425-client sshd[60069]: Disconnected from user root 192.168.204.25 port 46208 May 25 04:30:15 oleg425-client sshd[60056]: pam_unix(sshd:session): session closed for user root May 25 04:30:15 oleg425-client systemd[1]: session-307.scope: Succeeded. May 25 04:30:15 oleg425-client systemd-logind[1020]: Session 307 logged out. Waiting for processes to exit. May 25 04:30:15 oleg425-client systemd-logind[1020]: Removed session 307. May 25 04:30:17 oleg425-client sshd[60200]: Accepted publickey for root from 192.168.204.25 port 46214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:17 oleg425-client systemd-logind[1020]: New session 308 of user root. May 25 04:30:17 oleg425-client systemd[1]: Started Session 308 of user root. May 25 04:30:17 oleg425-client sshd[60200]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:17 oleg425-client sshd[60213]: Received disconnect from 192.168.204.25 port 46214:11: disconnected by user May 25 04:30:17 oleg425-client sshd[60213]: Disconnected from user root 192.168.204.25 port 46214 May 25 04:30:17 oleg425-client sshd[60200]: pam_unix(sshd:session): session closed for user root May 25 04:30:17 oleg425-client systemd[1]: session-308.scope: Succeeded. May 25 04:30:17 oleg425-client systemd-logind[1020]: Session 308 logged out. Waiting for processes to exit. May 25 04:30:18 oleg425-client systemd-logind[1020]: Removed session 308. May 25 04:30:19 oleg425-client sshd[60353]: Accepted publickey for root from 192.168.204.25 port 46228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:19 oleg425-client systemd-logind[1020]: New session 309 of user root. May 25 04:30:19 oleg425-client systemd[1]: Started Session 309 of user root. May 25 04:30:19 oleg425-client sshd[60353]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:20 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 04:30:18 (1779697818) May 25 04:30:20 oleg425-client sshd[60366]: Received disconnect from 192.168.204.25 port 46228:11: disconnected by user May 25 04:30:20 oleg425-client sshd[60366]: Disconnected from user root 192.168.204.25 port 46228 May 25 04:30:20 oleg425-client sshd[60353]: pam_unix(sshd:session): session closed for user root May 25 04:30:20 oleg425-client systemd-logind[1020]: Session 309 logged out. Waiting for processes to exit. May 25 04:30:20 oleg425-client systemd[1]: session-309.scope: Succeeded. May 25 04:30:20 oleg425-client systemd-logind[1020]: Removed session 309. May 25 04:30:24 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b18049000: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 04:30:24 oleg425-client kernel: Lustre: Skipped 13 previous similar messages May 25 04:30:27 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b18049000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:30:27 oleg425-client kernel: LustreError: 60474:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 May 25 04:30:29 oleg425-client sshd[60688]: Accepted publickey for root from 192.168.204.25 port 35442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:29 oleg425-client systemd-logind[1020]: New session 310 of user root. May 25 04:30:29 oleg425-client systemd[1]: Started Session 310 of user root. May 25 04:30:29 oleg425-client sshd[60688]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:30 oleg425-client sshd[60701]: Received disconnect from 192.168.204.25 port 35442:11: disconnected by user May 25 04:30:30 oleg425-client sshd[60701]: Disconnected from user root 192.168.204.25 port 35442 May 25 04:30:30 oleg425-client sshd[60688]: pam_unix(sshd:session): session closed for user root May 25 04:30:30 oleg425-client systemd[1]: session-310.scope: Succeeded. May 25 04:30:30 oleg425-client systemd-logind[1020]: Session 310 logged out. Waiting for processes to exit. May 25 04:30:30 oleg425-client systemd-logind[1020]: Removed session 310. May 25 04:30:31 oleg425-client sshd[60825]: Accepted publickey for root from 192.168.204.25 port 35446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:31 oleg425-client systemd-logind[1020]: New session 311 of user root. May 25 04:30:31 oleg425-client systemd[1]: Started Session 311 of user root. May 25 04:30:31 oleg425-client sshd[60825]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:32 oleg425-client sshd[60838]: Received disconnect from 192.168.204.25 port 35446:11: disconnected by user May 25 04:30:32 oleg425-client sshd[60838]: Disconnected from user root 192.168.204.25 port 35446 May 25 04:30:32 oleg425-client sshd[60825]: pam_unix(sshd:session): session closed for user root May 25 04:30:32 oleg425-client systemd[1]: session-311.scope: Succeeded. May 25 04:30:32 oleg425-client systemd-logind[1020]: Session 311 logged out. Waiting for processes to exit. May 25 04:30:32 oleg425-client systemd-logind[1020]: Removed session 311. May 25 04:30:33 oleg425-client sshd[60970]: Accepted publickey for root from 192.168.204.25 port 35462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:33 oleg425-client systemd-logind[1020]: New session 312 of user root. May 25 04:30:33 oleg425-client systemd[1]: Started Session 312 of user root. May 25 04:30:33 oleg425-client sshd[60970]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:33 oleg425-client sshd[60983]: Received disconnect from 192.168.204.25 port 35462:11: disconnected by user May 25 04:30:33 oleg425-client sshd[60983]: Disconnected from user root 192.168.204.25 port 35462 May 25 04:30:33 oleg425-client sshd[60970]: pam_unix(sshd:session): session closed for user root May 25 04:30:33 oleg425-client systemd-logind[1020]: Session 312 logged out. Waiting for processes to exit. May 25 04:30:33 oleg425-client systemd[1]: session-312.scope: Succeeded. May 25 04:30:33 oleg425-client systemd-logind[1020]: Removed session 312. May 25 04:30:35 oleg425-client sshd[61123]: Accepted publickey for root from 192.168.204.25 port 46838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:35 oleg425-client systemd-logind[1020]: New session 313 of user root. May 25 04:30:35 oleg425-client systemd[1]: Started Session 313 of user root. May 25 04:30:35 oleg425-client sshd[61123]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:35 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 04:30:33 (1779697833) May 25 04:30:35 oleg425-client sshd[61136]: Received disconnect from 192.168.204.25 port 46838:11: disconnected by user May 25 04:30:35 oleg425-client sshd[61136]: Disconnected from user root 192.168.204.25 port 46838 May 25 04:30:35 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:30:35 oleg425-client sshd[61123]: pam_unix(sshd:session): session closed for user root May 25 04:30:35 oleg425-client kernel: LustreError: 61173:0:(recover.c:329:ptlrpc_recover_import()) cfs_race id 531 sleeping May 25 04:30:35 oleg425-client systemd[1]: session-313.scope: Succeeded. May 25 04:30:35 oleg425-client systemd-logind[1020]: Session 313 logged out. Waiting for processes to exit. May 25 04:30:35 oleg425-client systemd-logind[1020]: Removed session 313. May 25 04:30:39 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b18049000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:30:39 oleg425-client kernel: LustreError: 61195:0:(import.c:293:ptlrpc_invalidate_import()) cfs_fail_race id 531 waking May 25 04:30:39 oleg425-client kernel: LustreError: 61173:0:(recover.c:329:ptlrpc_recover_import()) cfs_fail_race id 531 awake: rc=880 May 25 04:30:39 oleg425-client kernel: LustreError: 61173:0:(import.c:719:ptlrpc_connect_import_locked()) already connecting May 25 04:30:39 oleg425-client kernel: LustreError: 61200:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:30:40 oleg425-client kernel: LustreError: 61206:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:30:40 oleg425-client kernel: LustreError: 61206:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 5 previous similar messages May 25 04:30:43 oleg425-client kernel: LustreError: 61229:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:30:43 oleg425-client kernel: LustreError: 61229:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 13 previous similar messages May 25 04:30:48 oleg425-client kernel: LustreError: 61274:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:30:48 oleg425-client kernel: LustreError: 61274:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 27 previous similar messages May 25 04:30:52 oleg425-client sshd[61391]: Accepted publickey for root from 192.168.204.25 port 58992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:52 oleg425-client systemd-logind[1020]: New session 314 of user root. May 25 04:30:52 oleg425-client systemd[1]: Started Session 314 of user root. May 25 04:30:52 oleg425-client sshd[61391]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:52 oleg425-client sshd[61405]: Received disconnect from 192.168.204.25 port 58992:11: disconnected by user May 25 04:30:53 oleg425-client sshd[61405]: Disconnected from user root 192.168.204.25 port 58992 May 25 04:30:53 oleg425-client sshd[61391]: pam_unix(sshd:session): session closed for user root May 25 04:30:53 oleg425-client systemd-logind[1020]: Session 314 logged out. Waiting for processes to exit. May 25 04:30:53 oleg425-client systemd[1]: session-314.scope: Succeeded. May 25 04:30:53 oleg425-client systemd-logind[1020]: Removed session 314. May 25 04:30:54 oleg425-client sshd[61529]: Accepted publickey for root from 192.168.204.25 port 35302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:55 oleg425-client systemd[1]: Started Session 315 of user root. May 25 04:30:55 oleg425-client systemd-logind[1020]: New session 315 of user root. May 25 04:30:55 oleg425-client sshd[61529]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:55 oleg425-client sshd[61542]: Received disconnect from 192.168.204.25 port 35302:11: disconnected by user May 25 04:30:55 oleg425-client sshd[61542]: Disconnected from user root 192.168.204.25 port 35302 May 25 04:30:55 oleg425-client sshd[61529]: pam_unix(sshd:session): session closed for user root May 25 04:30:55 oleg425-client systemd[1]: session-315.scope: Succeeded. May 25 04:30:55 oleg425-client systemd-logind[1020]: Session 315 logged out. Waiting for processes to exit. May 25 04:30:55 oleg425-client systemd-logind[1020]: Removed session 315. May 25 04:30:56 oleg425-client sshd[61673]: Accepted publickey for root from 192.168.204.25 port 35306 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:56 oleg425-client systemd[1]: Started Session 316 of user root. May 25 04:30:56 oleg425-client systemd-logind[1020]: New session 316 of user root. May 25 04:30:56 oleg425-client sshd[61673]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:57 oleg425-client sshd[61686]: Received disconnect from 192.168.204.25 port 35306:11: disconnected by user May 25 04:30:57 oleg425-client sshd[61686]: Disconnected from user root 192.168.204.25 port 35306 May 25 04:30:57 oleg425-client sshd[61673]: pam_unix(sshd:session): session closed for user root May 25 04:30:57 oleg425-client systemd[1]: session-316.scope: Succeeded. May 25 04:30:57 oleg425-client systemd-logind[1020]: Session 316 logged out. Waiting for processes to exit. May 25 04:30:57 oleg425-client systemd-logind[1020]: Removed session 316. May 25 04:30:59 oleg425-client sshd[61827]: Accepted publickey for root from 192.168.204.25 port 35320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:59 oleg425-client systemd-logind[1020]: New session 317 of user root. May 25 04:30:59 oleg425-client systemd[1]: Started Session 317 of user root. May 25 04:30:59 oleg425-client sshd[61827]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:59 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 04:30:57 (1779697857) May 25 04:30:59 oleg425-client sshd[61840]: Received disconnect from 192.168.204.25 port 35320:11: disconnected by user May 25 04:30:59 oleg425-client sshd[61840]: Disconnected from user root 192.168.204.25 port 35320 May 25 04:30:59 oleg425-client sshd[61827]: pam_unix(sshd:session): session closed for user root May 25 04:30:59 oleg425-client systemd[1]: session-317.scope: Succeeded. May 25 04:30:59 oleg425-client systemd-logind[1020]: Session 317 logged out. Waiting for processes to exit. May 25 04:30:59 oleg425-client systemd-logind[1020]: Removed session 317. May 25 04:31:36 oleg425-client sshd[62188]: Accepted publickey for root from 192.168.204.25 port 50770 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:37 oleg425-client systemd-logind[1020]: New session 318 of user root. May 25 04:31:37 oleg425-client systemd[1]: Started Session 318 of user root. May 25 04:31:37 oleg425-client sshd[62188]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:37 oleg425-client sshd[62201]: Received disconnect from 192.168.204.25 port 50770:11: disconnected by user May 25 04:31:37 oleg425-client sshd[62201]: Disconnected from user root 192.168.204.25 port 50770 May 25 04:31:37 oleg425-client sshd[62188]: pam_unix(sshd:session): session closed for user root May 25 04:31:37 oleg425-client systemd[1]: session-318.scope: Succeeded. May 25 04:31:37 oleg425-client systemd-logind[1020]: Session 318 logged out. Waiting for processes to exit. May 25 04:31:37 oleg425-client systemd-logind[1020]: Removed session 318. May 25 04:31:41 oleg425-client sshd[62423]: Accepted publickey for root from 192.168.204.25 port 50786 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:41 oleg425-client systemd-logind[1020]: New session 319 of user root. May 25 04:31:41 oleg425-client systemd[1]: Started Session 319 of user root. May 25 04:31:41 oleg425-client sshd[62423]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:41 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:31:41 oleg425-client sshd[62436]: Received disconnect from 192.168.204.25 port 50786:11: disconnected by user May 25 04:31:41 oleg425-client sshd[62436]: Disconnected from user root 192.168.204.25 port 50786 May 25 04:31:41 oleg425-client sshd[62423]: pam_unix(sshd:session): session closed for user root May 25 04:31:41 oleg425-client systemd[1]: session-319.scope: Succeeded. May 25 04:31:41 oleg425-client systemd-logind[1020]: Session 319 logged out. Waiting for processes to exit. May 25 04:31:41 oleg425-client systemd-logind[1020]: Removed session 319. May 25 04:31:43 oleg425-client sshd[62577]: Accepted publickey for root from 192.168.204.25 port 50788 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:43 oleg425-client systemd-logind[1020]: New session 320 of user root. May 25 04:31:43 oleg425-client systemd[1]: Started Session 320 of user root. May 25 04:31:43 oleg425-client sshd[62577]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:43 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:31:43 oleg425-client sshd[62591]: Received disconnect from 192.168.204.25 port 50788:11: disconnected by user May 25 04:31:43 oleg425-client sshd[62591]: Disconnected from user root 192.168.204.25 port 50788 May 25 04:31:43 oleg425-client sshd[62577]: pam_unix(sshd:session): session closed for user root May 25 04:31:43 oleg425-client systemd-logind[1020]: Session 320 logged out. Waiting for processes to exit. May 25 04:31:43 oleg425-client systemd[1]: session-320.scope: Succeeded. May 25 04:31:43 oleg425-client systemd-logind[1020]: Removed session 320. May 25 04:31:45 oleg425-client sshd[62632]: Accepted publickey for root from 192.168.204.25 port 41372 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:45 oleg425-client systemd[1]: Started Session 321 of user root. May 25 04:31:45 oleg425-client systemd-logind[1020]: New session 321 of user root. May 25 04:31:45 oleg425-client sshd[62632]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:45 oleg425-client sshd[62645]: Received disconnect from 192.168.204.25 port 41372:11: disconnected by user May 25 04:31:45 oleg425-client sshd[62645]: Disconnected from user root 192.168.204.25 port 41372 May 25 04:31:45 oleg425-client sshd[62632]: pam_unix(sshd:session): session closed for user root May 25 04:31:45 oleg425-client systemd[1]: session-321.scope: Succeeded. May 25 04:31:45 oleg425-client systemd-logind[1020]: Session 321 logged out. Waiting for processes to exit. May 25 04:31:46 oleg425-client systemd-logind[1020]: Removed session 321. May 25 04:31:49 oleg425-client sshd[62794]: Accepted publickey for root from 192.168.204.25 port 41382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:50 oleg425-client systemd-logind[1020]: New session 322 of user root. May 25 04:31:50 oleg425-client systemd[1]: Started Session 322 of user root. May 25 04:31:50 oleg425-client sshd[62794]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:50 oleg425-client sshd[62807]: Received disconnect from 192.168.204.25 port 41382:11: disconnected by user May 25 04:31:50 oleg425-client sshd[62807]: Disconnected from user root 192.168.204.25 port 41382 May 25 04:31:50 oleg425-client sshd[62794]: pam_unix(sshd:session): session closed for user root May 25 04:31:50 oleg425-client systemd[1]: session-322.scope: Succeeded. May 25 04:31:50 oleg425-client systemd-logind[1020]: Session 322 logged out. Waiting for processes to exit. May 25 04:31:50 oleg425-client systemd-logind[1020]: Removed session 322. May 25 04:31:51 oleg425-client sshd[62931]: Accepted publickey for root from 192.168.204.25 port 41394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:51 oleg425-client systemd-logind[1020]: New session 323 of user root. May 25 04:31:51 oleg425-client systemd[1]: Started Session 323 of user root. May 25 04:31:51 oleg425-client sshd[62931]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:52 oleg425-client sshd[62944]: Received disconnect from 192.168.204.25 port 41394:11: disconnected by user May 25 04:31:52 oleg425-client sshd[62944]: Disconnected from user root 192.168.204.25 port 41394 May 25 04:31:52 oleg425-client sshd[62931]: pam_unix(sshd:session): session closed for user root May 25 04:31:52 oleg425-client systemd[1]: session-323.scope: Succeeded. May 25 04:31:52 oleg425-client systemd-logind[1020]: Session 323 logged out. Waiting for processes to exit. May 25 04:31:52 oleg425-client systemd-logind[1020]: Removed session 323. May 25 04:31:53 oleg425-client sshd[63076]: Accepted publickey for root from 192.168.204.25 port 41410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:53 oleg425-client systemd[1]: Started Session 324 of user root. May 25 04:31:53 oleg425-client systemd-logind[1020]: New session 324 of user root. May 25 04:31:53 oleg425-client sshd[63076]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:54 oleg425-client sshd[63089]: Received disconnect from 192.168.204.25 port 41410:11: disconnected by user May 25 04:31:54 oleg425-client sshd[63089]: Disconnected from user root 192.168.204.25 port 41410 May 25 04:31:54 oleg425-client sshd[63076]: pam_unix(sshd:session): session closed for user root May 25 04:31:54 oleg425-client systemd[1]: session-324.scope: Succeeded. May 25 04:31:54 oleg425-client systemd-logind[1020]: Session 324 logged out. Waiting for processes to exit. May 25 04:31:54 oleg425-client systemd-logind[1020]: Removed session 324. May 25 04:31:55 oleg425-client sshd[63229]: Accepted publickey for root from 192.168.204.25 port 42254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:55 oleg425-client systemd[1]: Started Session 325 of user root. May 25 04:31:55 oleg425-client systemd-logind[1020]: New session 325 of user root. May 25 04:31:55 oleg425-client sshd[63229]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:56 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 04:31:54 (1779697914) May 25 04:31:56 oleg425-client sshd[63242]: Received disconnect from 192.168.204.25 port 42254:11: disconnected by user May 25 04:31:56 oleg425-client sshd[63242]: Disconnected from user root 192.168.204.25 port 42254 May 25 04:31:56 oleg425-client sshd[63229]: pam_unix(sshd:session): session closed for user root May 25 04:31:56 oleg425-client systemd[1]: session-325.scope: Succeeded. May 25 04:31:56 oleg425-client systemd-logind[1020]: Session 325 logged out. Waiting for processes to exit. May 25 04:31:56 oleg425-client systemd-logind[1020]: Removed session 325. May 25 04:32:32 oleg425-client sshd[63564]: Accepted publickey for root from 192.168.204.25 port 42438 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:33 oleg425-client systemd[1]: Started Session 326 of user root. May 25 04:32:33 oleg425-client systemd-logind[1020]: New session 326 of user root. May 25 04:32:33 oleg425-client sshd[63564]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:33 oleg425-client sshd[63577]: Received disconnect from 192.168.204.25 port 42438:11: disconnected by user May 25 04:32:33 oleg425-client sshd[63577]: Disconnected from user root 192.168.204.25 port 42438 May 25 04:32:33 oleg425-client sshd[63564]: pam_unix(sshd:session): session closed for user root May 25 04:32:33 oleg425-client systemd-logind[1020]: Session 326 logged out. Waiting for processes to exit. May 25 04:32:33 oleg425-client systemd[1]: session-326.scope: Succeeded. May 25 04:32:33 oleg425-client systemd-logind[1020]: Removed session 326. May 25 04:32:37 oleg425-client sshd[63799]: Accepted publickey for root from 192.168.204.25 port 57420 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:37 oleg425-client systemd[1]: Started Session 327 of user root. May 25 04:32:37 oleg425-client systemd-logind[1020]: New session 327 of user root. May 25 04:32:37 oleg425-client sshd[63799]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:37 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:32:37 oleg425-client sshd[63813]: Received disconnect from 192.168.204.25 port 57420:11: disconnected by user May 25 04:32:37 oleg425-client sshd[63813]: Disconnected from user root 192.168.204.25 port 57420 May 25 04:32:37 oleg425-client sshd[63799]: pam_unix(sshd:session): session closed for user root May 25 04:32:37 oleg425-client systemd[1]: session-327.scope: Succeeded. May 25 04:32:37 oleg425-client systemd-logind[1020]: Session 327 logged out. Waiting for processes to exit. May 25 04:32:37 oleg425-client systemd-logind[1020]: Removed session 327. May 25 04:32:38 oleg425-client sshd[63954]: Accepted publickey for root from 192.168.204.25 port 57426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:39 oleg425-client systemd-logind[1020]: New session 328 of user root. May 25 04:32:39 oleg425-client systemd[1]: Started Session 328 of user root. May 25 04:32:39 oleg425-client sshd[63954]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:39 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:32:39 oleg425-client sshd[63968]: Received disconnect from 192.168.204.25 port 57426:11: disconnected by user May 25 04:32:39 oleg425-client sshd[63968]: Disconnected from user root 192.168.204.25 port 57426 May 25 04:32:39 oleg425-client sshd[63954]: pam_unix(sshd:session): session closed for user root May 25 04:32:39 oleg425-client systemd[1]: session-328.scope: Succeeded. May 25 04:32:39 oleg425-client systemd-logind[1020]: Session 328 logged out. Waiting for processes to exit. May 25 04:32:39 oleg425-client systemd-logind[1020]: Removed session 328. May 25 04:32:41 oleg425-client sshd[64009]: Accepted publickey for root from 192.168.204.25 port 57434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:41 oleg425-client systemd-logind[1020]: New session 329 of user root. May 25 04:32:41 oleg425-client systemd[1]: Started Session 329 of user root. May 25 04:32:41 oleg425-client sshd[64009]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:41 oleg425-client sshd[64022]: Received disconnect from 192.168.204.25 port 57434:11: disconnected by user May 25 04:32:41 oleg425-client sshd[64022]: Disconnected from user root 192.168.204.25 port 57434 May 25 04:32:41 oleg425-client sshd[64009]: pam_unix(sshd:session): session closed for user root May 25 04:32:41 oleg425-client systemd-logind[1020]: Session 329 logged out. Waiting for processes to exit. May 25 04:32:41 oleg425-client systemd[1]: session-329.scope: Succeeded. May 25 04:32:41 oleg425-client systemd-logind[1020]: Removed session 329. May 25 04:32:45 oleg425-client sshd[64173]: Accepted publickey for root from 192.168.204.25 port 48492 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:45 oleg425-client systemd-logind[1020]: New session 330 of user root. May 25 04:32:45 oleg425-client systemd[1]: Started Session 330 of user root. May 25 04:32:45 oleg425-client sshd[64173]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:45 oleg425-client sshd[64186]: Received disconnect from 192.168.204.25 port 48492:11: disconnected by user May 25 04:32:45 oleg425-client sshd[64186]: Disconnected from user root 192.168.204.25 port 48492 May 25 04:32:45 oleg425-client sshd[64173]: pam_unix(sshd:session): session closed for user root May 25 04:32:45 oleg425-client systemd[1]: session-330.scope: Succeeded. May 25 04:32:45 oleg425-client systemd-logind[1020]: Session 330 logged out. Waiting for processes to exit. May 25 04:32:45 oleg425-client systemd-logind[1020]: Removed session 330. May 25 04:32:46 oleg425-client sshd[64310]: Accepted publickey for root from 192.168.204.25 port 48500 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:46 oleg425-client systemd[1]: Started Session 331 of user root. May 25 04:32:46 oleg425-client systemd-logind[1020]: New session 331 of user root. May 25 04:32:46 oleg425-client sshd[64310]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:47 oleg425-client sshd[64323]: Received disconnect from 192.168.204.25 port 48500:11: disconnected by user May 25 04:32:47 oleg425-client sshd[64323]: Disconnected from user root 192.168.204.25 port 48500 May 25 04:32:47 oleg425-client sshd[64310]: pam_unix(sshd:session): session closed for user root May 25 04:32:47 oleg425-client systemd-logind[1020]: Session 331 logged out. Waiting for processes to exit. May 25 04:32:47 oleg425-client systemd[1]: session-331.scope: Succeeded. May 25 04:32:47 oleg425-client systemd-logind[1020]: Removed session 331. May 25 04:32:48 oleg425-client sshd[64454]: Accepted publickey for root from 192.168.204.25 port 48514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:48 oleg425-client systemd[1]: Started Session 332 of user root. May 25 04:32:48 oleg425-client systemd-logind[1020]: New session 332 of user root. May 25 04:32:48 oleg425-client sshd[64454]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:48 oleg425-client sshd[64467]: Received disconnect from 192.168.204.25 port 48514:11: disconnected by user May 25 04:32:48 oleg425-client sshd[64467]: Disconnected from user root 192.168.204.25 port 48514 May 25 04:32:48 oleg425-client sshd[64454]: pam_unix(sshd:session): session closed for user root May 25 04:32:49 oleg425-client systemd-logind[1020]: Session 332 logged out. Waiting for processes to exit. May 25 04:32:49 oleg425-client systemd[1]: session-332.scope: Succeeded. May 25 04:32:49 oleg425-client systemd-logind[1020]: Removed session 332. May 25 04:32:51 oleg425-client sshd[64609]: Accepted publickey for root from 192.168.204.25 port 48522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:51 oleg425-client systemd-logind[1020]: New session 333 of user root. May 25 04:32:51 oleg425-client systemd[1]: Started Session 333 of user root. May 25 04:32:51 oleg425-client sshd[64609]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:51 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 04:32:49 (1779697969) May 25 04:32:52 oleg425-client sshd[64622]: Received disconnect from 192.168.204.25 port 48522:11: disconnected by user May 25 04:32:52 oleg425-client sshd[64622]: Disconnected from user root 192.168.204.25 port 48522 May 25 04:32:52 oleg425-client sshd[64609]: pam_unix(sshd:session): session closed for user root May 25 04:32:52 oleg425-client systemd-logind[1020]: Session 333 logged out. Waiting for processes to exit. May 25 04:32:52 oleg425-client systemd[1]: session-333.scope: Succeeded. May 25 04:32:52 oleg425-client systemd-logind[1020]: Removed session 333. May 25 04:33:54 oleg425-client sshd[64957]: Accepted publickey for root from 192.168.204.25 port 48114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:54 oleg425-client systemd[1]: Started Session 334 of user root. May 25 04:33:54 oleg425-client systemd-logind[1020]: New session 334 of user root. May 25 04:33:54 oleg425-client sshd[64957]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:55 oleg425-client sshd[64970]: Received disconnect from 192.168.204.25 port 48114:11: disconnected by user May 25 04:33:55 oleg425-client sshd[64970]: Disconnected from user root 192.168.204.25 port 48114 May 25 04:33:55 oleg425-client sshd[64957]: pam_unix(sshd:session): session closed for user root May 25 04:33:55 oleg425-client systemd[1]: session-334.scope: Succeeded. May 25 04:33:55 oleg425-client systemd-logind[1020]: Session 334 logged out. Waiting for processes to exit. May 25 04:33:55 oleg425-client systemd-logind[1020]: Removed session 334. May 25 04:33:58 oleg425-client sshd[65191]: Accepted publickey for root from 192.168.204.25 port 48130 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:58 oleg425-client systemd-logind[1020]: New session 335 of user root. May 25 04:33:58 oleg425-client systemd[1]: Started Session 335 of user root. May 25 04:33:58 oleg425-client sshd[65191]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:59 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:33:59 oleg425-client sshd[65204]: Received disconnect from 192.168.204.25 port 48130:11: disconnected by user May 25 04:33:59 oleg425-client sshd[65204]: Disconnected from user root 192.168.204.25 port 48130 May 25 04:33:59 oleg425-client sshd[65191]: pam_unix(sshd:session): session closed for user root May 25 04:33:59 oleg425-client systemd[1]: session-335.scope: Succeeded. May 25 04:33:59 oleg425-client systemd-logind[1020]: Session 335 logged out. Waiting for processes to exit. May 25 04:33:59 oleg425-client systemd-logind[1020]: Removed session 335. May 25 04:34:00 oleg425-client sshd[65346]: Accepted publickey for root from 192.168.204.25 port 48140 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:01 oleg425-client systemd-logind[1020]: New session 336 of user root. May 25 04:34:01 oleg425-client systemd[1]: Started Session 336 of user root. May 25 04:34:01 oleg425-client sshd[65346]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:01 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:34:01 oleg425-client sshd[65359]: Received disconnect from 192.168.204.25 port 48140:11: disconnected by user May 25 04:34:01 oleg425-client sshd[65359]: Disconnected from user root 192.168.204.25 port 48140 May 25 04:34:01 oleg425-client sshd[65346]: pam_unix(sshd:session): session closed for user root May 25 04:34:01 oleg425-client systemd[1]: session-336.scope: Succeeded. May 25 04:34:01 oleg425-client systemd-logind[1020]: Session 336 logged out. Waiting for processes to exit. May 25 04:34:01 oleg425-client systemd-logind[1020]: Removed session 336. May 25 04:34:02 oleg425-client sshd[65400]: Accepted publickey for root from 192.168.204.25 port 48148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:03 oleg425-client systemd-logind[1020]: New session 337 of user root. May 25 04:34:03 oleg425-client systemd[1]: Started Session 337 of user root. May 25 04:34:03 oleg425-client sshd[65400]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:03 oleg425-client sshd[65413]: Received disconnect from 192.168.204.25 port 48148:11: disconnected by user May 25 04:34:03 oleg425-client sshd[65413]: Disconnected from user root 192.168.204.25 port 48148 May 25 04:34:03 oleg425-client sshd[65400]: pam_unix(sshd:session): session closed for user root May 25 04:34:03 oleg425-client systemd-logind[1020]: Session 337 logged out. Waiting for processes to exit. May 25 04:34:03 oleg425-client systemd[1]: session-337.scope: Succeeded. May 25 04:34:03 oleg425-client systemd-logind[1020]: Removed session 337. May 25 04:34:04 oleg425-client sshd[65530]: Accepted publickey for root from 192.168.204.25 port 59966 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:04 oleg425-client systemd-logind[1020]: New session 338 of user root. May 25 04:34:04 oleg425-client systemd[1]: Started Session 338 of user root. May 25 04:34:04 oleg425-client sshd[65530]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:05 oleg425-client sshd[65543]: Received disconnect from 192.168.204.25 port 59966:11: disconnected by user May 25 04:34:05 oleg425-client sshd[65543]: Disconnected from user root 192.168.204.25 port 59966 May 25 04:34:05 oleg425-client sshd[65530]: pam_unix(sshd:session): session closed for user root May 25 04:34:05 oleg425-client systemd-logind[1020]: Session 338 logged out. Waiting for processes to exit. May 25 04:34:05 oleg425-client systemd[1]: session-338.scope: Succeeded. May 25 04:34:05 oleg425-client systemd-logind[1020]: Removed session 338. May 25 04:34:06 oleg425-client sshd[65667]: Accepted publickey for root from 192.168.204.25 port 59978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:06 oleg425-client systemd-logind[1020]: New session 339 of user root. May 25 04:34:06 oleg425-client systemd[1]: Started Session 339 of user root. May 25 04:34:06 oleg425-client sshd[65667]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:06 oleg425-client sshd[65681]: Received disconnect from 192.168.204.25 port 59978:11: disconnected by user May 25 04:34:06 oleg425-client sshd[65681]: Disconnected from user root 192.168.204.25 port 59978 May 25 04:34:06 oleg425-client sshd[65667]: pam_unix(sshd:session): session closed for user root May 25 04:34:07 oleg425-client systemd-logind[1020]: Session 339 logged out. Waiting for processes to exit. May 25 04:34:07 oleg425-client systemd[1]: session-339.scope: Succeeded. May 25 04:34:07 oleg425-client systemd-logind[1020]: Removed session 339. May 25 04:34:08 oleg425-client sshd[65812]: Accepted publickey for root from 192.168.204.25 port 59990 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:08 oleg425-client systemd-logind[1020]: New session 340 of user root. May 25 04:34:08 oleg425-client systemd[1]: Started Session 340 of user root. May 25 04:34:08 oleg425-client sshd[65812]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:08 oleg425-client sshd[65825]: Received disconnect from 192.168.204.25 port 59990:11: disconnected by user May 25 04:34:08 oleg425-client sshd[65825]: Disconnected from user root 192.168.204.25 port 59990 May 25 04:34:08 oleg425-client sshd[65812]: pam_unix(sshd:session): session closed for user root May 25 04:34:08 oleg425-client systemd[1]: session-340.scope: Succeeded. May 25 04:34:08 oleg425-client systemd-logind[1020]: Session 340 logged out. Waiting for processes to exit. May 25 04:34:08 oleg425-client systemd-logind[1020]: Removed session 340. May 25 04:34:10 oleg425-client sshd[65966]: Accepted publickey for root from 192.168.204.25 port 60006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:10 oleg425-client systemd-logind[1020]: New session 341 of user root. May 25 04:34:10 oleg425-client systemd[1]: Started Session 341 of user root. May 25 04:34:10 oleg425-client sshd[65966]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:10 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 04:34:09 (1779698049) May 25 04:34:10 oleg425-client sshd[65979]: Received disconnect from 192.168.204.25 port 60006:11: disconnected by user May 25 04:34:10 oleg425-client sshd[65979]: Disconnected from user root 192.168.204.25 port 60006 May 25 04:34:11 oleg425-client sshd[65966]: pam_unix(sshd:session): session closed for user root May 25 04:34:11 oleg425-client systemd[1]: session-341.scope: Succeeded. May 25 04:34:11 oleg425-client systemd-logind[1020]: Session 341 logged out. Waiting for processes to exit. May 25 04:34:11 oleg425-client systemd-logind[1020]: Removed session 341. May 25 04:34:48 oleg425-client sshd[66298]: Accepted publickey for root from 192.168.204.25 port 46350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:48 oleg425-client systemd-logind[1020]: New session 342 of user root. May 25 04:34:48 oleg425-client systemd[1]: Started Session 342 of user root. May 25 04:34:48 oleg425-client sshd[66298]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:49 oleg425-client sshd[66311]: Received disconnect from 192.168.204.25 port 46350:11: disconnected by user May 25 04:34:49 oleg425-client sshd[66311]: Disconnected from user root 192.168.204.25 port 46350 May 25 04:34:49 oleg425-client sshd[66298]: pam_unix(sshd:session): session closed for user root May 25 04:34:49 oleg425-client systemd[1]: session-342.scope: Succeeded. May 25 04:34:49 oleg425-client systemd-logind[1020]: Session 342 logged out. Waiting for processes to exit. May 25 04:34:49 oleg425-client systemd-logind[1020]: Removed session 342. May 25 04:34:53 oleg425-client sshd[66534]: Accepted publickey for root from 192.168.204.25 port 46352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:53 oleg425-client systemd-logind[1020]: New session 343 of user root. May 25 04:34:53 oleg425-client systemd[1]: Started Session 343 of user root. May 25 04:34:53 oleg425-client sshd[66534]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:53 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:34:53 oleg425-client sshd[66547]: Received disconnect from 192.168.204.25 port 46352:11: disconnected by user May 25 04:34:53 oleg425-client sshd[66547]: Disconnected from user root 192.168.204.25 port 46352 May 25 04:34:54 oleg425-client sshd[66534]: pam_unix(sshd:session): session closed for user root May 25 04:34:54 oleg425-client systemd[1]: session-343.scope: Succeeded. May 25 04:34:54 oleg425-client systemd-logind[1020]: Session 343 logged out. Waiting for processes to exit. May 25 04:34:54 oleg425-client systemd-logind[1020]: Removed session 343. May 25 04:34:55 oleg425-client sshd[66689]: Accepted publickey for root from 192.168.204.25 port 51852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:55 oleg425-client systemd-logind[1020]: New session 344 of user root. May 25 04:34:55 oleg425-client systemd[1]: Started Session 344 of user root. May 25 04:34:55 oleg425-client sshd[66689]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:55 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:34:55 oleg425-client sshd[66702]: Received disconnect from 192.168.204.25 port 51852:11: disconnected by user May 25 04:34:55 oleg425-client sshd[66702]: Disconnected from user root 192.168.204.25 port 51852 May 25 04:34:55 oleg425-client sshd[66689]: pam_unix(sshd:session): session closed for user root May 25 04:34:56 oleg425-client systemd[1]: session-344.scope: Succeeded. May 25 04:34:56 oleg425-client systemd-logind[1020]: Session 344 logged out. Waiting for processes to exit. May 25 04:34:56 oleg425-client systemd-logind[1020]: Removed session 344. May 25 04:34:57 oleg425-client sshd[66743]: Accepted publickey for root from 192.168.204.25 port 51868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:34:57 oleg425-client systemd-logind[1020]: New session 345 of user root. May 25 04:34:57 oleg425-client systemd[1]: Started Session 345 of user root. May 25 04:34:57 oleg425-client sshd[66743]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:34:57 oleg425-client sshd[66757]: Received disconnect from 192.168.204.25 port 51868:11: disconnected by user May 25 04:34:57 oleg425-client sshd[66757]: Disconnected from user root 192.168.204.25 port 51868 May 25 04:34:57 oleg425-client sshd[66743]: pam_unix(sshd:session): session closed for user root May 25 04:34:58 oleg425-client systemd-logind[1020]: Session 345 logged out. Waiting for processes to exit. May 25 04:34:58 oleg425-client systemd[1]: session-345.scope: Succeeded. May 25 04:34:58 oleg425-client systemd-logind[1020]: Removed session 345. May 25 04:35:01 oleg425-client anacron[47878]: Job `cron.weekly' started May 25 04:35:01 oleg425-client anacron[47878]: Job `cron.weekly' terminated May 25 04:35:03 oleg425-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 04:35:03 oleg425-client kernel: LustreError: 66850:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b18049000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:35:03 oleg425-client kernel: LustreError: 66850:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:35:03 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:35:50 oleg425-client sshd[67313]: Accepted publickey for root from 192.168.204.25 port 44416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:35:50 oleg425-client systemd-logind[1020]: New session 346 of user root. May 25 04:35:50 oleg425-client systemd[1]: Started Session 346 of user root. May 25 04:35:50 oleg425-client sshd[67313]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:35:50 oleg425-client sshd[67326]: Received disconnect from 192.168.204.25 port 44416:11: disconnected by user May 25 04:35:50 oleg425-client sshd[67326]: Disconnected from user root 192.168.204.25 port 44416 May 25 04:35:50 oleg425-client sshd[67313]: pam_unix(sshd:session): session closed for user root May 25 04:35:50 oleg425-client systemd[1]: session-346.scope: Succeeded. May 25 04:35:50 oleg425-client systemd-logind[1020]: Session 346 logged out. Waiting for processes to exit. May 25 04:35:51 oleg425-client systemd-logind[1020]: Removed session 346. May 25 04:35:54 oleg425-client sshd[67549]: Accepted publickey for root from 192.168.204.25 port 46856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:35:54 oleg425-client systemd-logind[1020]: New session 347 of user root. May 25 04:35:54 oleg425-client systemd[1]: Started Session 347 of user root. May 25 04:35:54 oleg425-client sshd[67549]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:35:54 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:35:54 oleg425-client sshd[67562]: Received disconnect from 192.168.204.25 port 46856:11: disconnected by user May 25 04:35:54 oleg425-client sshd[67562]: Disconnected from user root 192.168.204.25 port 46856 May 25 04:35:54 oleg425-client sshd[67549]: pam_unix(sshd:session): session closed for user root May 25 04:35:54 oleg425-client systemd[1]: session-347.scope: Succeeded. May 25 04:35:54 oleg425-client systemd-logind[1020]: Session 347 logged out. Waiting for processes to exit. May 25 04:35:54 oleg425-client systemd-logind[1020]: Removed session 347. May 25 04:35:56 oleg425-client sshd[67611]: Accepted publickey for root from 192.168.204.25 port 46858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:35:56 oleg425-client systemd-logind[1020]: New session 348 of user root. May 25 04:35:56 oleg425-client systemd[1]: Started Session 348 of user root. May 25 04:35:56 oleg425-client sshd[67611]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:35:56 oleg425-client sshd[67624]: Received disconnect from 192.168.204.25 port 46858:11: disconnected by user May 25 04:35:56 oleg425-client sshd[67624]: Disconnected from user root 192.168.204.25 port 46858 May 25 04:35:56 oleg425-client sshd[67611]: pam_unix(sshd:session): session closed for user root May 25 04:35:57 oleg425-client systemd[1]: session-348.scope: Succeeded. May 25 04:35:57 oleg425-client systemd-logind[1020]: Session 348 logged out. Waiting for processes to exit. May 25 04:35:57 oleg425-client systemd-logind[1020]: Removed session 348. May 25 04:35:57 oleg425-client systemd-udevd[67694]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:35:57 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:35:59 oleg425-client sshd[67809]: Accepted publickey for root from 192.168.204.25 port 46872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:35:59 oleg425-client systemd-logind[1020]: New session 349 of user root. May 25 04:35:59 oleg425-client systemd[1]: Started Session 349 of user root. May 25 04:35:59 oleg425-client sshd[67809]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:35:59 oleg425-client sshd[67822]: Received disconnect from 192.168.204.25 port 46872:11: disconnected by user May 25 04:35:59 oleg425-client sshd[67822]: Disconnected from user root 192.168.204.25 port 46872 May 25 04:35:59 oleg425-client sshd[67809]: pam_unix(sshd:session): session closed for user root May 25 04:35:59 oleg425-client systemd-logind[1020]: Session 349 logged out. Waiting for processes to exit. May 25 04:35:59 oleg425-client systemd[1]: session-349.scope: Succeeded. May 25 04:35:59 oleg425-client systemd-logind[1020]: Removed session 349. May 25 04:36:00 oleg425-client sshd[67946]: Accepted publickey for root from 192.168.204.25 port 46886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:00 oleg425-client systemd-logind[1020]: New session 350 of user root. May 25 04:36:00 oleg425-client systemd[1]: Started Session 350 of user root. May 25 04:36:00 oleg425-client sshd[67946]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:01 oleg425-client sshd[67959]: Received disconnect from 192.168.204.25 port 46886:11: disconnected by user May 25 04:36:01 oleg425-client sshd[67959]: Disconnected from user root 192.168.204.25 port 46886 May 25 04:36:01 oleg425-client sshd[67946]: pam_unix(sshd:session): session closed for user root May 25 04:36:01 oleg425-client systemd[1]: session-350.scope: Succeeded. May 25 04:36:01 oleg425-client systemd-logind[1020]: Session 350 logged out. Waiting for processes to exit. May 25 04:36:01 oleg425-client systemd-logind[1020]: Removed session 350. May 25 04:36:03 oleg425-client sshd[68090]: Accepted publickey for root from 192.168.204.25 port 46900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:03 oleg425-client systemd-logind[1020]: New session 351 of user root. May 25 04:36:03 oleg425-client systemd[1]: Started Session 351 of user root. May 25 04:36:03 oleg425-client sshd[68090]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:03 oleg425-client sshd[68103]: Received disconnect from 192.168.204.25 port 46900:11: disconnected by user May 25 04:36:03 oleg425-client sshd[68103]: Disconnected from user root 192.168.204.25 port 46900 May 25 04:36:03 oleg425-client sshd[68090]: pam_unix(sshd:session): session closed for user root May 25 04:36:03 oleg425-client systemd[1]: session-351.scope: Succeeded. May 25 04:36:03 oleg425-client systemd-logind[1020]: Session 351 logged out. Waiting for processes to exit. May 25 04:36:03 oleg425-client systemd-logind[1020]: Removed session 351. May 25 04:36:05 oleg425-client sshd[68244]: Accepted publickey for root from 192.168.204.25 port 35586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:05 oleg425-client systemd-logind[1020]: New session 352 of user root. May 25 04:36:05 oleg425-client systemd[1]: Started Session 352 of user root. May 25 04:36:05 oleg425-client sshd[68244]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:05 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 04:36:04 (1779698164) May 25 04:36:05 oleg425-client sshd[68257]: Received disconnect from 192.168.204.25 port 35586:11: disconnected by user May 25 04:36:05 oleg425-client sshd[68257]: Disconnected from user root 192.168.204.25 port 35586 May 25 04:36:05 oleg425-client sshd[68244]: pam_unix(sshd:session): session closed for user root May 25 04:36:06 oleg425-client systemd[1]: session-352.scope: Succeeded. May 25 04:36:06 oleg425-client systemd-logind[1020]: Session 352 logged out. Waiting for processes to exit. May 25 04:36:06 oleg425-client systemd-logind[1020]: Removed session 352. May 25 04:36:08 oleg425-client sshd[68405]: Accepted publickey for root from 192.168.204.25 port 35598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:08 oleg425-client systemd-logind[1020]: New session 353 of user root. May 25 04:36:08 oleg425-client systemd[1]: Started Session 353 of user root. May 25 04:36:08 oleg425-client sshd[68405]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:09 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds May 25 04:36:09 oleg425-client sshd[68419]: Received disconnect from 192.168.204.25 port 35598:11: disconnected by user May 25 04:36:09 oleg425-client sshd[68419]: Disconnected from user root 192.168.204.25 port 35598 May 25 04:36:09 oleg425-client sshd[68405]: pam_unix(sshd:session): session closed for user root May 25 04:36:09 oleg425-client systemd-logind[1020]: Session 353 logged out. Waiting for processes to exit. May 25 04:36:09 oleg425-client systemd[1]: session-353.scope: Succeeded. May 25 04:36:09 oleg425-client systemd-logind[1020]: Removed session 353. May 25 04:36:11 oleg425-client sshd[68558]: Accepted publickey for root from 192.168.204.25 port 35612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:11 oleg425-client systemd-logind[1020]: New session 354 of user root. May 25 04:36:11 oleg425-client systemd[1]: Started Session 354 of user root. May 25 04:36:11 oleg425-client sshd[68558]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:12 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 04:36:09 (1779698169) May 25 04:36:12 oleg425-client sshd[68571]: Received disconnect from 192.168.204.25 port 35612:11: disconnected by user May 25 04:36:12 oleg425-client sshd[68571]: Disconnected from user root 192.168.204.25 port 35612 May 25 04:36:12 oleg425-client sshd[68558]: pam_unix(sshd:session): session closed for user root May 25 04:36:12 oleg425-client systemd-logind[1020]: Session 354 logged out. Waiting for processes to exit. May 25 04:36:12 oleg425-client systemd[1]: session-354.scope: Succeeded. May 25 04:36:12 oleg425-client systemd-logind[1020]: Removed session 354. May 25 04:36:34 oleg425-client sshd[68854]: Accepted publickey for root from 192.168.204.25 port 39082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:34 oleg425-client systemd-logind[1020]: New session 355 of user root. May 25 04:36:34 oleg425-client systemd[1]: Started Session 355 of user root. May 25 04:36:34 oleg425-client sshd[68854]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:35 oleg425-client sshd[68867]: Received disconnect from 192.168.204.25 port 39082:11: disconnected by user May 25 04:36:35 oleg425-client sshd[68867]: Disconnected from user root 192.168.204.25 port 39082 May 25 04:36:35 oleg425-client sshd[68854]: pam_unix(sshd:session): session closed for user root May 25 04:36:35 oleg425-client systemd-logind[1020]: Session 355 logged out. Waiting for processes to exit. May 25 04:36:35 oleg425-client systemd[1]: session-355.scope: Succeeded. May 25 04:36:35 oleg425-client systemd-logind[1020]: Removed session 355. May 25 04:36:38 oleg425-client sshd[69003]: Accepted publickey for root from 192.168.204.25 port 39088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:38 oleg425-client systemd-logind[1020]: New session 356 of user root. May 25 04:36:38 oleg425-client systemd[1]: Started Session 356 of user root. May 25 04:36:38 oleg425-client sshd[69003]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:38 oleg425-client sshd[69016]: Received disconnect from 192.168.204.25 port 39088:11: disconnected by user May 25 04:36:38 oleg425-client sshd[69016]: Disconnected from user root 192.168.204.25 port 39088 May 25 04:36:38 oleg425-client sshd[69003]: pam_unix(sshd:session): session closed for user root May 25 04:36:38 oleg425-client systemd-logind[1020]: Session 356 logged out. Waiting for processes to exit. May 25 04:36:38 oleg425-client systemd[1]: session-356.scope: Succeeded. May 25 04:36:38 oleg425-client systemd-logind[1020]: Removed session 356. May 25 04:36:39 oleg425-client sshd[69141]: Accepted publickey for root from 192.168.204.25 port 39100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:39 oleg425-client systemd-logind[1020]: New session 357 of user root. May 25 04:36:39 oleg425-client systemd[1]: Started Session 357 of user root. May 25 04:36:39 oleg425-client sshd[69141]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:39 oleg425-client sshd[69154]: Received disconnect from 192.168.204.25 port 39100:11: disconnected by user May 25 04:36:39 oleg425-client sshd[69154]: Disconnected from user root 192.168.204.25 port 39100 May 25 04:36:39 oleg425-client sshd[69141]: pam_unix(sshd:session): session closed for user root May 25 04:36:40 oleg425-client systemd[1]: session-357.scope: Succeeded. May 25 04:36:40 oleg425-client systemd-logind[1020]: Session 357 logged out. Waiting for processes to exit. May 25 04:36:40 oleg425-client systemd-logind[1020]: Removed session 357. May 25 04:36:40 oleg425-client sshd[69285]: Accepted publickey for root from 192.168.204.25 port 39106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:41 oleg425-client systemd[1]: Started Session 358 of user root. May 25 04:36:41 oleg425-client systemd-logind[1020]: New session 358 of user root. May 25 04:36:41 oleg425-client sshd[69285]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:41 oleg425-client sshd[69298]: Received disconnect from 192.168.204.25 port 39106:11: disconnected by user May 25 04:36:41 oleg425-client sshd[69298]: Disconnected from user root 192.168.204.25 port 39106 May 25 04:36:41 oleg425-client sshd[69285]: pam_unix(sshd:session): session closed for user root May 25 04:36:41 oleg425-client systemd-logind[1020]: Session 358 logged out. Waiting for processes to exit. May 25 04:36:41 oleg425-client systemd[1]: session-358.scope: Succeeded. May 25 04:36:41 oleg425-client systemd-logind[1020]: Removed session 358. May 25 04:36:43 oleg425-client sshd[69438]: Accepted publickey for root from 192.168.204.25 port 39114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:43 oleg425-client systemd-logind[1020]: New session 359 of user root. May 25 04:36:43 oleg425-client systemd[1]: Started Session 359 of user root. May 25 04:36:43 oleg425-client sshd[69438]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:44 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 04:36:41 (1779698201) May 25 04:36:44 oleg425-client sshd[69451]: Received disconnect from 192.168.204.25 port 39114:11: disconnected by user May 25 04:36:44 oleg425-client sshd[69451]: Disconnected from user root 192.168.204.25 port 39114 May 25 04:36:44 oleg425-client sshd[69438]: pam_unix(sshd:session): session closed for user root May 25 04:36:44 oleg425-client systemd[1]: session-359.scope: Succeeded. May 25 04:36:44 oleg425-client systemd-logind[1020]: Session 359 logged out. Waiting for processes to exit. May 25 04:36:44 oleg425-client systemd-logind[1020]: Removed session 359. May 25 04:36:45 oleg425-client sshd[69575]: Accepted publickey for root from 192.168.204.25 port 43232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:45 oleg425-client systemd[1]: Started Session 360 of user root. May 25 04:36:45 oleg425-client systemd-logind[1020]: New session 360 of user root. May 25 04:36:45 oleg425-client sshd[69575]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:46 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients May 25 04:36:46 oleg425-client sshd[69588]: Received disconnect from 192.168.204.25 port 43232:11: disconnected by user May 25 04:36:46 oleg425-client sshd[69588]: Disconnected from user root 192.168.204.25 port 43232 May 25 04:36:46 oleg425-client sshd[69575]: pam_unix(sshd:session): session closed for user root May 25 04:36:46 oleg425-client systemd-logind[1020]: Session 360 logged out. Waiting for processes to exit. May 25 04:36:46 oleg425-client systemd[1]: session-360.scope: Succeeded. May 25 04:36:46 oleg425-client systemd-logind[1020]: Removed session 360. May 25 04:36:48 oleg425-client sshd[69727]: Accepted publickey for root from 192.168.204.25 port 43236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:36:48 oleg425-client systemd[1]: Started Session 361 of user root. May 25 04:36:48 oleg425-client systemd-logind[1020]: New session 361 of user root. May 25 04:36:48 oleg425-client sshd[69727]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:36:48 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 04:36:46 (1779698206) May 25 04:36:48 oleg425-client sshd[69740]: Received disconnect from 192.168.204.25 port 43236:11: disconnected by user May 25 04:36:48 oleg425-client sshd[69740]: Disconnected from user root 192.168.204.25 port 43236 May 25 04:36:48 oleg425-client sshd[69727]: pam_unix(sshd:session): session closed for user root May 25 04:36:49 oleg425-client systemd[1]: session-361.scope: Succeeded. May 25 04:36:49 oleg425-client systemd-logind[1020]: Session 361 logged out. Waiting for processes to exit. May 25 04:36:49 oleg425-client systemd-logind[1020]: Removed session 361. May 25 04:36:50 oleg425-client kernel: Lustre: *** cfs_fail_loc=805, val=0*** May 25 04:36:50 oleg425-client systemd-udevd[69810]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:36:50 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:36:57 oleg425-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 04:37:17 oleg425-client kernel: Lustre: 2374:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779698221/real 1779698221] req@ffffa09b0859b100 x1866143445888512/t0(0) o400->lustre-MDT0000-mdc-ffffa09b0ab46800@192.168.204.125@tcp:12/10 lens 224/224 e 0 to 1 dl 1779698237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:37:17 oleg425-client kernel: Lustre: 2374:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 04:37:17 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:37:27 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00b1dadb to 0x799e3d1c00b1dcf6 May 25 04:37:42 oleg425-client kernel: LustreError: 2371:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b21760800: namespace resource [0x200000007:0x1:0x0].0x0 (ffffa09b105c4500) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:37:45 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:37:45 oleg425-client kernel: LustreError: 70186:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b21760800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:37:45 oleg425-client kernel: LustreError: 70186:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:37:45 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:37:46 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:37:50 oleg425-client sshd[70337]: Accepted publickey for root from 192.168.204.25 port 51698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:37:50 oleg425-client systemd-logind[1020]: New session 362 of user root. May 25 04:37:50 oleg425-client systemd[1]: Started Session 362 of user root. May 25 04:37:50 oleg425-client sshd[70337]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:37:50 oleg425-client sshd[70350]: Received disconnect from 192.168.204.25 port 51698:11: disconnected by user May 25 04:37:50 oleg425-client sshd[70350]: Disconnected from user root 192.168.204.25 port 51698 May 25 04:37:50 oleg425-client sshd[70337]: pam_unix(sshd:session): session closed for user root May 25 04:37:50 oleg425-client systemd-logind[1020]: Session 362 logged out. Waiting for processes to exit. May 25 04:37:50 oleg425-client systemd[1]: session-362.scope: Succeeded. May 25 04:37:50 oleg425-client systemd-logind[1020]: Removed session 362. May 25 04:37:51 oleg425-client sshd[70474]: Accepted publickey for root from 192.168.204.25 port 51708 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:37:51 oleg425-client systemd-logind[1020]: New session 363 of user root. May 25 04:37:51 oleg425-client systemd[1]: Started Session 363 of user root. May 25 04:37:51 oleg425-client sshd[70474]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:37:52 oleg425-client sshd[70487]: Received disconnect from 192.168.204.25 port 51708:11: disconnected by user May 25 04:37:52 oleg425-client sshd[70487]: Disconnected from user root 192.168.204.25 port 51708 May 25 04:37:52 oleg425-client sshd[70474]: pam_unix(sshd:session): session closed for user root May 25 04:37:52 oleg425-client systemd-logind[1020]: Session 363 logged out. Waiting for processes to exit. May 25 04:37:52 oleg425-client systemd[1]: session-363.scope: Succeeded. May 25 04:37:52 oleg425-client systemd-logind[1020]: Removed session 363. May 25 04:37:53 oleg425-client sshd[70619]: Accepted publickey for root from 192.168.204.25 port 51710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:37:53 oleg425-client systemd-logind[1020]: New session 364 of user root. May 25 04:37:53 oleg425-client systemd[1]: Started Session 364 of user root. May 25 04:37:53 oleg425-client sshd[70619]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:37:53 oleg425-client sshd[70632]: Received disconnect from 192.168.204.25 port 51710:11: disconnected by user May 25 04:37:53 oleg425-client sshd[70632]: Disconnected from user root 192.168.204.25 port 51710 May 25 04:37:53 oleg425-client sshd[70619]: pam_unix(sshd:session): session closed for user root May 25 04:37:53 oleg425-client systemd[1]: session-364.scope: Succeeded. May 25 04:37:53 oleg425-client systemd-logind[1020]: Session 364 logged out. Waiting for processes to exit. May 25 04:37:53 oleg425-client systemd-logind[1020]: Removed session 364. May 25 04:37:55 oleg425-client sshd[70772]: Accepted publickey for root from 192.168.204.25 port 39286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:37:55 oleg425-client systemd-logind[1020]: New session 365 of user root. May 25 04:37:55 oleg425-client systemd[1]: Started Session 365 of user root. May 25 04:37:55 oleg425-client sshd[70772]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:37:55 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 107: drop reint reply, then restart MDT ========================================================== 04:37:54 (1779698274) May 25 04:37:55 oleg425-client sshd[70785]: Received disconnect from 192.168.204.25 port 39286:11: disconnected by user May 25 04:37:55 oleg425-client sshd[70785]: Disconnected from user root 192.168.204.25 port 39286 May 25 04:37:55 oleg425-client sshd[70772]: pam_unix(sshd:session): session closed for user root May 25 04:37:56 oleg425-client systemd[1]: session-365.scope: Succeeded. May 25 04:37:56 oleg425-client systemd-logind[1020]: Session 365 logged out. Waiting for processes to exit. May 25 04:37:56 oleg425-client systemd-logind[1020]: Removed session 365. May 25 04:38:23 oleg425-client kernel: LustreError: 2371:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffffa09b104fb800 x1866143445900416/t90194313220(90194313220) o101->lustre-MDT0000-mdc-ffffa09b0ab46800@192.168.204.125@tcp:12/10 lens 664/608 e 0 to 0 dl 1779698319 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0 May 25 04:38:28 oleg425-client sshd[71105]: Accepted publickey for root from 192.168.204.25 port 43344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:28 oleg425-client systemd-logind[1020]: New session 366 of user root. May 25 04:38:28 oleg425-client systemd[1]: Started Session 366 of user root. May 25 04:38:28 oleg425-client sshd[71105]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:28 oleg425-client sshd[71119]: Received disconnect from 192.168.204.25 port 43344:11: disconnected by user May 25 04:38:28 oleg425-client sshd[71119]: Disconnected from user root 192.168.204.25 port 43344 May 25 04:38:28 oleg425-client sshd[71105]: pam_unix(sshd:session): session closed for user root May 25 04:38:29 oleg425-client systemd[1]: session-366.scope: Succeeded. May 25 04:38:29 oleg425-client systemd-logind[1020]: Session 366 logged out. Waiting for processes to exit. May 25 04:38:29 oleg425-client systemd-logind[1020]: Removed session 366. May 25 04:38:32 oleg425-client sshd[71341]: Accepted publickey for root from 192.168.204.25 port 43348 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:32 oleg425-client systemd-logind[1020]: New session 367 of user root. May 25 04:38:32 oleg425-client systemd[1]: Started Session 367 of user root. May 25 04:38:32 oleg425-client sshd[71341]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:32 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:38:32 oleg425-client sshd[71354]: Received disconnect from 192.168.204.25 port 43348:11: disconnected by user May 25 04:38:32 oleg425-client sshd[71354]: Disconnected from user root 192.168.204.25 port 43348 May 25 04:38:32 oleg425-client sshd[71341]: pam_unix(sshd:session): session closed for user root May 25 04:38:32 oleg425-client systemd[1]: session-367.scope: Succeeded. May 25 04:38:32 oleg425-client systemd-logind[1020]: Session 367 logged out. Waiting for processes to exit. May 25 04:38:32 oleg425-client systemd-logind[1020]: Removed session 367. May 25 04:38:33 oleg425-client sshd[71496]: Accepted publickey for root from 192.168.204.25 port 43352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:33 oleg425-client systemd[1]: Started Session 368 of user root. May 25 04:38:33 oleg425-client systemd-logind[1020]: New session 368 of user root. May 25 04:38:33 oleg425-client sshd[71496]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:33 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:38:33 oleg425-client sshd[71509]: Received disconnect from 192.168.204.25 port 43352:11: disconnected by user May 25 04:38:33 oleg425-client sshd[71509]: Disconnected from user root 192.168.204.25 port 43352 May 25 04:38:34 oleg425-client sshd[71496]: pam_unix(sshd:session): session closed for user root May 25 04:38:34 oleg425-client systemd[1]: session-368.scope: Succeeded. May 25 04:38:34 oleg425-client systemd-logind[1020]: Session 368 logged out. Waiting for processes to exit. May 25 04:38:34 oleg425-client systemd-logind[1020]: Removed session 368. May 25 04:38:35 oleg425-client sshd[71550]: Accepted publickey for root from 192.168.204.25 port 51158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:35 oleg425-client systemd-logind[1020]: New session 369 of user root. May 25 04:38:35 oleg425-client systemd[1]: Started Session 369 of user root. May 25 04:38:35 oleg425-client sshd[71550]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:35 oleg425-client sshd[71563]: Received disconnect from 192.168.204.25 port 51158:11: disconnected by user May 25 04:38:35 oleg425-client sshd[71563]: Disconnected from user root 192.168.204.25 port 51158 May 25 04:38:35 oleg425-client sshd[71550]: pam_unix(sshd:session): session closed for user root May 25 04:38:36 oleg425-client systemd[1]: session-369.scope: Succeeded. May 25 04:38:36 oleg425-client systemd-logind[1020]: Session 369 logged out. Waiting for processes to exit. May 25 04:38:36 oleg425-client systemd-logind[1020]: Removed session 369. May 25 04:38:36 oleg425-client sshd[71681]: Accepted publickey for root from 192.168.204.25 port 51160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:36 oleg425-client systemd-logind[1020]: New session 370 of user root. May 25 04:38:36 oleg425-client systemd[1]: Started Session 370 of user root. May 25 04:38:36 oleg425-client sshd[71681]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:37 oleg425-client sshd[71694]: Received disconnect from 192.168.204.25 port 51160:11: disconnected by user May 25 04:38:37 oleg425-client sshd[71694]: Disconnected from user root 192.168.204.25 port 51160 May 25 04:38:37 oleg425-client sshd[71681]: pam_unix(sshd:session): session closed for user root May 25 04:38:37 oleg425-client systemd-logind[1020]: Session 370 logged out. Waiting for processes to exit. May 25 04:38:37 oleg425-client systemd[1]: session-370.scope: Succeeded. May 25 04:38:37 oleg425-client systemd-logind[1020]: Removed session 370. May 25 04:38:38 oleg425-client sshd[71819]: Accepted publickey for root from 192.168.204.25 port 51172 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:38 oleg425-client systemd-logind[1020]: New session 371 of user root. May 25 04:38:38 oleg425-client systemd[1]: Started Session 371 of user root. May 25 04:38:38 oleg425-client sshd[71819]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:38 oleg425-client sshd[71832]: Received disconnect from 192.168.204.25 port 51172:11: disconnected by user May 25 04:38:38 oleg425-client sshd[71832]: Disconnected from user root 192.168.204.25 port 51172 May 25 04:38:38 oleg425-client sshd[71819]: pam_unix(sshd:session): session closed for user root May 25 04:38:38 oleg425-client systemd[1]: session-371.scope: Succeeded. May 25 04:38:38 oleg425-client systemd-logind[1020]: Session 371 logged out. Waiting for processes to exit. May 25 04:38:38 oleg425-client systemd-logind[1020]: Removed session 371. May 25 04:38:39 oleg425-client sshd[71963]: Accepted publickey for root from 192.168.204.25 port 51176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:39 oleg425-client systemd-logind[1020]: New session 372 of user root. May 25 04:38:39 oleg425-client systemd[1]: Started Session 372 of user root. May 25 04:38:39 oleg425-client sshd[71963]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:40 oleg425-client sshd[71976]: Received disconnect from 192.168.204.25 port 51176:11: disconnected by user May 25 04:38:40 oleg425-client sshd[71976]: Disconnected from user root 192.168.204.25 port 51176 May 25 04:38:40 oleg425-client sshd[71963]: pam_unix(sshd:session): session closed for user root May 25 04:38:40 oleg425-client systemd-logind[1020]: Session 372 logged out. Waiting for processes to exit. May 25 04:38:40 oleg425-client systemd[1]: session-372.scope: Succeeded. May 25 04:38:40 oleg425-client systemd-logind[1020]: Removed session 372. May 25 04:38:41 oleg425-client sshd[72116]: Accepted publickey for root from 192.168.204.25 port 51184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:41 oleg425-client systemd-logind[1020]: New session 373 of user root. May 25 04:38:41 oleg425-client systemd[1]: Started Session 373 of user root. May 25 04:38:41 oleg425-client sshd[72116]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:41 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 108: client eviction don't crash == 04:38:40 (1779698320) May 25 04:38:41 oleg425-client sshd[72129]: Received disconnect from 192.168.204.25 port 51184:11: disconnected by user May 25 04:38:41 oleg425-client sshd[72129]: Disconnected from user root 192.168.204.25 port 51184 May 25 04:38:41 oleg425-client sshd[72116]: pam_unix(sshd:session): session closed for user root May 25 04:38:41 oleg425-client systemd-logind[1020]: Session 373 logged out. Waiting for processes to exit. May 25 04:38:41 oleg425-client systemd[1]: session-373.scope: Succeeded. May 25 04:38:41 oleg425-client systemd-logind[1020]: Removed session 373. May 25 04:38:42 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab46800: operation ost_write to node 192.168.204.125@tcp failed: rc = -107 May 25 04:38:42 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:38:42 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab46800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 04:38:42 oleg425-client kernel: Lustre: 2372:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.125@tcp:/lustre/fid: [0x20000a042:0x6:0x0]// may get corrupted (rc -5) May 25 04:38:42 oleg425-client kernel: LustreError: 72180:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffffa09b0ab46800: namespace resource [0x240000400:0x4062:0x0].0x0 (ffffa09b104f3d00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:38:42 oleg425-client kernel: LustreError: 72180:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 04:38:44 oleg425-client sshd[72187]: Accepted publickey for root from 192.168.204.25 port 60762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:44 oleg425-client systemd[1]: Started Session 374 of user root. May 25 04:38:44 oleg425-client systemd-logind[1020]: New session 374 of user root. May 25 04:38:44 oleg425-client sshd[72187]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:45 oleg425-client sshd[72200]: Received disconnect from 192.168.204.25 port 60762:11: disconnected by user May 25 04:38:45 oleg425-client sshd[72200]: Disconnected from user root 192.168.204.25 port 60762 May 25 04:38:45 oleg425-client sshd[72187]: pam_unix(sshd:session): session closed for user root May 25 04:38:45 oleg425-client systemd[1]: session-374.scope: Succeeded. May 25 04:38:45 oleg425-client systemd-logind[1020]: Session 374 logged out. Waiting for processes to exit. May 25 04:38:45 oleg425-client systemd-logind[1020]: Removed session 374. May 25 04:38:46 oleg425-client sshd[72318]: Accepted publickey for root from 192.168.204.25 port 60772 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:46 oleg425-client systemd-logind[1020]: New session 375 of user root. May 25 04:38:46 oleg425-client systemd[1]: Started Session 375 of user root. May 25 04:38:46 oleg425-client sshd[72318]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:46 oleg425-client sshd[72331]: Received disconnect from 192.168.204.25 port 60772:11: disconnected by user May 25 04:38:46 oleg425-client sshd[72331]: Disconnected from user root 192.168.204.25 port 60772 May 25 04:38:46 oleg425-client sshd[72318]: pam_unix(sshd:session): session closed for user root May 25 04:38:47 oleg425-client systemd[1]: session-375.scope: Succeeded. May 25 04:38:47 oleg425-client systemd-logind[1020]: Session 375 logged out. Waiting for processes to exit. May 25 04:38:47 oleg425-client systemd-logind[1020]: Removed session 375. May 25 04:38:47 oleg425-client sshd[72455]: Accepted publickey for root from 192.168.204.25 port 60774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:47 oleg425-client systemd-logind[1020]: New session 376 of user root. May 25 04:38:47 oleg425-client systemd[1]: Started Session 376 of user root. May 25 04:38:47 oleg425-client sshd[72455]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:48 oleg425-client sshd[72469]: Received disconnect from 192.168.204.25 port 60774:11: disconnected by user May 25 04:38:48 oleg425-client sshd[72469]: Disconnected from user root 192.168.204.25 port 60774 May 25 04:38:48 oleg425-client sshd[72455]: pam_unix(sshd:session): session closed for user root May 25 04:38:48 oleg425-client systemd[1]: session-376.scope: Succeeded. May 25 04:38:48 oleg425-client systemd-logind[1020]: Session 376 logged out. Waiting for processes to exit. May 25 04:38:48 oleg425-client systemd-logind[1020]: Removed session 376. May 25 04:38:49 oleg425-client sshd[72600]: Accepted publickey for root from 192.168.204.25 port 60784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:49 oleg425-client systemd-logind[1020]: New session 377 of user root. May 25 04:38:49 oleg425-client systemd[1]: Started Session 377 of user root. May 25 04:38:49 oleg425-client sshd[72600]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:49 oleg425-client sshd[72613]: Received disconnect from 192.168.204.25 port 60784:11: disconnected by user May 25 04:38:49 oleg425-client sshd[72613]: Disconnected from user root 192.168.204.25 port 60784 May 25 04:38:49 oleg425-client sshd[72600]: pam_unix(sshd:session): session closed for user root May 25 04:38:49 oleg425-client systemd[1]: session-377.scope: Succeeded. May 25 04:38:49 oleg425-client systemd-logind[1020]: Session 377 logged out. Waiting for processes to exit. May 25 04:38:49 oleg425-client systemd-logind[1020]: Removed session 377. May 25 04:38:51 oleg425-client sshd[72753]: Accepted publickey for root from 192.168.204.25 port 60794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:51 oleg425-client systemd-logind[1020]: New session 378 of user root. May 25 04:38:51 oleg425-client systemd[1]: Started Session 378 of user root. May 25 04:38:51 oleg425-client sshd[72753]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:51 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110a: create remote directory: drop client req ========================================================== 04:38:50 (1779698330) May 25 04:38:51 oleg425-client sshd[72766]: Received disconnect from 192.168.204.25 port 60794:11: disconnected by user May 25 04:38:51 oleg425-client sshd[72766]: Disconnected from user root 192.168.204.25 port 60794 May 25 04:38:51 oleg425-client sshd[72753]: pam_unix(sshd:session): session closed for user root May 25 04:38:51 oleg425-client systemd-logind[1020]: Session 378 logged out. Waiting for processes to exit. May 25 04:38:51 oleg425-client systemd[1]: session-378.scope: Succeeded. May 25 04:38:51 oleg425-client systemd-logind[1020]: Removed session 378. May 25 04:38:52 oleg425-client sshd[72889]: Accepted publickey for root from 192.168.204.25 port 60798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:52 oleg425-client systemd[1]: Started Session 379 of user root. May 25 04:38:52 oleg425-client systemd-logind[1020]: New session 379 of user root. May 25 04:38:52 oleg425-client sshd[72889]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:53 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110a needs >= 2 MDTs May 25 04:38:53 oleg425-client sshd[72902]: Received disconnect from 192.168.204.25 port 60798:11: disconnected by user May 25 04:38:53 oleg425-client sshd[72902]: Disconnected from user root 192.168.204.25 port 60798 May 25 04:38:53 oleg425-client sshd[72889]: pam_unix(sshd:session): session closed for user root May 25 04:38:53 oleg425-client systemd[1]: session-379.scope: Succeeded. May 25 04:38:53 oleg425-client systemd-logind[1020]: Session 379 logged out. Waiting for processes to exit. May 25 04:38:53 oleg425-client systemd-logind[1020]: Removed session 379. May 25 04:38:54 oleg425-client sshd[73042]: Accepted publickey for root from 192.168.204.25 port 57268 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:54 oleg425-client systemd-logind[1020]: New session 380 of user root. May 25 04:38:55 oleg425-client systemd[1]: Started Session 380 of user root. May 25 04:38:55 oleg425-client sshd[73042]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:55 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110b: create remote directory: drop Master rep ========================================================== 04:38:53 (1779698333) May 25 04:38:55 oleg425-client sshd[73055]: Received disconnect from 192.168.204.25 port 57268:11: disconnected by user May 25 04:38:55 oleg425-client sshd[73055]: Disconnected from user root 192.168.204.25 port 57268 May 25 04:38:55 oleg425-client sshd[73042]: pam_unix(sshd:session): session closed for user root May 25 04:38:55 oleg425-client systemd[1]: session-380.scope: Succeeded. May 25 04:38:55 oleg425-client systemd-logind[1020]: Session 380 logged out. Waiting for processes to exit. May 25 04:38:55 oleg425-client systemd-logind[1020]: Removed session 380. May 25 04:38:56 oleg425-client sshd[73178]: Accepted publickey for root from 192.168.204.25 port 57284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:56 oleg425-client systemd-logind[1020]: New session 381 of user root. May 25 04:38:56 oleg425-client systemd[1]: Started Session 381 of user root. May 25 04:38:56 oleg425-client sshd[73178]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:56 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110b needs >= 2 MDTs May 25 04:38:56 oleg425-client sshd[73191]: Received disconnect from 192.168.204.25 port 57284:11: disconnected by user May 25 04:38:56 oleg425-client sshd[73191]: Disconnected from user root 192.168.204.25 port 57284 May 25 04:38:56 oleg425-client sshd[73178]: pam_unix(sshd:session): session closed for user root May 25 04:38:57 oleg425-client systemd-logind[1020]: Session 381 logged out. Waiting for processes to exit. May 25 04:38:57 oleg425-client systemd[1]: session-381.scope: Succeeded. May 25 04:38:57 oleg425-client systemd-logind[1020]: Removed session 381. May 25 04:38:58 oleg425-client sshd[73330]: Accepted publickey for root from 192.168.204.25 port 57298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:58 oleg425-client systemd-logind[1020]: New session 382 of user root. May 25 04:38:58 oleg425-client systemd[1]: Started Session 382 of user root. May 25 04:38:58 oleg425-client sshd[73330]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:58 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110c: create remote directory: drop update rep on slave MDT ========================================================== 04:38:57 (1779698337) May 25 04:38:58 oleg425-client sshd[73344]: Received disconnect from 192.168.204.25 port 57298:11: disconnected by user May 25 04:38:58 oleg425-client sshd[73344]: Disconnected from user root 192.168.204.25 port 57298 May 25 04:38:58 oleg425-client sshd[73330]: pam_unix(sshd:session): session closed for user root May 25 04:38:58 oleg425-client systemd-logind[1020]: Session 382 logged out. Waiting for processes to exit. May 25 04:38:58 oleg425-client systemd[1]: session-382.scope: Succeeded. May 25 04:38:58 oleg425-client systemd-logind[1020]: Removed session 382. May 25 04:38:59 oleg425-client sshd[73467]: Accepted publickey for root from 192.168.204.25 port 57304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:59 oleg425-client systemd-logind[1020]: New session 383 of user root. May 25 04:38:59 oleg425-client systemd[1]: Started Session 383 of user root. May 25 04:38:59 oleg425-client sshd[73467]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:59 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110c needs >= 2 MDTs May 25 04:38:59 oleg425-client sshd[73480]: Received disconnect from 192.168.204.25 port 57304:11: disconnected by user May 25 04:39:00 oleg425-client sshd[73480]: Disconnected from user root 192.168.204.25 port 57304 May 25 04:39:00 oleg425-client sshd[73467]: pam_unix(sshd:session): session closed for user root May 25 04:39:00 oleg425-client systemd[1]: session-383.scope: Succeeded. May 25 04:39:00 oleg425-client systemd-logind[1020]: Session 383 logged out. Waiting for processes to exit. May 25 04:39:00 oleg425-client systemd-logind[1020]: Removed session 383. May 25 04:39:01 oleg425-client sshd[73619]: Accepted publickey for root from 192.168.204.25 port 57316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:01 oleg425-client systemd[1]: Started Session 384 of user root. May 25 04:39:01 oleg425-client systemd-logind[1020]: New session 384 of user root. May 25 04:39:01 oleg425-client sshd[73619]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:02 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110d: remove remote directory: drop client req ========================================================== 04:39:00 (1779698340) May 25 04:39:02 oleg425-client sshd[73632]: Received disconnect from 192.168.204.25 port 57316:11: disconnected by user May 25 04:39:02 oleg425-client sshd[73632]: Disconnected from user root 192.168.204.25 port 57316 May 25 04:39:02 oleg425-client sshd[73619]: pam_unix(sshd:session): session closed for user root May 25 04:39:02 oleg425-client systemd-logind[1020]: Session 384 logged out. Waiting for processes to exit. May 25 04:39:02 oleg425-client systemd[1]: session-384.scope: Succeeded. May 25 04:39:02 oleg425-client systemd-logind[1020]: Removed session 384. May 25 04:39:03 oleg425-client sshd[73755]: Accepted publickey for root from 192.168.204.25 port 57326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:03 oleg425-client systemd[1]: Started Session 385 of user root. May 25 04:39:03 oleg425-client systemd-logind[1020]: New session 385 of user root. May 25 04:39:03 oleg425-client sshd[73755]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:03 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110d needs >= 2 MDTs May 25 04:39:03 oleg425-client sshd[73768]: Received disconnect from 192.168.204.25 port 57326:11: disconnected by user May 25 04:39:03 oleg425-client sshd[73768]: Disconnected from user root 192.168.204.25 port 57326 May 25 04:39:03 oleg425-client sshd[73755]: pam_unix(sshd:session): session closed for user root May 25 04:39:03 oleg425-client systemd-logind[1020]: Session 385 logged out. Waiting for processes to exit. May 25 04:39:03 oleg425-client systemd[1]: session-385.scope: Succeeded. May 25 04:39:03 oleg425-client systemd-logind[1020]: Removed session 385. May 25 04:39:05 oleg425-client sshd[73909]: Accepted publickey for root from 192.168.204.25 port 59420 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:05 oleg425-client systemd[1]: Started Session 386 of user root. May 25 04:39:05 oleg425-client systemd-logind[1020]: New session 386 of user root. May 25 04:39:05 oleg425-client sshd[73909]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:05 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110e: remove remote directory: drop master rep ========================================================== 04:39:04 (1779698344) May 25 04:39:05 oleg425-client sshd[73922]: Received disconnect from 192.168.204.25 port 59420:11: disconnected by user May 25 04:39:05 oleg425-client sshd[73922]: Disconnected from user root 192.168.204.25 port 59420 May 25 04:39:05 oleg425-client sshd[73909]: pam_unix(sshd:session): session closed for user root May 25 04:39:05 oleg425-client systemd-logind[1020]: Session 386 logged out. Waiting for processes to exit. May 25 04:39:05 oleg425-client systemd[1]: session-386.scope: Succeeded. May 25 04:39:05 oleg425-client systemd-logind[1020]: Removed session 386. May 25 04:39:07 oleg425-client sshd[74045]: Accepted publickey for root from 192.168.204.25 port 59422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:07 oleg425-client systemd-logind[1020]: New session 387 of user root. May 25 04:39:07 oleg425-client systemd[1]: Started Session 387 of user root. May 25 04:39:07 oleg425-client sshd[74045]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:07 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110e needs >= 2 MDTs May 25 04:39:07 oleg425-client sshd[74058]: Received disconnect from 192.168.204.25 port 59422:11: disconnected by user May 25 04:39:07 oleg425-client sshd[74058]: Disconnected from user root 192.168.204.25 port 59422 May 25 04:39:07 oleg425-client sshd[74045]: pam_unix(sshd:session): session closed for user root May 25 04:39:07 oleg425-client systemd[1]: session-387.scope: Succeeded. May 25 04:39:07 oleg425-client systemd-logind[1020]: Session 387 logged out. Waiting for processes to exit. May 25 04:39:07 oleg425-client systemd-logind[1020]: Removed session 387. May 25 04:39:09 oleg425-client sshd[74197]: Accepted publickey for root from 192.168.204.25 port 59426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:09 oleg425-client systemd-logind[1020]: New session 388 of user root. May 25 04:39:09 oleg425-client systemd[1]: Started Session 388 of user root. May 25 04:39:09 oleg425-client sshd[74197]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:10 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110f: remove remote directory: drop slave rep ========================================================== 04:39:08 (1779698348) May 25 04:39:10 oleg425-client sshd[74210]: Received disconnect from 192.168.204.25 port 59426:11: disconnected by user May 25 04:39:10 oleg425-client sshd[74210]: Disconnected from user root 192.168.204.25 port 59426 May 25 04:39:10 oleg425-client sshd[74197]: pam_unix(sshd:session): session closed for user root May 25 04:39:10 oleg425-client systemd-logind[1020]: Session 388 logged out. Waiting for processes to exit. May 25 04:39:10 oleg425-client systemd[1]: session-388.scope: Succeeded. May 25 04:39:10 oleg425-client systemd-logind[1020]: Removed session 388. May 25 04:39:11 oleg425-client sshd[74334]: Accepted publickey for root from 192.168.204.25 port 59442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:11 oleg425-client systemd-logind[1020]: New session 389 of user root. May 25 04:39:11 oleg425-client systemd[1]: Started Session 389 of user root. May 25 04:39:11 oleg425-client sshd[74334]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:12 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110f needs >= 2 MDTs May 25 04:39:12 oleg425-client sshd[74347]: Received disconnect from 192.168.204.25 port 59442:11: disconnected by user May 25 04:39:12 oleg425-client sshd[74347]: Disconnected from user root 192.168.204.25 port 59442 May 25 04:39:12 oleg425-client sshd[74334]: pam_unix(sshd:session): session closed for user root May 25 04:39:12 oleg425-client systemd-logind[1020]: Session 389 logged out. Waiting for processes to exit. May 25 04:39:12 oleg425-client systemd[1]: session-389.scope: Succeeded. May 25 04:39:12 oleg425-client systemd-logind[1020]: Removed session 389. May 25 04:39:14 oleg425-client sshd[74486]: Accepted publickey for root from 192.168.204.25 port 59446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:14 oleg425-client systemd[1]: Started Session 390 of user root. May 25 04:39:14 oleg425-client systemd-logind[1020]: New session 390 of user root. May 25 04:39:14 oleg425-client sshd[74486]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:14 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110g: drop reply during migration ========================================================== 04:39:12 (1779698352) May 25 04:39:14 oleg425-client sshd[74499]: Received disconnect from 192.168.204.25 port 59446:11: disconnected by user May 25 04:39:14 oleg425-client sshd[74499]: Disconnected from user root 192.168.204.25 port 59446 May 25 04:39:14 oleg425-client sshd[74486]: pam_unix(sshd:session): session closed for user root May 25 04:39:14 oleg425-client systemd[1]: session-390.scope: Succeeded. May 25 04:39:14 oleg425-client systemd-logind[1020]: Session 390 logged out. Waiting for processes to exit. May 25 04:39:14 oleg425-client systemd-logind[1020]: Removed session 390. May 25 04:39:15 oleg425-client sshd[74625]: Accepted publickey for root from 192.168.204.25 port 51702 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:15 oleg425-client systemd-logind[1020]: New session 391 of user root. May 25 04:39:15 oleg425-client systemd[1]: Started Session 391 of user root. May 25 04:39:15 oleg425-client sshd[74625]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:16 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110g needs >= 2 MDTs May 25 04:39:16 oleg425-client sshd[74638]: Received disconnect from 192.168.204.25 port 51702:11: disconnected by user May 25 04:39:16 oleg425-client sshd[74638]: Disconnected from user root 192.168.204.25 port 51702 May 25 04:39:16 oleg425-client sshd[74625]: pam_unix(sshd:session): session closed for user root May 25 04:39:16 oleg425-client systemd[1]: session-391.scope: Succeeded. May 25 04:39:16 oleg425-client systemd-logind[1020]: Session 391 logged out. Waiting for processes to exit. May 25 04:39:16 oleg425-client systemd-logind[1020]: Removed session 391. May 25 04:39:17 oleg425-client sshd[74778]: Accepted publickey for root from 192.168.204.25 port 51710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:17 oleg425-client systemd-logind[1020]: New session 392 of user root. May 25 04:39:17 oleg425-client systemd[1]: Started Session 392 of user root. May 25 04:39:17 oleg425-client sshd[74778]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:18 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110h: drop update reply during cross-MDT file rename ========================================================== 04:39:16 (1779698356) May 25 04:39:18 oleg425-client sshd[74791]: Received disconnect from 192.168.204.25 port 51710:11: disconnected by user May 25 04:39:18 oleg425-client sshd[74791]: Disconnected from user root 192.168.204.25 port 51710 May 25 04:39:18 oleg425-client sshd[74778]: pam_unix(sshd:session): session closed for user root May 25 04:39:18 oleg425-client systemd[1]: session-392.scope: Succeeded. May 25 04:39:18 oleg425-client systemd-logind[1020]: Session 392 logged out. Waiting for processes to exit. May 25 04:39:18 oleg425-client systemd-logind[1020]: Removed session 392. May 25 04:39:19 oleg425-client sshd[74914]: Accepted publickey for root from 192.168.204.25 port 51722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:19 oleg425-client systemd-logind[1020]: New session 393 of user root. May 25 04:39:19 oleg425-client systemd[1]: Started Session 393 of user root. May 25 04:39:19 oleg425-client sshd[74914]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:19 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110h needs >= 2 MDTs May 25 04:39:19 oleg425-client sshd[74927]: Received disconnect from 192.168.204.25 port 51722:11: disconnected by user May 25 04:39:19 oleg425-client sshd[74927]: Disconnected from user root 192.168.204.25 port 51722 May 25 04:39:19 oleg425-client sshd[74914]: pam_unix(sshd:session): session closed for user root May 25 04:39:20 oleg425-client systemd-logind[1020]: Session 393 logged out. Waiting for processes to exit. May 25 04:39:20 oleg425-client systemd[1]: session-393.scope: Succeeded. May 25 04:39:20 oleg425-client systemd-logind[1020]: Removed session 393. May 25 04:39:21 oleg425-client sshd[75067]: Accepted publickey for root from 192.168.204.25 port 51734 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:22 oleg425-client systemd-logind[1020]: New session 394 of user root. May 25 04:39:22 oleg425-client systemd[1]: Started Session 394 of user root. May 25 04:39:22 oleg425-client sshd[75067]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:22 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110i: drop update reply during cross-MDT dir rename ========================================================== 04:39:20 (1779698360) May 25 04:39:22 oleg425-client sshd[75080]: Received disconnect from 192.168.204.25 port 51734:11: disconnected by user May 25 04:39:22 oleg425-client sshd[75080]: Disconnected from user root 192.168.204.25 port 51734 May 25 04:39:22 oleg425-client sshd[75067]: pam_unix(sshd:session): session closed for user root May 25 04:39:22 oleg425-client systemd[1]: session-394.scope: Succeeded. May 25 04:39:22 oleg425-client systemd-logind[1020]: Session 394 logged out. Waiting for processes to exit. May 25 04:39:22 oleg425-client systemd-logind[1020]: Removed session 394. May 25 04:39:23 oleg425-client sshd[75203]: Accepted publickey for root from 192.168.204.25 port 51742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:23 oleg425-client systemd[1]: Started Session 395 of user root. May 25 04:39:23 oleg425-client systemd-logind[1020]: New session 395 of user root. May 25 04:39:23 oleg425-client sshd[75203]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:23 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110i needs >= 2 MDTs May 25 04:39:23 oleg425-client sshd[75216]: Received disconnect from 192.168.204.25 port 51742:11: disconnected by user May 25 04:39:23 oleg425-client sshd[75216]: Disconnected from user root 192.168.204.25 port 51742 May 25 04:39:23 oleg425-client sshd[75203]: pam_unix(sshd:session): session closed for user root May 25 04:39:23 oleg425-client systemd[1]: session-395.scope: Succeeded. May 25 04:39:23 oleg425-client systemd-logind[1020]: Session 395 logged out. Waiting for processes to exit. May 25 04:39:23 oleg425-client systemd-logind[1020]: Removed session 395. May 25 04:39:25 oleg425-client sshd[75355]: Accepted publickey for root from 192.168.204.25 port 46162 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:25 oleg425-client systemd-logind[1020]: New session 396 of user root. May 25 04:39:25 oleg425-client systemd[1]: Started Session 396 of user root. May 25 04:39:25 oleg425-client sshd[75355]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:25 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110j: drop update reply during cross-MDT ln ========================================================== 04:39:24 (1779698364) May 25 04:39:25 oleg425-client sshd[75368]: Received disconnect from 192.168.204.25 port 46162:11: disconnected by user May 25 04:39:25 oleg425-client sshd[75368]: Disconnected from user root 192.168.204.25 port 46162 May 25 04:39:25 oleg425-client sshd[75355]: pam_unix(sshd:session): session closed for user root May 25 04:39:25 oleg425-client systemd[1]: session-396.scope: Succeeded. May 25 04:39:25 oleg425-client systemd-logind[1020]: Session 396 logged out. Waiting for processes to exit. May 25 04:39:25 oleg425-client systemd-logind[1020]: Removed session 396. May 25 04:39:26 oleg425-client sshd[75491]: Accepted publickey for root from 192.168.204.25 port 46166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:26 oleg425-client systemd-logind[1020]: New session 397 of user root. May 25 04:39:26 oleg425-client systemd[1]: Started Session 397 of user root. May 25 04:39:26 oleg425-client sshd[75491]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:26 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110j needs >= 2 MDTs May 25 04:39:26 oleg425-client sshd[75504]: Received disconnect from 192.168.204.25 port 46166:11: disconnected by user May 25 04:39:26 oleg425-client sshd[75504]: Disconnected from user root 192.168.204.25 port 46166 May 25 04:39:26 oleg425-client sshd[75491]: pam_unix(sshd:session): session closed for user root May 25 04:39:26 oleg425-client systemd[1]: session-397.scope: Succeeded. May 25 04:39:26 oleg425-client systemd-logind[1020]: Session 397 logged out. Waiting for processes to exit. May 25 04:39:26 oleg425-client systemd-logind[1020]: Removed session 397. May 25 04:39:27 oleg425-client sshd[75644]: Accepted publickey for root from 192.168.204.25 port 46176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:27 oleg425-client systemd[1]: Started Session 398 of user root. May 25 04:39:27 oleg425-client systemd-logind[1020]: New session 398 of user root. May 25 04:39:28 oleg425-client sshd[75644]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:28 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110k: FID_QUERY failed during recovery ========================================================== 04:39:26 (1779698366) May 25 04:39:28 oleg425-client sshd[75657]: Received disconnect from 192.168.204.25 port 46176:11: disconnected by user May 25 04:39:28 oleg425-client sshd[75657]: Disconnected from user root 192.168.204.25 port 46176 May 25 04:39:28 oleg425-client sshd[75644]: pam_unix(sshd:session): session closed for user root May 25 04:39:28 oleg425-client systemd[1]: session-398.scope: Succeeded. May 25 04:39:28 oleg425-client systemd-logind[1020]: Session 398 logged out. Waiting for processes to exit. May 25 04:39:28 oleg425-client systemd-logind[1020]: Removed session 398. May 25 04:39:29 oleg425-client sshd[75780]: Accepted publickey for root from 192.168.204.25 port 46188 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:29 oleg425-client systemd[1]: Started Session 399 of user root. May 25 04:39:29 oleg425-client systemd-logind[1020]: New session 399 of user root. May 25 04:39:29 oleg425-client sshd[75780]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:29 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110k needs >= 2 MDTS May 25 04:39:29 oleg425-client sshd[75793]: Received disconnect from 192.168.204.25 port 46188:11: disconnected by user May 25 04:39:29 oleg425-client sshd[75793]: Disconnected from user root 192.168.204.25 port 46188 May 25 04:39:29 oleg425-client sshd[75780]: pam_unix(sshd:session): session closed for user root May 25 04:39:30 oleg425-client systemd[1]: session-399.scope: Succeeded. May 25 04:39:30 oleg425-client systemd-logind[1020]: Session 399 logged out. Waiting for processes to exit. May 25 04:39:30 oleg425-client systemd-logind[1020]: Removed session 399. May 25 04:39:31 oleg425-client sshd[75932]: Accepted publickey for root from 192.168.204.25 port 46196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:31 oleg425-client systemd-logind[1020]: New session 400 of user root. May 25 04:39:31 oleg425-client systemd[1]: Started Session 400 of user root. May 25 04:39:31 oleg425-client sshd[75932]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:31 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110m: update resent vs original RPC race ========================================================== 04:39:30 (1779698370) May 25 04:39:31 oleg425-client sshd[75945]: Received disconnect from 192.168.204.25 port 46196:11: disconnected by user May 25 04:39:31 oleg425-client sshd[75945]: Disconnected from user root 192.168.204.25 port 46196 May 25 04:39:31 oleg425-client sshd[75932]: pam_unix(sshd:session): session closed for user root May 25 04:39:31 oleg425-client systemd[1]: session-400.scope: Succeeded. May 25 04:39:31 oleg425-client systemd-logind[1020]: Session 400 logged out. Waiting for processes to exit. May 25 04:39:31 oleg425-client systemd-logind[1020]: Removed session 400. May 25 04:39:34 oleg425-client sshd[76092]: Accepted publickey for root from 192.168.204.25 port 46210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:34 oleg425-client systemd[1]: Started Session 401 of user root. May 25 04:39:34 oleg425-client systemd-logind[1020]: New session 401 of user root. May 25 04:39:34 oleg425-client sshd[76092]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:34 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_110m needs at least 2 MDTs May 25 04:39:34 oleg425-client sshd[76106]: Received disconnect from 192.168.204.25 port 46210:11: disconnected by user May 25 04:39:34 oleg425-client sshd[76106]: Disconnected from user root 192.168.204.25 port 46210 May 25 04:39:34 oleg425-client sshd[76092]: pam_unix(sshd:session): session closed for user root May 25 04:39:34 oleg425-client systemd-logind[1020]: Session 401 logged out. Waiting for processes to exit. May 25 04:39:34 oleg425-client systemd[1]: session-401.scope: Succeeded. May 25 04:39:34 oleg425-client systemd-logind[1020]: Removed session 401. May 25 04:39:36 oleg425-client sshd[76245]: Accepted publickey for root from 192.168.204.25 port 39666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:36 oleg425-client systemd[1]: Started Session 402 of user root. May 25 04:39:36 oleg425-client systemd-logind[1020]: New session 402 of user root. May 25 04:39:36 oleg425-client sshd[76245]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:36 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 111: mdd setup fail should not cause umount oops ========================================================== 04:39:34 (1779698374) May 25 04:39:36 oleg425-client sshd[76258]: Received disconnect from 192.168.204.25 port 39666:11: disconnected by user May 25 04:39:36 oleg425-client sshd[76258]: Disconnected from user root 192.168.204.25 port 39666 May 25 04:39:36 oleg425-client sshd[76245]: pam_unix(sshd:session): session closed for user root May 25 04:39:37 oleg425-client systemd-logind[1020]: Session 402 logged out. Waiting for processes to exit. May 25 04:39:37 oleg425-client systemd[1]: session-402.scope: Succeeded. May 25 04:39:37 oleg425-client systemd-logind[1020]: Removed session 402. May 25 04:40:03 oleg425-client sshd[76697]: Accepted publickey for root from 192.168.204.25 port 58252 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:03 oleg425-client systemd-logind[1020]: New session 403 of user root. May 25 04:40:03 oleg425-client systemd[1]: Started Session 403 of user root. May 25 04:40:03 oleg425-client sshd[76697]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:03 oleg425-client sshd[76710]: Received disconnect from 192.168.204.25 port 58252:11: disconnected by user May 25 04:40:03 oleg425-client sshd[76710]: Disconnected from user root 192.168.204.25 port 58252 May 25 04:40:03 oleg425-client sshd[76697]: pam_unix(sshd:session): session closed for user root May 25 04:40:03 oleg425-client systemd-logind[1020]: Session 403 logged out. Waiting for processes to exit. May 25 04:40:03 oleg425-client systemd[1]: session-403.scope: Succeeded. May 25 04:40:03 oleg425-client systemd-logind[1020]: Removed session 403. May 25 04:40:04 oleg425-client sshd[76836]: Accepted publickey for root from 192.168.204.25 port 52044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:04 oleg425-client systemd-logind[1020]: New session 404 of user root. May 25 04:40:04 oleg425-client systemd[1]: Started Session 404 of user root. May 25 04:40:04 oleg425-client sshd[76836]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:05 oleg425-client sshd[76849]: Received disconnect from 192.168.204.25 port 52044:11: disconnected by user May 25 04:40:05 oleg425-client sshd[76849]: Disconnected from user root 192.168.204.25 port 52044 May 25 04:40:05 oleg425-client sshd[76836]: pam_unix(sshd:session): session closed for user root May 25 04:40:05 oleg425-client systemd[1]: session-404.scope: Succeeded. May 25 04:40:05 oleg425-client systemd-logind[1020]: Session 404 logged out. Waiting for processes to exit. May 25 04:40:05 oleg425-client systemd-logind[1020]: Removed session 404. May 25 04:40:06 oleg425-client sshd[76980]: Accepted publickey for root from 192.168.204.25 port 52060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:06 oleg425-client systemd-logind[1020]: New session 405 of user root. May 25 04:40:06 oleg425-client systemd[1]: Started Session 405 of user root. May 25 04:40:06 oleg425-client sshd[76980]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:06 oleg425-client sshd[76993]: Received disconnect from 192.168.204.25 port 52060:11: disconnected by user May 25 04:40:06 oleg425-client sshd[76993]: Disconnected from user root 192.168.204.25 port 52060 May 25 04:40:06 oleg425-client sshd[76980]: pam_unix(sshd:session): session closed for user root May 25 04:40:06 oleg425-client systemd[1]: session-405.scope: Succeeded. May 25 04:40:06 oleg425-client systemd-logind[1020]: Session 405 logged out. Waiting for processes to exit. May 25 04:40:06 oleg425-client systemd-logind[1020]: Removed session 405. May 25 04:40:08 oleg425-client sshd[77133]: Accepted publickey for root from 192.168.204.25 port 52072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:08 oleg425-client systemd-logind[1020]: New session 406 of user root. May 25 04:40:08 oleg425-client systemd[1]: Started Session 406 of user root. May 25 04:40:08 oleg425-client sshd[77133]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:09 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 112a: bulk resend while orignal request is in progress ========================================================== 04:40:07 (1779698407) May 25 04:40:09 oleg425-client sshd[77146]: Received disconnect from 192.168.204.25 port 52072:11: disconnected by user May 25 04:40:09 oleg425-client sshd[77146]: Disconnected from user root 192.168.204.25 port 52072 May 25 04:40:09 oleg425-client sshd[77133]: pam_unix(sshd:session): session closed for user root May 25 04:40:09 oleg425-client systemd-logind[1020]: Session 406 logged out. Waiting for processes to exit. May 25 04:40:09 oleg425-client systemd[1]: session-406.scope: Succeeded. May 25 04:40:09 oleg425-client systemd-logind[1020]: Removed session 406. May 25 04:40:33 oleg425-client sshd[77339]: Accepted publickey for root from 192.168.204.25 port 58982 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:33 oleg425-client systemd-logind[1020]: New session 407 of user root. May 25 04:40:33 oleg425-client systemd[1]: Started Session 407 of user root. May 25 04:40:33 oleg425-client sshd[77339]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:33 oleg425-client sshd[77352]: Received disconnect from 192.168.204.25 port 58982:11: disconnected by user May 25 04:40:33 oleg425-client sshd[77352]: Disconnected from user root 192.168.204.25 port 58982 May 25 04:40:33 oleg425-client sshd[77339]: pam_unix(sshd:session): session closed for user root May 25 04:40:33 oleg425-client systemd[1]: session-407.scope: Succeeded. May 25 04:40:33 oleg425-client systemd-logind[1020]: Session 407 logged out. Waiting for processes to exit. May 25 04:40:33 oleg425-client systemd-logind[1020]: Removed session 407. May 25 04:40:34 oleg425-client sshd[77477]: Accepted publickey for root from 192.168.204.25 port 40002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:34 oleg425-client systemd-logind[1020]: New session 408 of user root. May 25 04:40:34 oleg425-client systemd[1]: Started Session 408 of user root. May 25 04:40:34 oleg425-client sshd[77477]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:35 oleg425-client sshd[77490]: Received disconnect from 192.168.204.25 port 40002:11: disconnected by user May 25 04:40:35 oleg425-client sshd[77490]: Disconnected from user root 192.168.204.25 port 40002 May 25 04:40:35 oleg425-client sshd[77477]: pam_unix(sshd:session): session closed for user root May 25 04:40:35 oleg425-client systemd[1]: session-408.scope: Succeeded. May 25 04:40:35 oleg425-client systemd-logind[1020]: Session 408 logged out. Waiting for processes to exit. May 25 04:40:35 oleg425-client systemd-logind[1020]: Removed session 408. May 25 04:40:36 oleg425-client sshd[77622]: Accepted publickey for root from 192.168.204.25 port 40010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:36 oleg425-client systemd[1]: Started Session 409 of user root. May 25 04:40:36 oleg425-client systemd-logind[1020]: New session 409 of user root. May 25 04:40:36 oleg425-client sshd[77622]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:36 oleg425-client sshd[77635]: Received disconnect from 192.168.204.25 port 40010:11: disconnected by user May 25 04:40:36 oleg425-client sshd[77635]: Disconnected from user root 192.168.204.25 port 40010 May 25 04:40:36 oleg425-client sshd[77622]: pam_unix(sshd:session): session closed for user root May 25 04:40:36 oleg425-client systemd[1]: session-409.scope: Succeeded. May 25 04:40:36 oleg425-client systemd-logind[1020]: Session 409 logged out. Waiting for processes to exit. May 25 04:40:36 oleg425-client systemd-logind[1020]: Removed session 409. May 25 04:40:37 oleg425-client sshd[77775]: Accepted publickey for root from 192.168.204.25 port 40020 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:37 oleg425-client systemd-logind[1020]: New session 410 of user root. May 25 04:40:37 oleg425-client systemd[1]: Started Session 410 of user root. May 25 04:40:37 oleg425-client sshd[77775]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:38 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115a: read: late REQ MDunlink and no bulk ========================================================== 04:40:37 (1779698437) May 25 04:40:38 oleg425-client sshd[77788]: Received disconnect from 192.168.204.25 port 40020:11: disconnected by user May 25 04:40:38 oleg425-client sshd[77788]: Disconnected from user root 192.168.204.25 port 40020 May 25 04:40:38 oleg425-client sshd[77775]: pam_unix(sshd:session): session closed for user root May 25 04:40:38 oleg425-client systemd[1]: session-410.scope: Succeeded. May 25 04:40:38 oleg425-client systemd-logind[1020]: Session 410 logged out. Waiting for processes to exit. May 25 04:40:38 oleg425-client systemd-logind[1020]: Removed session 410. May 25 04:40:38 oleg425-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** May 25 04:40:43 oleg425-client sshd[77989]: Accepted publickey for root from 192.168.204.25 port 40026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:43 oleg425-client systemd-logind[1020]: New session 411 of user root. May 25 04:40:43 oleg425-client systemd[1]: Started Session 411 of user root. May 25 04:40:43 oleg425-client sshd[77989]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:44 oleg425-client sshd[78002]: Received disconnect from 192.168.204.25 port 40026:11: disconnected by user May 25 04:40:44 oleg425-client sshd[78002]: Disconnected from user root 192.168.204.25 port 40026 May 25 04:40:44 oleg425-client sshd[77989]: pam_unix(sshd:session): session closed for user root May 25 04:40:44 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:40:44 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:40:44 oleg425-client systemd-logind[1020]: Session 411 logged out. Waiting for processes to exit. May 25 04:40:44 oleg425-client systemd[1]: session-411.scope: Succeeded. May 25 04:40:44 oleg425-client systemd-logind[1020]: Removed session 411. May 25 04:40:45 oleg425-client sshd[78127]: Accepted publickey for root from 192.168.204.25 port 56506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:45 oleg425-client systemd[1]: Started Session 412 of user root. May 25 04:40:45 oleg425-client systemd-logind[1020]: New session 412 of user root. May 25 04:40:45 oleg425-client sshd[78127]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:45 oleg425-client sshd[78140]: Received disconnect from 192.168.204.25 port 56506:11: disconnected by user May 25 04:40:45 oleg425-client sshd[78140]: Disconnected from user root 192.168.204.25 port 56506 May 25 04:40:45 oleg425-client sshd[78127]: pam_unix(sshd:session): session closed for user root May 25 04:40:45 oleg425-client systemd[1]: session-412.scope: Succeeded. May 25 04:40:45 oleg425-client systemd-logind[1020]: Session 412 logged out. Waiting for processes to exit. May 25 04:40:45 oleg425-client systemd-logind[1020]: Removed session 412. May 25 04:40:46 oleg425-client sshd[78271]: Accepted publickey for root from 192.168.204.25 port 56510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:46 oleg425-client systemd-logind[1020]: New session 413 of user root. May 25 04:40:46 oleg425-client systemd[1]: Started Session 413 of user root. May 25 04:40:46 oleg425-client sshd[78271]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:46 oleg425-client sshd[78284]: Received disconnect from 192.168.204.25 port 56510:11: disconnected by user May 25 04:40:46 oleg425-client sshd[78284]: Disconnected from user root 192.168.204.25 port 56510 May 25 04:40:46 oleg425-client sshd[78271]: pam_unix(sshd:session): session closed for user root May 25 04:40:46 oleg425-client systemd[1]: session-413.scope: Succeeded. May 25 04:40:46 oleg425-client systemd-logind[1020]: Session 413 logged out. Waiting for processes to exit. May 25 04:40:46 oleg425-client systemd-logind[1020]: Removed session 413. May 25 04:40:48 oleg425-client sshd[78425]: Accepted publickey for root from 192.168.204.25 port 56512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:49 oleg425-client systemd[1]: Started Session 414 of user root. May 25 04:40:49 oleg425-client systemd-logind[1020]: New session 414 of user root. May 25 04:40:49 oleg425-client sshd[78425]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:49 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115b: write: late REQ MDunlink and no bulk ========================================================== 04:40:47 (1779698447) May 25 04:40:49 oleg425-client sshd[78438]: Received disconnect from 192.168.204.25 port 56512:11: disconnected by user May 25 04:40:49 oleg425-client sshd[78438]: Disconnected from user root 192.168.204.25 port 56512 May 25 04:40:49 oleg425-client sshd[78425]: pam_unix(sshd:session): session closed for user root May 25 04:40:49 oleg425-client systemd[1]: session-414.scope: Succeeded. May 25 04:40:49 oleg425-client systemd-logind[1020]: Session 414 logged out. Waiting for processes to exit. May 25 04:40:49 oleg425-client systemd-logind[1020]: Removed session 414. May 25 04:40:49 oleg425-client kernel: Lustre: *** cfs_fail_loc=51b, val=4*** May 25 04:40:54 oleg425-client sshd[78634]: Accepted publickey for root from 192.168.204.25 port 43214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:55 oleg425-client systemd-logind[1020]: New session 415 of user root. May 25 04:40:55 oleg425-client systemd[1]: Started Session 415 of user root. May 25 04:40:55 oleg425-client sshd[78634]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:55 oleg425-client sshd[78648]: Received disconnect from 192.168.204.25 port 43214:11: disconnected by user May 25 04:40:55 oleg425-client sshd[78648]: Disconnected from user root 192.168.204.25 port 43214 May 25 04:40:55 oleg425-client sshd[78634]: pam_unix(sshd:session): session closed for user root May 25 04:40:55 oleg425-client systemd-logind[1020]: Session 415 logged out. Waiting for processes to exit. May 25 04:40:55 oleg425-client systemd[1]: session-415.scope: Succeeded. May 25 04:40:55 oleg425-client systemd-logind[1020]: Removed session 415. May 25 04:40:56 oleg425-client sshd[78772]: Accepted publickey for root from 192.168.204.25 port 43222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:56 oleg425-client systemd-logind[1020]: New session 416 of user root. May 25 04:40:56 oleg425-client systemd[1]: Started Session 416 of user root. May 25 04:40:56 oleg425-client sshd[78772]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:56 oleg425-client sshd[78785]: Received disconnect from 192.168.204.25 port 43222:11: disconnected by user May 25 04:40:56 oleg425-client sshd[78785]: Disconnected from user root 192.168.204.25 port 43222 May 25 04:40:57 oleg425-client sshd[78772]: pam_unix(sshd:session): session closed for user root May 25 04:40:57 oleg425-client systemd[1]: session-416.scope: Succeeded. May 25 04:40:57 oleg425-client systemd-logind[1020]: Session 416 logged out. Waiting for processes to exit. May 25 04:40:57 oleg425-client systemd-logind[1020]: Removed session 416. May 25 04:40:57 oleg425-client sshd[78916]: Accepted publickey for root from 192.168.204.25 port 43224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:58 oleg425-client systemd[1]: Started Session 417 of user root. May 25 04:40:58 oleg425-client systemd-logind[1020]: New session 417 of user root. May 25 04:40:58 oleg425-client sshd[78916]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:58 oleg425-client sshd[78929]: Received disconnect from 192.168.204.25 port 43224:11: disconnected by user May 25 04:40:58 oleg425-client sshd[78929]: Disconnected from user root 192.168.204.25 port 43224 May 25 04:40:58 oleg425-client sshd[78916]: pam_unix(sshd:session): session closed for user root May 25 04:40:58 oleg425-client systemd[1]: session-417.scope: Succeeded. May 25 04:40:58 oleg425-client systemd-logind[1020]: Session 417 logged out. Waiting for processes to exit. May 25 04:40:58 oleg425-client systemd-logind[1020]: Removed session 417. May 25 04:40:59 oleg425-client sshd[79069]: Accepted publickey for root from 192.168.204.25 port 43236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:59 oleg425-client systemd[1]: Started Session 418 of user root. May 25 04:40:59 oleg425-client systemd-logind[1020]: New session 418 of user root. May 25 04:40:59 oleg425-client sshd[79069]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:00 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115c: read: late Reply MDunlink and no bulk ========================================================== 04:40:58 (1779698458) May 25 04:41:00 oleg425-client sshd[79083]: Received disconnect from 192.168.204.25 port 43236:11: disconnected by user May 25 04:41:00 oleg425-client sshd[79083]: Disconnected from user root 192.168.204.25 port 43236 May 25 04:41:00 oleg425-client sshd[79069]: pam_unix(sshd:session): session closed for user root May 25 04:41:00 oleg425-client systemd[1]: session-418.scope: Succeeded. May 25 04:41:00 oleg425-client systemd-logind[1020]: Session 418 logged out. Waiting for processes to exit. May 25 04:41:00 oleg425-client systemd-logind[1020]: Removed session 418. May 25 04:41:00 oleg425-client kernel: Lustre: *** cfs_fail_loc=50f, val=3*** May 25 04:41:03 oleg425-client sshd[79284]: Accepted publickey for root from 192.168.204.25 port 43240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:03 oleg425-client systemd[1]: Started Session 419 of user root. May 25 04:41:03 oleg425-client systemd-logind[1020]: New session 419 of user root. May 25 04:41:03 oleg425-client sshd[79284]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:03 oleg425-client sshd[79297]: Received disconnect from 192.168.204.25 port 43240:11: disconnected by user May 25 04:41:03 oleg425-client sshd[79297]: Disconnected from user root 192.168.204.25 port 43240 May 25 04:41:03 oleg425-client sshd[79284]: pam_unix(sshd:session): session closed for user root May 25 04:41:03 oleg425-client systemd[1]: session-419.scope: Succeeded. May 25 04:41:03 oleg425-client systemd-logind[1020]: Session 419 logged out. Waiting for processes to exit. May 25 04:41:03 oleg425-client systemd-logind[1020]: Removed session 419. May 25 04:41:04 oleg425-client sshd[79421]: Accepted publickey for root from 192.168.204.25 port 54298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:04 oleg425-client systemd-logind[1020]: New session 420 of user root. May 25 04:41:04 oleg425-client systemd[1]: Started Session 420 of user root. May 25 04:41:04 oleg425-client sshd[79421]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:04 oleg425-client sshd[79434]: Received disconnect from 192.168.204.25 port 54298:11: disconnected by user May 25 04:41:04 oleg425-client sshd[79434]: Disconnected from user root 192.168.204.25 port 54298 May 25 04:41:05 oleg425-client sshd[79421]: pam_unix(sshd:session): session closed for user root May 25 04:41:05 oleg425-client systemd[1]: session-420.scope: Succeeded. May 25 04:41:05 oleg425-client systemd-logind[1020]: Session 420 logged out. Waiting for processes to exit. May 25 04:41:05 oleg425-client systemd-logind[1020]: Removed session 420. May 25 04:41:06 oleg425-client sshd[79566]: Accepted publickey for root from 192.168.204.25 port 54300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:06 oleg425-client systemd[1]: Started Session 421 of user root. May 25 04:41:06 oleg425-client systemd-logind[1020]: New session 421 of user root. May 25 04:41:06 oleg425-client sshd[79566]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:06 oleg425-client sshd[79579]: Received disconnect from 192.168.204.25 port 54300:11: disconnected by user May 25 04:41:06 oleg425-client sshd[79579]: Disconnected from user root 192.168.204.25 port 54300 May 25 04:41:06 oleg425-client sshd[79566]: pam_unix(sshd:session): session closed for user root May 25 04:41:06 oleg425-client systemd-logind[1020]: Session 421 logged out. Waiting for processes to exit. May 25 04:41:06 oleg425-client systemd[1]: session-421.scope: Succeeded. May 25 04:41:06 oleg425-client systemd-logind[1020]: Removed session 421. May 25 04:41:07 oleg425-client sshd[79719]: Accepted publickey for root from 192.168.204.25 port 54304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:08 oleg425-client systemd-logind[1020]: New session 422 of user root. May 25 04:41:08 oleg425-client systemd[1]: Started Session 422 of user root. May 25 04:41:08 oleg425-client sshd[79719]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:08 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115d: write: late Reply MDunlink and no bulk ========================================================== 04:41:07 (1779698467) May 25 04:41:08 oleg425-client sshd[79732]: Received disconnect from 192.168.204.25 port 54304:11: disconnected by user May 25 04:41:08 oleg425-client sshd[79732]: Disconnected from user root 192.168.204.25 port 54304 May 25 04:41:08 oleg425-client sshd[79719]: pam_unix(sshd:session): session closed for user root May 25 04:41:08 oleg425-client systemd[1]: session-422.scope: Succeeded. May 25 04:41:08 oleg425-client systemd-logind[1020]: Session 422 logged out. Waiting for processes to exit. May 25 04:41:08 oleg425-client systemd-logind[1020]: Removed session 422. May 25 04:41:08 oleg425-client kernel: Lustre: *** cfs_fail_loc=50f, val=4*** May 25 04:41:11 oleg425-client sshd[79929]: Accepted publickey for root from 192.168.204.25 port 54308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:11 oleg425-client systemd-logind[1020]: New session 423 of user root. May 25 04:41:11 oleg425-client systemd[1]: Started Session 423 of user root. May 25 04:41:11 oleg425-client sshd[79929]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:11 oleg425-client sshd[79942]: Received disconnect from 192.168.204.25 port 54308:11: disconnected by user May 25 04:41:11 oleg425-client sshd[79942]: Disconnected from user root 192.168.204.25 port 54308 May 25 04:41:11 oleg425-client sshd[79929]: pam_unix(sshd:session): session closed for user root May 25 04:41:11 oleg425-client systemd-logind[1020]: Session 423 logged out. Waiting for processes to exit. May 25 04:41:11 oleg425-client systemd[1]: session-423.scope: Succeeded. May 25 04:41:11 oleg425-client systemd-logind[1020]: Removed session 423. May 25 04:41:12 oleg425-client sshd[80066]: Accepted publickey for root from 192.168.204.25 port 54318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:12 oleg425-client systemd[1]: Started Session 424 of user root. May 25 04:41:12 oleg425-client systemd-logind[1020]: New session 424 of user root. May 25 04:41:12 oleg425-client sshd[80066]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:13 oleg425-client sshd[80079]: Received disconnect from 192.168.204.25 port 54318:11: disconnected by user May 25 04:41:13 oleg425-client sshd[80079]: Disconnected from user root 192.168.204.25 port 54318 May 25 04:41:13 oleg425-client sshd[80066]: pam_unix(sshd:session): session closed for user root May 25 04:41:13 oleg425-client systemd-logind[1020]: Session 424 logged out. Waiting for processes to exit. May 25 04:41:13 oleg425-client systemd[1]: session-424.scope: Succeeded. May 25 04:41:13 oleg425-client systemd-logind[1020]: Removed session 424. May 25 04:41:14 oleg425-client sshd[80210]: Accepted publickey for root from 192.168.204.25 port 44478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:14 oleg425-client systemd[1]: Started Session 425 of user root. May 25 04:41:14 oleg425-client systemd-logind[1020]: New session 425 of user root. May 25 04:41:14 oleg425-client sshd[80210]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:14 oleg425-client sshd[80223]: Received disconnect from 192.168.204.25 port 44478:11: disconnected by user May 25 04:41:14 oleg425-client sshd[80223]: Disconnected from user root 192.168.204.25 port 44478 May 25 04:41:14 oleg425-client sshd[80210]: pam_unix(sshd:session): session closed for user root May 25 04:41:14 oleg425-client systemd[1]: session-425.scope: Succeeded. May 25 04:41:14 oleg425-client systemd-logind[1020]: Session 425 logged out. Waiting for processes to exit. May 25 04:41:14 oleg425-client systemd-logind[1020]: Removed session 425. May 25 04:41:15 oleg425-client sshd[80363]: Accepted publickey for root from 192.168.204.25 port 44480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:15 oleg425-client systemd[1]: Started Session 426 of user root. May 25 04:41:15 oleg425-client systemd-logind[1020]: New session 426 of user root. May 25 04:41:15 oleg425-client sshd[80363]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:16 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115e: read: late Bulk MDunlink and no reply ========================================================== 04:41:15 (1779698475) May 25 04:41:16 oleg425-client sshd[80377]: Received disconnect from 192.168.204.25 port 44480:11: disconnected by user May 25 04:41:16 oleg425-client sshd[80377]: Disconnected from user root 192.168.204.25 port 44480 May 25 04:41:16 oleg425-client sshd[80363]: pam_unix(sshd:session): session closed for user root May 25 04:41:16 oleg425-client systemd[1]: session-426.scope: Succeeded. May 25 04:41:16 oleg425-client systemd-logind[1020]: Session 426 logged out. Waiting for processes to exit. May 25 04:41:16 oleg425-client systemd-logind[1020]: Removed session 426. May 25 04:41:16 oleg425-client kernel: Lustre: *** cfs_fail_loc=510, val=3*** May 25 04:41:19 oleg425-client sshd[80577]: Accepted publickey for root from 192.168.204.25 port 44492 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:20 oleg425-client systemd-logind[1020]: New session 427 of user root. May 25 04:41:20 oleg425-client systemd[1]: Started Session 427 of user root. May 25 04:41:20 oleg425-client sshd[80577]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:20 oleg425-client sshd[80590]: Received disconnect from 192.168.204.25 port 44492:11: disconnected by user May 25 04:41:20 oleg425-client sshd[80590]: Disconnected from user root 192.168.204.25 port 44492 May 25 04:41:20 oleg425-client sshd[80577]: pam_unix(sshd:session): session closed for user root May 25 04:41:20 oleg425-client systemd[1]: session-427.scope: Succeeded. May 25 04:41:20 oleg425-client systemd-logind[1020]: Session 427 logged out. Waiting for processes to exit. May 25 04:41:20 oleg425-client systemd-logind[1020]: Removed session 427. May 25 04:41:21 oleg425-client sshd[80714]: Accepted publickey for root from 192.168.204.25 port 44504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:21 oleg425-client systemd-logind[1020]: New session 428 of user root. May 25 04:41:21 oleg425-client systemd[1]: Started Session 428 of user root. May 25 04:41:21 oleg425-client sshd[80714]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:22 oleg425-client sshd[80727]: Received disconnect from 192.168.204.25 port 44504:11: disconnected by user May 25 04:41:22 oleg425-client sshd[80727]: Disconnected from user root 192.168.204.25 port 44504 May 25 04:41:22 oleg425-client sshd[80714]: pam_unix(sshd:session): session closed for user root May 25 04:41:22 oleg425-client systemd[1]: session-428.scope: Succeeded. May 25 04:41:22 oleg425-client systemd-logind[1020]: Session 428 logged out. Waiting for processes to exit. May 25 04:41:22 oleg425-client systemd-logind[1020]: Removed session 428. May 25 04:41:23 oleg425-client sshd[80859]: Accepted publickey for root from 192.168.204.25 port 44510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:23 oleg425-client systemd[1]: Started Session 429 of user root. May 25 04:41:23 oleg425-client systemd-logind[1020]: New session 429 of user root. May 25 04:41:23 oleg425-client sshd[80859]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:23 oleg425-client sshd[80872]: Received disconnect from 192.168.204.25 port 44510:11: disconnected by user May 25 04:41:23 oleg425-client sshd[80872]: Disconnected from user root 192.168.204.25 port 44510 May 25 04:41:23 oleg425-client sshd[80859]: pam_unix(sshd:session): session closed for user root May 25 04:41:24 oleg425-client systemd-logind[1020]: Session 429 logged out. Waiting for processes to exit. May 25 04:41:24 oleg425-client systemd[1]: session-429.scope: Succeeded. May 25 04:41:24 oleg425-client systemd-logind[1020]: Removed session 429. May 25 04:41:25 oleg425-client sshd[81012]: Accepted publickey for root from 192.168.204.25 port 39930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:25 oleg425-client systemd[1]: Started Session 430 of user root. May 25 04:41:25 oleg425-client systemd-logind[1020]: New session 430 of user root. May 25 04:41:25 oleg425-client sshd[81012]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:26 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115f: read: late REQ MDunlink and no reply ========================================================== 04:41:24 (1779698484) May 25 04:41:26 oleg425-client sshd[81025]: Received disconnect from 192.168.204.25 port 39930:11: disconnected by user May 25 04:41:26 oleg425-client sshd[81025]: Disconnected from user root 192.168.204.25 port 39930 May 25 04:41:26 oleg425-client sshd[81012]: pam_unix(sshd:session): session closed for user root May 25 04:41:26 oleg425-client systemd-logind[1020]: Session 430 logged out. Waiting for processes to exit. May 25 04:41:26 oleg425-client systemd[1]: session-430.scope: Succeeded. May 25 04:41:26 oleg425-client systemd-logind[1020]: Removed session 430. May 25 04:41:26 oleg425-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** May 25 04:42:26 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab46800: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:42:26 oleg425-client kernel: Lustre: Skipped 15 previous similar messages May 25 04:42:27 oleg425-client sshd[81234]: Accepted publickey for root from 192.168.204.25 port 52016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:27 oleg425-client systemd-logind[1020]: New session 431 of user root. May 25 04:42:27 oleg425-client systemd[1]: Started Session 431 of user root. May 25 04:42:27 oleg425-client sshd[81234]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:27 oleg425-client sshd[81247]: Received disconnect from 192.168.204.25 port 52016:11: disconnected by user May 25 04:42:27 oleg425-client sshd[81247]: Disconnected from user root 192.168.204.25 port 52016 May 25 04:42:27 oleg425-client sshd[81234]: pam_unix(sshd:session): session closed for user root May 25 04:42:28 oleg425-client systemd[1]: session-431.scope: Succeeded. May 25 04:42:28 oleg425-client systemd-logind[1020]: Session 431 logged out. Waiting for processes to exit. May 25 04:42:28 oleg425-client systemd-logind[1020]: Removed session 431. May 25 04:42:29 oleg425-client sshd[81371]: Accepted publickey for root from 192.168.204.25 port 52022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:29 oleg425-client systemd-logind[1020]: New session 432 of user root. May 25 04:42:29 oleg425-client systemd[1]: Started Session 432 of user root. May 25 04:42:29 oleg425-client sshd[81371]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:30 oleg425-client sshd[81384]: Received disconnect from 192.168.204.25 port 52022:11: disconnected by user May 25 04:42:30 oleg425-client sshd[81384]: Disconnected from user root 192.168.204.25 port 52022 May 25 04:42:30 oleg425-client sshd[81371]: pam_unix(sshd:session): session closed for user root May 25 04:42:30 oleg425-client systemd[1]: session-432.scope: Succeeded. May 25 04:42:30 oleg425-client systemd-logind[1020]: Session 432 logged out. Waiting for processes to exit. May 25 04:42:30 oleg425-client systemd-logind[1020]: Removed session 432. May 25 04:42:31 oleg425-client sshd[81516]: Accepted publickey for root from 192.168.204.25 port 52024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:31 oleg425-client systemd-logind[1020]: New session 433 of user root. May 25 04:42:31 oleg425-client systemd[1]: Started Session 433 of user root. May 25 04:42:31 oleg425-client sshd[81516]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:31 oleg425-client sshd[81529]: Received disconnect from 192.168.204.25 port 52024:11: disconnected by user May 25 04:42:31 oleg425-client sshd[81529]: Disconnected from user root 192.168.204.25 port 52024 May 25 04:42:31 oleg425-client sshd[81516]: pam_unix(sshd:session): session closed for user root May 25 04:42:31 oleg425-client systemd[1]: session-433.scope: Succeeded. May 25 04:42:31 oleg425-client systemd-logind[1020]: Session 433 logged out. Waiting for processes to exit. May 25 04:42:31 oleg425-client systemd-logind[1020]: Removed session 433. May 25 04:42:32 oleg425-client sshd[81670]: Accepted publickey for root from 192.168.204.25 port 52034 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:32 oleg425-client systemd-logind[1020]: New session 434 of user root. May 25 04:42:32 oleg425-client systemd[1]: Started Session 434 of user root. May 25 04:42:32 oleg425-client sshd[81670]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:33 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115g: read: late REQ MDunlink and Reply MDunlink ========================================================== 04:42:32 (1779698552) May 25 04:42:33 oleg425-client sshd[81683]: Received disconnect from 192.168.204.25 port 52034:11: disconnected by user May 25 04:42:33 oleg425-client sshd[81683]: Disconnected from user root 192.168.204.25 port 52034 May 25 04:42:33 oleg425-client sshd[81670]: pam_unix(sshd:session): session closed for user root May 25 04:42:33 oleg425-client systemd-logind[1020]: Session 434 logged out. Waiting for processes to exit. May 25 04:42:33 oleg425-client systemd[1]: session-434.scope: Succeeded. May 25 04:42:33 oleg425-client systemd-logind[1020]: Removed session 434. May 25 04:42:33 oleg425-client kernel: Lustre: *** cfs_fail_loc=51c, val=3*** May 25 04:43:34 oleg425-client sshd[81892]: Accepted publickey for root from 192.168.204.25 port 34618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:34 oleg425-client systemd-logind[1020]: New session 435 of user root. May 25 04:43:34 oleg425-client systemd[1]: Started Session 435 of user root. May 25 04:43:34 oleg425-client sshd[81892]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:35 oleg425-client sshd[81905]: Received disconnect from 192.168.204.25 port 34618:11: disconnected by user May 25 04:43:35 oleg425-client sshd[81905]: Disconnected from user root 192.168.204.25 port 34618 May 25 04:43:35 oleg425-client sshd[81892]: pam_unix(sshd:session): session closed for user root May 25 04:43:35 oleg425-client systemd[1]: session-435.scope: Succeeded. May 25 04:43:35 oleg425-client systemd-logind[1020]: Session 435 logged out. Waiting for processes to exit. May 25 04:43:35 oleg425-client systemd-logind[1020]: Removed session 435. May 25 04:43:37 oleg425-client sshd[82029]: Accepted publickey for root from 192.168.204.25 port 34632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:37 oleg425-client systemd-logind[1020]: New session 436 of user root. May 25 04:43:37 oleg425-client systemd[1]: Started Session 436 of user root. May 25 04:43:37 oleg425-client sshd[82029]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:37 oleg425-client sshd[82042]: Received disconnect from 192.168.204.25 port 34632:11: disconnected by user May 25 04:43:37 oleg425-client sshd[82042]: Disconnected from user root 192.168.204.25 port 34632 May 25 04:43:37 oleg425-client sshd[82029]: pam_unix(sshd:session): session closed for user root May 25 04:43:37 oleg425-client systemd-logind[1020]: Session 436 logged out. Waiting for processes to exit. May 25 04:43:37 oleg425-client systemd[1]: session-436.scope: Succeeded. May 25 04:43:37 oleg425-client systemd-logind[1020]: Removed session 436. May 25 04:43:38 oleg425-client sshd[82173]: Accepted publickey for root from 192.168.204.25 port 34634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:38 oleg425-client systemd[1]: Started Session 437 of user root. May 25 04:43:38 oleg425-client systemd-logind[1020]: New session 437 of user root. May 25 04:43:38 oleg425-client sshd[82173]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:38 oleg425-client sshd[82186]: Received disconnect from 192.168.204.25 port 34634:11: disconnected by user May 25 04:43:38 oleg425-client sshd[82186]: Disconnected from user root 192.168.204.25 port 34634 May 25 04:43:38 oleg425-client sshd[82173]: pam_unix(sshd:session): session closed for user root May 25 04:43:38 oleg425-client systemd[1]: session-437.scope: Succeeded. May 25 04:43:38 oleg425-client systemd-logind[1020]: Session 437 logged out. Waiting for processes to exit. May 25 04:43:39 oleg425-client systemd-logind[1020]: Removed session 437. May 25 04:43:40 oleg425-client sshd[82327]: Accepted publickey for root from 192.168.204.25 port 34650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:40 oleg425-client systemd-logind[1020]: New session 438 of user root. May 25 04:43:40 oleg425-client systemd[1]: Started Session 438 of user root. May 25 04:43:40 oleg425-client sshd[82327]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:40 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 120: flock race: completion vs. evict ========================================================== 04:43:39 (1779698619) May 25 04:43:40 oleg425-client sshd[82340]: Received disconnect from 192.168.204.25 port 34650:11: disconnected by user May 25 04:43:40 oleg425-client sshd[82340]: Disconnected from user root 192.168.204.25 port 34650 May 25 04:43:40 oleg425-client sshd[82327]: pam_unix(sshd:session): session closed for user root May 25 04:43:40 oleg425-client systemd[1]: session-438.scope: Succeeded. May 25 04:43:40 oleg425-client systemd-logind[1020]: Session 438 logged out. Waiting for processes to exit. May 25 04:43:40 oleg425-client systemd-logind[1020]: Removed session 438. May 25 04:43:41 oleg425-client kernel: LustreError: 82381:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 04:43:44 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -107 May 25 04:43:44 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:43:44 oleg425-client kernel: LustreError: 82396:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b0ab46800: namespace resource [0x20000a042:0x11:0x0].0xc (ffffa09b104f3d00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:43:44 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab46800: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 04:43:44 oleg425-client kernel: Lustre: Skipped 13 previous similar messages May 25 04:43:45 oleg425-client kernel: LustreError: 82381:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 04:43:47 oleg425-client kernel: LustreError: 82412:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 04:43:50 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:43:50 oleg425-client kernel: LustreError: 82426:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b0ab46800: namespace resource [0x20000a042:0x11:0x0].0xc (ffffa09b105c4c00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:43:50 oleg425-client kernel: LustreError: 82426:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 04:43:51 oleg425-client kernel: LustreError: 82412:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 04:43:58 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:43:58 oleg425-client kernel: LustreError: 82468:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms May 25 04:44:01 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:01 oleg425-client kernel: LustreError: 82488:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:44:01 oleg425-client kernel: LustreError: 82488:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 13 previous similar messages May 25 04:44:02 oleg425-client kernel: LustreError: 82468:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake May 25 04:44:02 oleg425-client kernel: LustreError: 82494:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:44:02 oleg425-client kernel: LustreError: 82468:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffffa09b0ab46800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108 May 25 04:44:03 oleg425-client kernel: LustreError: 82494:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 5 previous similar messages May 25 04:44:05 oleg425-client kernel: LustreError: 82516:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:44:05 oleg425-client kernel: LustreError: 82516:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 13 previous similar messages May 25 04:44:09 oleg425-client kernel: LustreError: 82543:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms May 25 04:44:12 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:12 oleg425-client kernel: LustreError: 82558:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b0ab46800: namespace resource [0x20000a042:0x11:0x0].0xc (ffffa09b104f3000) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:44:12 oleg425-client kernel: LustreError: 82558:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 04:44:13 oleg425-client kernel: LustreError: 82543:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake May 25 04:44:20 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:20 oleg425-client kernel: LustreError: 82599:0:(ldlm_flock.c:858:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 sleeping for 4000ms May 25 04:44:23 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:23 oleg425-client kernel: LustreError: 82614:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b0ab46800: namespace resource [0x20000a042:0x11:0x0].0xc (ffffa09b0a943200) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:44:23 oleg425-client kernel: LustreError: 82614:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 04:44:24 oleg425-client kernel: LustreError: 82599:0:(ldlm_flock.c:858:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 awake May 25 04:44:27 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:27 oleg425-client kernel: LustreError: 82647:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:44:27 oleg425-client kernel: LustreError: 82647:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 6 previous similar messages May 25 04:44:28 oleg425-client kernel: LustreError: 82627:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffffa09b0ab46800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108 May 25 04:44:36 oleg425-client kernel: LustreError: 82699:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 04:44:36 oleg425-client kernel: LustreError: 82699:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) Skipped 1 previous similar message May 25 04:44:40 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:44:40 oleg425-client kernel: LustreError: 82699:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 04:44:41 oleg425-client kernel: LustreError: 82699:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) Skipped 1 previous similar message May 25 04:44:41 oleg425-client kernel: LustreError: 82699:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffffa09b0ab46800: inode [0x20000a042:0x11:0x0] mdc close failed: rc = -108 May 25 04:44:41 oleg425-client kernel: LustreError: 82721:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:44:41 oleg425-client kernel: LustreError: 82721:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 26 previous similar messages May 25 04:44:47 oleg425-client sshd[82857]: Accepted publickey for root from 192.168.204.25 port 38280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:47 oleg425-client systemd-logind[1020]: New session 439 of user root. May 25 04:44:47 oleg425-client systemd[1]: Started Session 439 of user root. May 25 04:44:47 oleg425-client sshd[82857]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:47 oleg425-client sshd[82870]: Received disconnect from 192.168.204.25 port 38280:11: disconnected by user May 25 04:44:47 oleg425-client sshd[82870]: Disconnected from user root 192.168.204.25 port 38280 May 25 04:44:47 oleg425-client sshd[82857]: pam_unix(sshd:session): session closed for user root May 25 04:44:47 oleg425-client systemd[1]: session-439.scope: Succeeded. May 25 04:44:47 oleg425-client systemd-logind[1020]: Session 439 logged out. Waiting for processes to exit. May 25 04:44:47 oleg425-client systemd-logind[1020]: Removed session 439. May 25 04:44:48 oleg425-client sshd[82994]: Accepted publickey for root from 192.168.204.25 port 38286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:48 oleg425-client systemd[1]: Started Session 440 of user root. May 25 04:44:48 oleg425-client systemd-logind[1020]: New session 440 of user root. May 25 04:44:48 oleg425-client sshd[82994]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:49 oleg425-client sshd[83007]: Received disconnect from 192.168.204.25 port 38286:11: disconnected by user May 25 04:44:49 oleg425-client sshd[83007]: Disconnected from user root 192.168.204.25 port 38286 May 25 04:44:49 oleg425-client sshd[82994]: pam_unix(sshd:session): session closed for user root May 25 04:44:49 oleg425-client systemd[1]: session-440.scope: Succeeded. May 25 04:44:49 oleg425-client systemd-logind[1020]: Session 440 logged out. Waiting for processes to exit. May 25 04:44:49 oleg425-client systemd-logind[1020]: Removed session 440. May 25 04:44:50 oleg425-client sshd[83139]: Accepted publickey for root from 192.168.204.25 port 38294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:50 oleg425-client systemd-logind[1020]: New session 441 of user root. May 25 04:44:50 oleg425-client systemd[1]: Started Session 441 of user root. May 25 04:44:50 oleg425-client sshd[83139]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:50 oleg425-client sshd[83152]: Received disconnect from 192.168.204.25 port 38294:11: disconnected by user May 25 04:44:50 oleg425-client sshd[83152]: Disconnected from user root 192.168.204.25 port 38294 May 25 04:44:50 oleg425-client sshd[83139]: pam_unix(sshd:session): session closed for user root May 25 04:44:51 oleg425-client systemd[1]: session-441.scope: Succeeded. May 25 04:44:51 oleg425-client systemd-logind[1020]: Session 441 logged out. Waiting for processes to exit. May 25 04:44:51 oleg425-client systemd-logind[1020]: Removed session 441. May 25 04:44:52 oleg425-client sshd[83292]: Accepted publickey for root from 192.168.204.25 port 38296 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:52 oleg425-client systemd-logind[1020]: New session 442 of user root. May 25 04:44:52 oleg425-client systemd[1]: Started Session 442 of user root. May 25 04:44:52 oleg425-client sshd[83292]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:52 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 113: ldlm enqueue dropped reply should not cause deadlocks ========================================================== 04:44:51 (1779698691) May 25 04:44:52 oleg425-client sshd[83305]: Received disconnect from 192.168.204.25 port 38296:11: disconnected by user May 25 04:44:52 oleg425-client sshd[83305]: Disconnected from user root 192.168.204.25 port 38296 May 25 04:44:52 oleg425-client sshd[83292]: pam_unix(sshd:session): session closed for user root May 25 04:44:53 oleg425-client systemd[1]: session-442.scope: Succeeded. May 25 04:44:53 oleg425-client systemd-logind[1020]: Session 442 logged out. Waiting for processes to exit. May 25 04:44:53 oleg425-client systemd-logind[1020]: Removed session 442. May 25 04:45:12 oleg425-client kernel: LustreError: 67682:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f sleeping for 4000ms May 25 04:45:12 oleg425-client kernel: LustreError: 67682:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message May 25 04:45:17 oleg425-client kernel: LustreError: 67682:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f awake May 25 04:45:17 oleg425-client kernel: LustreError: 67682:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) Skipped 1 previous similar message May 25 04:45:19 oleg425-client sshd[83550]: Accepted publickey for root from 192.168.204.25 port 46918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:19 oleg425-client systemd-logind[1020]: New session 443 of user root. May 25 04:45:19 oleg425-client systemd[1]: Started Session 443 of user root. May 25 04:45:19 oleg425-client sshd[83550]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:19 oleg425-client sshd[83563]: Received disconnect from 192.168.204.25 port 46918:11: disconnected by user May 25 04:45:19 oleg425-client sshd[83563]: Disconnected from user root 192.168.204.25 port 46918 May 25 04:45:19 oleg425-client sshd[83550]: pam_unix(sshd:session): session closed for user root May 25 04:45:19 oleg425-client systemd[1]: session-443.scope: Succeeded. May 25 04:45:19 oleg425-client systemd-logind[1020]: Session 443 logged out. Waiting for processes to exit. May 25 04:45:19 oleg425-client systemd-logind[1020]: Removed session 443. May 25 04:45:21 oleg425-client sshd[83687]: Accepted publickey for root from 192.168.204.25 port 46924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:21 oleg425-client systemd-logind[1020]: New session 444 of user root. May 25 04:45:21 oleg425-client systemd[1]: Started Session 444 of user root. May 25 04:45:21 oleg425-client sshd[83687]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:21 oleg425-client sshd[83700]: Received disconnect from 192.168.204.25 port 46924:11: disconnected by user May 25 04:45:21 oleg425-client sshd[83700]: Disconnected from user root 192.168.204.25 port 46924 May 25 04:45:21 oleg425-client sshd[83687]: pam_unix(sshd:session): session closed for user root May 25 04:45:21 oleg425-client systemd-logind[1020]: Session 444 logged out. Waiting for processes to exit. May 25 04:45:21 oleg425-client systemd[1]: session-444.scope: Succeeded. May 25 04:45:21 oleg425-client systemd-logind[1020]: Removed session 444. May 25 04:45:23 oleg425-client sshd[83831]: Accepted publickey for root from 192.168.204.25 port 46928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:23 oleg425-client systemd-logind[1020]: New session 445 of user root. May 25 04:45:23 oleg425-client systemd[1]: Started Session 445 of user root. May 25 04:45:23 oleg425-client sshd[83831]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:23 oleg425-client sshd[83844]: Received disconnect from 192.168.204.25 port 46928:11: disconnected by user May 25 04:45:23 oleg425-client sshd[83844]: Disconnected from user root 192.168.204.25 port 46928 May 25 04:45:23 oleg425-client sshd[83831]: pam_unix(sshd:session): session closed for user root May 25 04:45:24 oleg425-client systemd[1]: session-445.scope: Succeeded. May 25 04:45:24 oleg425-client systemd-logind[1020]: Session 445 logged out. Waiting for processes to exit. May 25 04:45:24 oleg425-client systemd-logind[1020]: Removed session 445. May 25 04:45:25 oleg425-client sshd[83985]: Accepted publickey for root from 192.168.204.25 port 32974 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:25 oleg425-client systemd[1]: Started Session 446 of user root. May 25 04:45:25 oleg425-client systemd-logind[1020]: New session 446 of user root. May 25 04:45:25 oleg425-client sshd[83985]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:25 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130a: enqueue resend on not existing file ========================================================== 04:45:24 (1779698724) May 25 04:45:25 oleg425-client sshd[83998]: Received disconnect from 192.168.204.25 port 32974:11: disconnected by user May 25 04:45:25 oleg425-client sshd[83998]: Disconnected from user root 192.168.204.25 port 32974 May 25 04:45:25 oleg425-client sshd[83985]: pam_unix(sshd:session): session closed for user root May 25 04:45:25 oleg425-client systemd[1]: session-446.scope: Succeeded. May 25 04:45:25 oleg425-client systemd-logind[1020]: Session 446 logged out. Waiting for processes to exit. May 25 04:45:25 oleg425-client systemd-logind[1020]: Removed session 446. May 25 04:46:09 oleg425-client sshd[84282]: Accepted publickey for root from 192.168.204.25 port 35310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:09 oleg425-client systemd-logind[1020]: New session 447 of user root. May 25 04:46:09 oleg425-client systemd[1]: Started Session 447 of user root. May 25 04:46:09 oleg425-client sshd[84282]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:10 oleg425-client sshd[84295]: Received disconnect from 192.168.204.25 port 35310:11: disconnected by user May 25 04:46:10 oleg425-client sshd[84295]: Disconnected from user root 192.168.204.25 port 35310 May 25 04:46:10 oleg425-client sshd[84282]: pam_unix(sshd:session): session closed for user root May 25 04:46:10 oleg425-client systemd[1]: session-447.scope: Succeeded. May 25 04:46:10 oleg425-client systemd-logind[1020]: Session 447 logged out. Waiting for processes to exit. May 25 04:46:10 oleg425-client systemd-logind[1020]: Removed session 447. May 25 04:46:12 oleg425-client sshd[84419]: Accepted publickey for root from 192.168.204.25 port 35322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:12 oleg425-client systemd-logind[1020]: New session 448 of user root. May 25 04:46:12 oleg425-client systemd[1]: Started Session 448 of user root. May 25 04:46:12 oleg425-client sshd[84419]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:13 oleg425-client sshd[84432]: Received disconnect from 192.168.204.25 port 35322:11: disconnected by user May 25 04:46:13 oleg425-client sshd[84432]: Disconnected from user root 192.168.204.25 port 35322 May 25 04:46:13 oleg425-client sshd[84419]: pam_unix(sshd:session): session closed for user root May 25 04:46:13 oleg425-client systemd[1]: session-448.scope: Succeeded. May 25 04:46:13 oleg425-client systemd-logind[1020]: Session 448 logged out. Waiting for processes to exit. May 25 04:46:13 oleg425-client systemd-logind[1020]: Removed session 448. May 25 04:46:14 oleg425-client sshd[84563]: Accepted publickey for root from 192.168.204.25 port 49722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:14 oleg425-client systemd[1]: Started Session 449 of user root. May 25 04:46:14 oleg425-client systemd-logind[1020]: New session 449 of user root. May 25 04:46:14 oleg425-client sshd[84563]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:15 oleg425-client sshd[84577]: Received disconnect from 192.168.204.25 port 49722:11: disconnected by user May 25 04:46:15 oleg425-client sshd[84577]: Disconnected from user root 192.168.204.25 port 49722 May 25 04:46:15 oleg425-client sshd[84563]: pam_unix(sshd:session): session closed for user root May 25 04:46:15 oleg425-client systemd-logind[1020]: Session 449 logged out. Waiting for processes to exit. May 25 04:46:15 oleg425-client systemd[1]: session-449.scope: Succeeded. May 25 04:46:15 oleg425-client systemd-logind[1020]: Removed session 449. May 25 04:46:16 oleg425-client sshd[84717]: Accepted publickey for root from 192.168.204.25 port 49736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:16 oleg425-client systemd-logind[1020]: New session 450 of user root. May 25 04:46:16 oleg425-client systemd[1]: Started Session 450 of user root. May 25 04:46:16 oleg425-client sshd[84717]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:17 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130b: enqueue resend on a stale inode ========================================================== 04:46:15 (1779698775) May 25 04:46:17 oleg425-client sshd[84730]: Received disconnect from 192.168.204.25 port 49736:11: disconnected by user May 25 04:46:17 oleg425-client sshd[84730]: Disconnected from user root 192.168.204.25 port 49736 May 25 04:46:17 oleg425-client sshd[84717]: pam_unix(sshd:session): session closed for user root May 25 04:46:17 oleg425-client systemd[1]: session-450.scope: Succeeded. May 25 04:46:17 oleg425-client systemd-logind[1020]: Session 450 logged out. Waiting for processes to exit. May 25 04:46:17 oleg425-client systemd-logind[1020]: Removed session 450. May 25 04:47:15 oleg425-client sshd[85082]: Accepted publickey for root from 192.168.204.25 port 57892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:15 oleg425-client systemd-logind[1020]: New session 451 of user root. May 25 04:47:15 oleg425-client systemd[1]: Started Session 451 of user root. May 25 04:47:15 oleg425-client sshd[85082]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:15 oleg425-client sshd[85095]: Received disconnect from 192.168.204.25 port 57892:11: disconnected by user May 25 04:47:15 oleg425-client sshd[85095]: Disconnected from user root 192.168.204.25 port 57892 May 25 04:47:15 oleg425-client sshd[85082]: pam_unix(sshd:session): session closed for user root May 25 04:47:15 oleg425-client systemd-logind[1020]: Session 451 logged out. Waiting for processes to exit. May 25 04:47:15 oleg425-client systemd[1]: session-451.scope: Succeeded. May 25 04:47:15 oleg425-client systemd-logind[1020]: Removed session 451. May 25 04:47:18 oleg425-client sshd[85219]: Accepted publickey for root from 192.168.204.25 port 57906 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:18 oleg425-client systemd[1]: Started Session 452 of user root. May 25 04:47:18 oleg425-client systemd-logind[1020]: New session 452 of user root. May 25 04:47:18 oleg425-client sshd[85219]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:18 oleg425-client sshd[85232]: Received disconnect from 192.168.204.25 port 57906:11: disconnected by user May 25 04:47:18 oleg425-client sshd[85232]: Disconnected from user root 192.168.204.25 port 57906 May 25 04:47:18 oleg425-client sshd[85219]: pam_unix(sshd:session): session closed for user root May 25 04:47:19 oleg425-client systemd[1]: session-452.scope: Succeeded. May 25 04:47:19 oleg425-client systemd-logind[1020]: Session 452 logged out. Waiting for processes to exit. May 25 04:47:19 oleg425-client systemd-logind[1020]: Removed session 452. May 25 04:47:20 oleg425-client sshd[85363]: Accepted publickey for root from 192.168.204.25 port 57922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:20 oleg425-client systemd[1]: Started Session 453 of user root. May 25 04:47:20 oleg425-client systemd-logind[1020]: New session 453 of user root. May 25 04:47:20 oleg425-client sshd[85363]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:21 oleg425-client sshd[85376]: Received disconnect from 192.168.204.25 port 57922:11: disconnected by user May 25 04:47:21 oleg425-client sshd[85376]: Disconnected from user root 192.168.204.25 port 57922 May 25 04:47:21 oleg425-client sshd[85363]: pam_unix(sshd:session): session closed for user root May 25 04:47:21 oleg425-client systemd[1]: session-453.scope: Succeeded. May 25 04:47:21 oleg425-client systemd-logind[1020]: Session 453 logged out. Waiting for processes to exit. May 25 04:47:21 oleg425-client systemd-logind[1020]: Removed session 453. May 25 04:47:22 oleg425-client sshd[85518]: Accepted publickey for root from 192.168.204.25 port 57936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:22 oleg425-client systemd-logind[1020]: New session 454 of user root. May 25 04:47:22 oleg425-client systemd[1]: Started Session 454 of user root. May 25 04:47:22 oleg425-client sshd[85518]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:22 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130c: layout intent resend on a stale inode ========================================================== 04:47:21 (1779698841) May 25 04:47:22 oleg425-client sshd[85531]: Received disconnect from 192.168.204.25 port 57936:11: disconnected by user May 25 04:47:22 oleg425-client sshd[85531]: Disconnected from user root 192.168.204.25 port 57936 May 25 04:47:22 oleg425-client sshd[85518]: pam_unix(sshd:session): session closed for user root May 25 04:47:22 oleg425-client systemd-logind[1020]: Session 454 logged out. Waiting for processes to exit. May 25 04:47:22 oleg425-client systemd[1]: session-454.scope: Succeeded. May 25 04:47:22 oleg425-client systemd-logind[1020]: Removed session 454. May 25 04:47:52 oleg425-client sshd[85844]: Accepted publickey for root from 192.168.204.25 port 48046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:52 oleg425-client systemd[1]: Started Session 455 of user root. May 25 04:47:52 oleg425-client systemd-logind[1020]: New session 455 of user root. May 25 04:47:52 oleg425-client sshd[85844]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:52 oleg425-client sshd[85857]: Received disconnect from 192.168.204.25 port 48046:11: disconnected by user May 25 04:47:52 oleg425-client sshd[85857]: Disconnected from user root 192.168.204.25 port 48046 May 25 04:47:52 oleg425-client sshd[85844]: pam_unix(sshd:session): session closed for user root May 25 04:47:52 oleg425-client systemd[1]: session-455.scope: Succeeded. May 25 04:47:52 oleg425-client systemd-logind[1020]: Session 455 logged out. Waiting for processes to exit. May 25 04:47:52 oleg425-client systemd-logind[1020]: Removed session 455. May 25 04:47:53 oleg425-client sshd[85981]: Accepted publickey for root from 192.168.204.25 port 48060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:53 oleg425-client systemd-logind[1020]: New session 456 of user root. May 25 04:47:53 oleg425-client systemd[1]: Started Session 456 of user root. May 25 04:47:53 oleg425-client sshd[85981]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:54 oleg425-client sshd[85994]: Received disconnect from 192.168.204.25 port 48060:11: disconnected by user May 25 04:47:54 oleg425-client sshd[85994]: Disconnected from user root 192.168.204.25 port 48060 May 25 04:47:54 oleg425-client sshd[85981]: pam_unix(sshd:session): session closed for user root May 25 04:47:54 oleg425-client systemd[1]: session-456.scope: Succeeded. May 25 04:47:54 oleg425-client systemd-logind[1020]: Session 456 logged out. Waiting for processes to exit. May 25 04:47:54 oleg425-client systemd-logind[1020]: Removed session 456. May 25 04:47:55 oleg425-client sshd[86126]: Accepted publickey for root from 192.168.204.25 port 54966 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:55 oleg425-client systemd[1]: Started Session 457 of user root. May 25 04:47:55 oleg425-client systemd-logind[1020]: New session 457 of user root. May 25 04:47:55 oleg425-client sshd[86126]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:56 oleg425-client sshd[86139]: Received disconnect from 192.168.204.25 port 54966:11: disconnected by user May 25 04:47:56 oleg425-client sshd[86139]: Disconnected from user root 192.168.204.25 port 54966 May 25 04:47:56 oleg425-client sshd[86126]: pam_unix(sshd:session): session closed for user root May 25 04:47:56 oleg425-client systemd[1]: session-457.scope: Succeeded. May 25 04:47:56 oleg425-client systemd-logind[1020]: Session 457 logged out. Waiting for processes to exit. May 25 04:47:56 oleg425-client systemd-logind[1020]: Removed session 457. May 25 04:47:57 oleg425-client sshd[86280]: Accepted publickey for root from 192.168.204.25 port 54980 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:57 oleg425-client systemd-logind[1020]: New session 458 of user root. May 25 04:47:57 oleg425-client systemd[1]: Started Session 458 of user root. May 25 04:47:57 oleg425-client sshd[86280]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:58 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 132: long punch =================== 04:47:56 (1779698876) May 25 04:47:58 oleg425-client sshd[86293]: Received disconnect from 192.168.204.25 port 54980:11: disconnected by user May 25 04:47:58 oleg425-client sshd[86293]: Disconnected from user root 192.168.204.25 port 54980 May 25 04:47:58 oleg425-client sshd[86280]: pam_unix(sshd:session): session closed for user root May 25 04:47:58 oleg425-client systemd[1]: session-458.scope: Succeeded. May 25 04:47:58 oleg425-client systemd-logind[1020]: Session 458 logged out. Waiting for processes to exit. May 25 04:47:58 oleg425-client systemd-logind[1020]: Removed session 458. May 25 04:47:58 oleg425-client systemd-udevd[86348]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:47:58 oleg425-client kernel: Lustre: Mounted lustre-client May 25 04:50:04 oleg425-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:50:04 oleg425-client kernel: LustreError: 86413:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b0ab15000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:50:04 oleg425-client kernel: LustreError: 86413:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:50:04 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 04:50:04 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:50:04 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:50:05 oleg425-client sshd[86509]: Accepted publickey for root from 192.168.204.25 port 36286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:05 oleg425-client systemd-logind[1020]: New session 459 of user root. May 25 04:50:05 oleg425-client systemd[1]: Started Session 459 of user root. May 25 04:50:05 oleg425-client sshd[86509]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:06 oleg425-client sshd[86522]: Received disconnect from 192.168.204.25 port 36286:11: disconnected by user May 25 04:50:06 oleg425-client sshd[86522]: Disconnected from user root 192.168.204.25 port 36286 May 25 04:50:06 oleg425-client sshd[86509]: pam_unix(sshd:session): session closed for user root May 25 04:50:06 oleg425-client systemd[1]: session-459.scope: Succeeded. May 25 04:50:06 oleg425-client systemd-logind[1020]: Session 459 logged out. Waiting for processes to exit. May 25 04:50:06 oleg425-client systemd-logind[1020]: Removed session 459. May 25 04:50:07 oleg425-client sshd[86646]: Accepted publickey for root from 192.168.204.25 port 36294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:07 oleg425-client systemd[1]: Started Session 460 of user root. May 25 04:50:07 oleg425-client systemd-logind[1020]: New session 460 of user root. May 25 04:50:07 oleg425-client sshd[86646]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:08 oleg425-client sshd[86659]: Received disconnect from 192.168.204.25 port 36294:11: disconnected by user May 25 04:50:08 oleg425-client sshd[86659]: Disconnected from user root 192.168.204.25 port 36294 May 25 04:50:08 oleg425-client sshd[86646]: pam_unix(sshd:session): session closed for user root May 25 04:50:08 oleg425-client systemd[1]: session-460.scope: Succeeded. May 25 04:50:08 oleg425-client systemd-logind[1020]: Session 460 logged out. Waiting for processes to exit. May 25 04:50:08 oleg425-client systemd-logind[1020]: Removed session 460. May 25 04:50:09 oleg425-client sshd[86791]: Accepted publickey for root from 192.168.204.25 port 36300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:09 oleg425-client systemd-logind[1020]: New session 461 of user root. May 25 04:50:09 oleg425-client systemd[1]: Started Session 461 of user root. May 25 04:50:09 oleg425-client sshd[86791]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:09 oleg425-client sshd[86804]: Received disconnect from 192.168.204.25 port 36300:11: disconnected by user May 25 04:50:10 oleg425-client sshd[86804]: Disconnected from user root 192.168.204.25 port 36300 May 25 04:50:10 oleg425-client sshd[86791]: pam_unix(sshd:session): session closed for user root May 25 04:50:10 oleg425-client systemd[1]: session-461.scope: Succeeded. May 25 04:50:10 oleg425-client systemd-logind[1020]: Session 461 logged out. Waiting for processes to exit. May 25 04:50:10 oleg425-client systemd-logind[1020]: Removed session 461. May 25 04:50:11 oleg425-client sshd[86945]: Accepted publickey for root from 192.168.204.25 port 36304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:11 oleg425-client systemd-logind[1020]: New session 462 of user root. May 25 04:50:11 oleg425-client systemd[1]: Started Session 462 of user root. May 25 04:50:11 oleg425-client sshd[86945]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 131: IO vs evict results to IO under staled lock ========================================================== 04:50:10 (1779699010) May 25 04:50:11 oleg425-client sshd[86958]: Received disconnect from 192.168.204.25 port 36304:11: disconnected by user May 25 04:50:11 oleg425-client sshd[86958]: Disconnected from user root 192.168.204.25 port 36304 May 25 04:50:11 oleg425-client sshd[86945]: pam_unix(sshd:session): session closed for user root May 25 04:50:12 oleg425-client systemd-logind[1020]: Session 462 logged out. Waiting for processes to exit. May 25 04:50:12 oleg425-client systemd[1]: session-462.scope: Succeeded. May 25 04:50:12 oleg425-client systemd-logind[1020]: Removed session 462. May 25 04:50:12 oleg425-client kernel: LustreError: 87028:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 10000ms May 25 04:50:15 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab46800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 04:50:15 oleg425-client kernel: LustreError: 87111:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffffa09b0ab46800: namespace resource [0x240000400:0x408d:0x0].0x0 (ffffa09b0a943300) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:50:15 oleg425-client kernel: LustreError: 87111:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 04:50:16 oleg425-client kernel: LustreError: 87028:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout interrupted May 25 04:50:16 oleg425-client kernel: Lustre: 2373:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.125@tcp:/lustre/fid: [0x20000bf89:0x9:0x0]// may get corrupted (rc -108) May 25 04:50:17 oleg425-client sshd[87206]: Accepted publickey for root from 192.168.204.25 port 33694 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:17 oleg425-client systemd-logind[1020]: New session 463 of user root. May 25 04:50:17 oleg425-client systemd[1]: Started Session 463 of user root. May 25 04:50:17 oleg425-client sshd[87206]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:17 oleg425-client sshd[87219]: Received disconnect from 192.168.204.25 port 33694:11: disconnected by user May 25 04:50:17 oleg425-client sshd[87219]: Disconnected from user root 192.168.204.25 port 33694 May 25 04:50:17 oleg425-client sshd[87206]: pam_unix(sshd:session): session closed for user root May 25 04:50:18 oleg425-client systemd[1]: session-463.scope: Succeeded. May 25 04:50:18 oleg425-client systemd-logind[1020]: Session 463 logged out. Waiting for processes to exit. May 25 04:50:18 oleg425-client systemd-logind[1020]: Removed session 463. May 25 04:50:19 oleg425-client sshd[87343]: Accepted publickey for root from 192.168.204.25 port 33704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:19 oleg425-client systemd-logind[1020]: New session 464 of user root. May 25 04:50:19 oleg425-client systemd[1]: Started Session 464 of user root. May 25 04:50:19 oleg425-client sshd[87343]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:19 oleg425-client sshd[87356]: Received disconnect from 192.168.204.25 port 33704:11: disconnected by user May 25 04:50:19 oleg425-client sshd[87356]: Disconnected from user root 192.168.204.25 port 33704 May 25 04:50:19 oleg425-client sshd[87343]: pam_unix(sshd:session): session closed for user root May 25 04:50:19 oleg425-client systemd[1]: session-464.scope: Succeeded. May 25 04:50:19 oleg425-client systemd-logind[1020]: Session 464 logged out. Waiting for processes to exit. May 25 04:50:19 oleg425-client systemd-logind[1020]: Removed session 464. May 25 04:50:20 oleg425-client sshd[87487]: Accepted publickey for root from 192.168.204.25 port 33720 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:21 oleg425-client systemd-logind[1020]: New session 465 of user root. May 25 04:50:21 oleg425-client systemd[1]: Started Session 465 of user root. May 25 04:50:21 oleg425-client sshd[87487]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:21 oleg425-client sshd[87500]: Received disconnect from 192.168.204.25 port 33720:11: disconnected by user May 25 04:50:21 oleg425-client sshd[87500]: Disconnected from user root 192.168.204.25 port 33720 May 25 04:50:21 oleg425-client sshd[87487]: pam_unix(sshd:session): session closed for user root May 25 04:50:21 oleg425-client systemd-logind[1020]: Session 465 logged out. Waiting for processes to exit. May 25 04:50:21 oleg425-client systemd[1]: session-465.scope: Succeeded. May 25 04:50:21 oleg425-client systemd-logind[1020]: Removed session 465. May 25 04:50:23 oleg425-client sshd[87640]: Accepted publickey for root from 192.168.204.25 port 33736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:23 oleg425-client systemd[1]: Started Session 466 of user root. May 25 04:50:23 oleg425-client systemd-logind[1020]: New session 466 of user root. May 25 04:50:23 oleg425-client sshd[87640]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:23 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 133: don't fail on flock resend === 04:50:21 (1779699021) May 25 04:50:23 oleg425-client sshd[87654]: Received disconnect from 192.168.204.25 port 33736:11: disconnected by user May 25 04:50:23 oleg425-client sshd[87654]: Disconnected from user root 192.168.204.25 port 33736 May 25 04:50:23 oleg425-client sshd[87640]: pam_unix(sshd:session): session closed for user root May 25 04:50:23 oleg425-client systemd[1]: session-466.scope: Succeeded. May 25 04:50:23 oleg425-client systemd-logind[1020]: Session 466 logged out. Waiting for processes to exit. May 25 04:50:23 oleg425-client systemd-logind[1020]: Removed session 466. May 25 04:51:21 oleg425-client kernel: Lustre: 87695:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779699026/real 1779699026] req@ffffa09b104f9500 x1866143446079104/t0(0) o101->lustre-MDT0000-mdc-ffffa09b0ab46800@192.168.204.125@tcp:12/10 lens 328/344 e 0 to 1 dl 1779699081 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 May 25 04:51:21 oleg425-client kernel: Lustre: 87695:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 19 previous similar messages May 25 04:51:23 oleg425-client sshd[87851]: Accepted publickey for root from 192.168.204.25 port 57758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:23 oleg425-client systemd-logind[1020]: New session 467 of user root. May 25 04:51:23 oleg425-client systemd[1]: Started Session 467 of user root. May 25 04:51:23 oleg425-client sshd[87851]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:23 oleg425-client sshd[87864]: Received disconnect from 192.168.204.25 port 57758:11: disconnected by user May 25 04:51:23 oleg425-client sshd[87864]: Disconnected from user root 192.168.204.25 port 57758 May 25 04:51:23 oleg425-client sshd[87851]: pam_unix(sshd:session): session closed for user root May 25 04:51:24 oleg425-client systemd-logind[1020]: Session 467 logged out. Waiting for processes to exit. May 25 04:51:24 oleg425-client systemd[1]: session-467.scope: Succeeded. May 25 04:51:24 oleg425-client systemd-logind[1020]: Removed session 467. May 25 04:51:26 oleg425-client sshd[87988]: Accepted publickey for root from 192.168.204.25 port 50936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:26 oleg425-client systemd[1]: Started Session 468 of user root. May 25 04:51:26 oleg425-client systemd-logind[1020]: New session 468 of user root. May 25 04:51:26 oleg425-client sshd[87988]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:26 oleg425-client sshd[88002]: Received disconnect from 192.168.204.25 port 50936:11: disconnected by user May 25 04:51:26 oleg425-client sshd[88002]: Disconnected from user root 192.168.204.25 port 50936 May 25 04:51:26 oleg425-client sshd[87988]: pam_unix(sshd:session): session closed for user root May 25 04:51:26 oleg425-client systemd[1]: session-468.scope: Succeeded. May 25 04:51:26 oleg425-client systemd-logind[1020]: Session 468 logged out. Waiting for processes to exit. May 25 04:51:26 oleg425-client systemd-logind[1020]: Removed session 468. May 25 04:51:27 oleg425-client sshd[88133]: Accepted publickey for root from 192.168.204.25 port 50944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:27 oleg425-client systemd-logind[1020]: New session 469 of user root. May 25 04:51:27 oleg425-client systemd[1]: Started Session 469 of user root. May 25 04:51:27 oleg425-client sshd[88133]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:28 oleg425-client sshd[88146]: Received disconnect from 192.168.204.25 port 50944:11: disconnected by user May 25 04:51:28 oleg425-client sshd[88146]: Disconnected from user root 192.168.204.25 port 50944 May 25 04:51:28 oleg425-client sshd[88133]: pam_unix(sshd:session): session closed for user root May 25 04:51:28 oleg425-client systemd-logind[1020]: Session 469 logged out. Waiting for processes to exit. May 25 04:51:28 oleg425-client systemd[1]: session-469.scope: Succeeded. May 25 04:51:28 oleg425-client systemd-logind[1020]: Removed session 469. May 25 04:51:29 oleg425-client sshd[88286]: Accepted publickey for root from 192.168.204.25 port 50950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:29 oleg425-client systemd-logind[1020]: New session 470 of user root. May 25 04:51:29 oleg425-client systemd[1]: Started Session 470 of user root. May 25 04:51:29 oleg425-client sshd[88286]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:30 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 134: race between failover and search for reply data free slot ========================================================== 04:51:28 (1779699088) May 25 04:51:30 oleg425-client sshd[88299]: Received disconnect from 192.168.204.25 port 50950:11: disconnected by user May 25 04:51:30 oleg425-client sshd[88299]: Disconnected from user root 192.168.204.25 port 50950 May 25 04:51:30 oleg425-client sshd[88286]: pam_unix(sshd:session): session closed for user root May 25 04:51:30 oleg425-client systemd[1]: session-470.scope: Succeeded. May 25 04:51:30 oleg425-client systemd-logind[1020]: Session 470 logged out. Waiting for processes to exit. May 25 04:51:30 oleg425-client systemd-logind[1020]: Removed session 470. May 25 04:51:31 oleg425-client sshd[88423]: Accepted publickey for root from 192.168.204.25 port 50964 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:31 oleg425-client systemd[1]: Started Session 471 of user root. May 25 04:51:31 oleg425-client systemd-logind[1020]: New session 471 of user root. May 25 04:51:31 oleg425-client sshd[88423]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:31 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_134 Need 2+ clients, have 1 May 25 04:51:31 oleg425-client sshd[88436]: Received disconnect from 192.168.204.25 port 50964:11: disconnected by user May 25 04:51:31 oleg425-client sshd[88436]: Disconnected from user root 192.168.204.25 port 50964 May 25 04:51:31 oleg425-client sshd[88423]: pam_unix(sshd:session): session closed for user root May 25 04:51:32 oleg425-client systemd[1]: session-471.scope: Succeeded. May 25 04:51:32 oleg425-client systemd-logind[1020]: Session 471 logged out. Waiting for processes to exit. May 25 04:51:32 oleg425-client systemd-logind[1020]: Removed session 471. May 25 04:51:32 oleg425-client sshd[88575]: Accepted publickey for root from 192.168.204.25 port 50968 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:33 oleg425-client systemd[1]: Started Session 472 of user root. May 25 04:51:33 oleg425-client systemd-logind[1020]: New session 472 of user root. May 25 04:51:33 oleg425-client sshd[88575]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:33 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 135: DOM: open/create resend to return size ========================================================== 04:51:32 (1779699092) May 25 04:51:33 oleg425-client sshd[88588]: Received disconnect from 192.168.204.25 port 50968:11: disconnected by user May 25 04:51:33 oleg425-client sshd[88588]: Disconnected from user root 192.168.204.25 port 50968 May 25 04:51:33 oleg425-client sshd[88575]: pam_unix(sshd:session): session closed for user root May 25 04:51:33 oleg425-client systemd-logind[1020]: Session 472 logged out. Waiting for processes to exit. May 25 04:51:33 oleg425-client systemd[1]: session-472.scope: Succeeded. May 25 04:51:33 oleg425-client systemd-logind[1020]: Removed session 472. May 25 04:52:30 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b0ab46800: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:52:30 oleg425-client kernel: Lustre: Skipped 15 previous similar messages May 25 04:52:31 oleg425-client sshd[88783]: Accepted publickey for root from 192.168.204.25 port 47210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:31 oleg425-client systemd[1]: Started Session 473 of user root. May 25 04:52:31 oleg425-client systemd-logind[1020]: New session 473 of user root. May 25 04:52:31 oleg425-client sshd[88783]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:32 oleg425-client sshd[88796]: Received disconnect from 192.168.204.25 port 47210:11: disconnected by user May 25 04:52:32 oleg425-client sshd[88796]: Disconnected from user root 192.168.204.25 port 47210 May 25 04:52:32 oleg425-client sshd[88783]: pam_unix(sshd:session): session closed for user root May 25 04:52:32 oleg425-client systemd[1]: session-473.scope: Succeeded. May 25 04:52:32 oleg425-client systemd-logind[1020]: Session 473 logged out. Waiting for processes to exit. May 25 04:52:32 oleg425-client systemd-logind[1020]: Removed session 473. May 25 04:52:33 oleg425-client sshd[88922]: Accepted publickey for root from 192.168.204.25 port 47212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:33 oleg425-client systemd-logind[1020]: New session 474 of user root. May 25 04:52:33 oleg425-client systemd[1]: Started Session 474 of user root. May 25 04:52:33 oleg425-client sshd[88922]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:33 oleg425-client sshd[88935]: Received disconnect from 192.168.204.25 port 47212:11: disconnected by user May 25 04:52:33 oleg425-client sshd[88935]: Disconnected from user root 192.168.204.25 port 47212 May 25 04:52:33 oleg425-client sshd[88922]: pam_unix(sshd:session): session closed for user root May 25 04:52:33 oleg425-client systemd[1]: session-474.scope: Succeeded. May 25 04:52:33 oleg425-client systemd-logind[1020]: Session 474 logged out. Waiting for processes to exit. May 25 04:52:33 oleg425-client systemd-logind[1020]: Removed session 474. May 25 04:52:35 oleg425-client sshd[89067]: Accepted publickey for root from 192.168.204.25 port 42236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:35 oleg425-client systemd-logind[1020]: New session 475 of user root. May 25 04:52:35 oleg425-client systemd[1]: Started Session 475 of user root. May 25 04:52:35 oleg425-client sshd[89067]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:35 oleg425-client sshd[89080]: Received disconnect from 192.168.204.25 port 42236:11: disconnected by user May 25 04:52:35 oleg425-client sshd[89080]: Disconnected from user root 192.168.204.25 port 42236 May 25 04:52:35 oleg425-client sshd[89067]: pam_unix(sshd:session): session closed for user root May 25 04:52:35 oleg425-client systemd[1]: session-475.scope: Succeeded. May 25 04:52:35 oleg425-client systemd-logind[1020]: Session 475 logged out. Waiting for processes to exit. May 25 04:52:36 oleg425-client systemd-logind[1020]: Removed session 475. May 25 04:52:37 oleg425-client sshd[89211]: Accepted publickey for root from 192.168.204.25 port 42252 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:37 oleg425-client systemd-logind[1020]: New session 476 of user root. May 25 04:52:37 oleg425-client systemd[1]: Started Session 476 of user root. May 25 04:52:37 oleg425-client sshd[89211]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:38 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_136 skipping excluded test 136 May 25 04:52:38 oleg425-client sshd[89224]: Received disconnect from 192.168.204.25 port 42252:11: disconnected by user May 25 04:52:38 oleg425-client sshd[89224]: Disconnected from user root 192.168.204.25 port 42252 May 25 04:52:38 oleg425-client sshd[89211]: pam_unix(sshd:session): session closed for user root May 25 04:52:38 oleg425-client systemd[1]: session-476.scope: Succeeded. May 25 04:52:38 oleg425-client systemd-logind[1020]: Session 476 logged out. Waiting for processes to exit. May 25 04:52:38 oleg425-client systemd-logind[1020]: Removed session 476. May 25 04:52:39 oleg425-client sshd[89361]: Accepted publickey for root from 192.168.204.25 port 42266 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:39 oleg425-client systemd-logind[1020]: New session 477 of user root. May 25 04:52:39 oleg425-client systemd[1]: Started Session 477 of user root. May 25 04:52:39 oleg425-client sshd[89361]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:39 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 137: late resend must be skipped if already applied ========================================================== 04:52:38 (1779699158) May 25 04:52:39 oleg425-client sshd[89374]: Received disconnect from 192.168.204.25 port 42266:11: disconnected by user May 25 04:52:39 oleg425-client sshd[89374]: Disconnected from user root 192.168.204.25 port 42266 May 25 04:52:39 oleg425-client sshd[89361]: pam_unix(sshd:session): session closed for user root May 25 04:52:40 oleg425-client systemd[1]: session-477.scope: Succeeded. May 25 04:52:40 oleg425-client systemd-logind[1020]: Session 477 logged out. Waiting for processes to exit. May 25 04:52:40 oleg425-client systemd-logind[1020]: Removed session 477. May 25 04:52:54 oleg425-client sshd[89521]: Accepted publickey for root from 192.168.204.25 port 36558 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:54 oleg425-client systemd-logind[1020]: New session 478 of user root. May 25 04:52:54 oleg425-client systemd[1]: Started Session 478 of user root. May 25 04:52:54 oleg425-client sshd[89521]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:55 oleg425-client sshd[89534]: Received disconnect from 192.168.204.25 port 36558:11: disconnected by user May 25 04:52:55 oleg425-client sshd[89534]: Disconnected from user root 192.168.204.25 port 36558 May 25 04:52:55 oleg425-client sshd[89521]: pam_unix(sshd:session): session closed for user root May 25 04:52:55 oleg425-client systemd[1]: session-478.scope: Succeeded. May 25 04:52:55 oleg425-client systemd-logind[1020]: Session 478 logged out. Waiting for processes to exit. May 25 04:52:55 oleg425-client systemd-logind[1020]: Removed session 478. May 25 04:52:57 oleg425-client sshd[89658]: Accepted publickey for root from 192.168.204.25 port 36572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:57 oleg425-client systemd-logind[1020]: New session 479 of user root. May 25 04:52:57 oleg425-client systemd[1]: Started Session 479 of user root. May 25 04:52:57 oleg425-client sshd[89658]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:58 oleg425-client sshd[89671]: Received disconnect from 192.168.204.25 port 36572:11: disconnected by user May 25 04:52:58 oleg425-client sshd[89671]: Disconnected from user root 192.168.204.25 port 36572 May 25 04:52:58 oleg425-client sshd[89658]: pam_unix(sshd:session): session closed for user root May 25 04:52:58 oleg425-client systemd-logind[1020]: Session 479 logged out. Waiting for processes to exit. May 25 04:52:58 oleg425-client systemd[1]: session-479.scope: Succeeded. May 25 04:52:58 oleg425-client systemd-logind[1020]: Removed session 479. May 25 04:53:00 oleg425-client sshd[89802]: Accepted publickey for root from 192.168.204.25 port 36582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:00 oleg425-client systemd[1]: Started Session 480 of user root. May 25 04:53:00 oleg425-client systemd-logind[1020]: New session 480 of user root. May 25 04:53:00 oleg425-client sshd[89802]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:00 oleg425-client sshd[89816]: Received disconnect from 192.168.204.25 port 36582:11: disconnected by user May 25 04:53:00 oleg425-client sshd[89816]: Disconnected from user root 192.168.204.25 port 36582 May 25 04:53:00 oleg425-client sshd[89802]: pam_unix(sshd:session): session closed for user root May 25 04:53:00 oleg425-client systemd[1]: session-480.scope: Succeeded. May 25 04:53:00 oleg425-client systemd-logind[1020]: Session 480 logged out. Waiting for processes to exit. May 25 04:53:00 oleg425-client systemd-logind[1020]: Removed session 480. May 25 04:53:37 oleg425-client sshd[89962]: Accepted publickey for root from 192.168.204.25 port 42244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:37 oleg425-client systemd-logind[1020]: New session 481 of user root. May 25 04:53:37 oleg425-client systemd[1]: Started Session 481 of user root. May 25 04:53:37 oleg425-client sshd[89962]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:38 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 138: Umount MDT during recovery === 04:53:36 (1779699216) May 25 04:53:38 oleg425-client sshd[89975]: Received disconnect from 192.168.204.25 port 42244:11: disconnected by user May 25 04:53:38 oleg425-client sshd[89975]: Disconnected from user root 192.168.204.25 port 42244 May 25 04:53:38 oleg425-client sshd[89962]: pam_unix(sshd:session): session closed for user root May 25 04:53:38 oleg425-client systemd[1]: session-481.scope: Succeeded. May 25 04:53:38 oleg425-client systemd-logind[1020]: Session 481 logged out. Waiting for processes to exit. May 25 04:53:38 oleg425-client systemd-logind[1020]: Removed session 481. May 25 04:53:40 oleg425-client sshd[90128]: Accepted publickey for root from 192.168.204.25 port 42248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:40 oleg425-client systemd-logind[1020]: New session 482 of user root. May 25 04:53:40 oleg425-client systemd[1]: Started Session 482 of user root. May 25 04:53:40 oleg425-client sshd[90128]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:40 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_138 needs >= 2 MDTs May 25 04:53:40 oleg425-client sshd[90141]: Received disconnect from 192.168.204.25 port 42248:11: disconnected by user May 25 04:53:40 oleg425-client sshd[90141]: Disconnected from user root 192.168.204.25 port 42248 May 25 04:53:40 oleg425-client sshd[90128]: pam_unix(sshd:session): session closed for user root May 25 04:53:40 oleg425-client systemd[1]: session-482.scope: Succeeded. May 25 04:53:40 oleg425-client systemd-logind[1020]: Session 482 logged out. Waiting for processes to exit. May 25 04:53:40 oleg425-client systemd-logind[1020]: Removed session 482. May 25 04:53:42 oleg425-client sshd[90280]: Accepted publickey for root from 192.168.204.25 port 42264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:42 oleg425-client systemd[1]: Started Session 483 of user root. May 25 04:53:42 oleg425-client systemd-logind[1020]: New session 483 of user root. May 25 04:53:42 oleg425-client sshd[90280]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:42 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 139: corrupted catid won't cause crash ========================================================== 04:53:41 (1779699221) May 25 04:53:42 oleg425-client sshd[90293]: Received disconnect from 192.168.204.25 port 42264:11: disconnected by user May 25 04:53:42 oleg425-client sshd[90293]: Disconnected from user root 192.168.204.25 port 42264 May 25 04:53:42 oleg425-client sshd[90280]: pam_unix(sshd:session): session closed for user root May 25 04:53:42 oleg425-client systemd-logind[1020]: Session 483 logged out. Waiting for processes to exit. May 25 04:53:42 oleg425-client systemd[1]: session-483.scope: Succeeded. May 25 04:53:42 oleg425-client systemd-logind[1020]: Removed session 483. May 25 04:53:43 oleg425-client sshd[90416]: Accepted publickey for root from 192.168.204.25 port 42270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:43 oleg425-client systemd[1]: Started Session 484 of user root. May 25 04:53:43 oleg425-client systemd-logind[1020]: New session 484 of user root. May 25 04:53:43 oleg425-client sshd[90416]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:44 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_139 needs >= 2 MDTs May 25 04:53:44 oleg425-client sshd[90429]: Received disconnect from 192.168.204.25 port 42270:11: disconnected by user May 25 04:53:44 oleg425-client sshd[90429]: Disconnected from user root 192.168.204.25 port 42270 May 25 04:53:44 oleg425-client sshd[90416]: pam_unix(sshd:session): session closed for user root May 25 04:53:44 oleg425-client systemd-logind[1020]: Session 484 logged out. Waiting for processes to exit. May 25 04:53:44 oleg425-client systemd[1]: session-484.scope: Succeeded. May 25 04:53:44 oleg425-client systemd-logind[1020]: Removed session 484. May 25 04:53:45 oleg425-client sshd[90569]: Accepted publickey for root from 192.168.204.25 port 49890 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:45 oleg425-client systemd-logind[1020]: New session 485 of user root. May 25 04:53:45 oleg425-client systemd[1]: Started Session 485 of user root. May 25 04:53:45 oleg425-client sshd[90569]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:46 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140a: local mount is flagged properly ========================================================== 04:53:44 (1779699224) May 25 04:53:46 oleg425-client sshd[90582]: Received disconnect from 192.168.204.25 port 49890:11: disconnected by user May 25 04:53:46 oleg425-client sshd[90582]: Disconnected from user root 192.168.204.25 port 49890 May 25 04:53:46 oleg425-client sshd[90569]: pam_unix(sshd:session): session closed for user root May 25 04:53:46 oleg425-client systemd[1]: session-485.scope: Succeeded. May 25 04:53:46 oleg425-client systemd-logind[1020]: Session 485 logged out. Waiting for processes to exit. May 25 04:53:46 oleg425-client systemd-logind[1020]: Removed session 485. May 25 04:54:15 oleg425-client sshd[90920]: Accepted publickey for root from 192.168.204.25 port 36080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:15 oleg425-client systemd[1]: Started Session 486 of user root. May 25 04:54:15 oleg425-client systemd-logind[1020]: New session 486 of user root. May 25 04:54:15 oleg425-client sshd[90920]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:16 oleg425-client sshd[90933]: Received disconnect from 192.168.204.25 port 36080:11: disconnected by user May 25 04:54:16 oleg425-client sshd[90933]: Disconnected from user root 192.168.204.25 port 36080 May 25 04:54:16 oleg425-client sshd[90920]: pam_unix(sshd:session): session closed for user root May 25 04:54:16 oleg425-client systemd[1]: session-486.scope: Succeeded. May 25 04:54:16 oleg425-client systemd-logind[1020]: Session 486 logged out. Waiting for processes to exit. May 25 04:54:16 oleg425-client systemd-logind[1020]: Removed session 486. May 25 04:54:17 oleg425-client sshd[91057]: Accepted publickey for root from 192.168.204.25 port 36092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:17 oleg425-client systemd-logind[1020]: New session 487 of user root. May 25 04:54:17 oleg425-client systemd[1]: Started Session 487 of user root. May 25 04:54:17 oleg425-client sshd[91057]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:17 oleg425-client sshd[91070]: Received disconnect from 192.168.204.25 port 36092:11: disconnected by user May 25 04:54:17 oleg425-client sshd[91070]: Disconnected from user root 192.168.204.25 port 36092 May 25 04:54:17 oleg425-client sshd[91057]: pam_unix(sshd:session): session closed for user root May 25 04:54:17 oleg425-client systemd[1]: session-487.scope: Succeeded. May 25 04:54:17 oleg425-client systemd-logind[1020]: Session 487 logged out. Waiting for processes to exit. May 25 04:54:17 oleg425-client systemd-logind[1020]: Removed session 487. May 25 04:54:18 oleg425-client sshd[91202]: Accepted publickey for root from 192.168.204.25 port 36100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:18 oleg425-client systemd-logind[1020]: New session 488 of user root. May 25 04:54:18 oleg425-client systemd[1]: Started Session 488 of user root. May 25 04:54:18 oleg425-client sshd[91202]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:19 oleg425-client sshd[91215]: Received disconnect from 192.168.204.25 port 36100:11: disconnected by user May 25 04:54:19 oleg425-client sshd[91215]: Disconnected from user root 192.168.204.25 port 36100 May 25 04:54:19 oleg425-client sshd[91202]: pam_unix(sshd:session): session closed for user root May 25 04:54:19 oleg425-client systemd-logind[1020]: Session 488 logged out. Waiting for processes to exit. May 25 04:54:19 oleg425-client systemd[1]: session-488.scope: Succeeded. May 25 04:54:19 oleg425-client systemd-logind[1020]: Removed session 488. May 25 04:54:21 oleg425-client sshd[91363]: Accepted publickey for root from 192.168.204.25 port 36104 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:21 oleg425-client systemd-logind[1020]: New session 489 of user root. May 25 04:54:21 oleg425-client systemd[1]: Started Session 489 of user root. May 25 04:54:21 oleg425-client sshd[91363]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:22 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140b: local mount is excluded from recovery ========================================================== 04:54:20 (1779699260) May 25 04:54:22 oleg425-client sshd[91376]: Received disconnect from 192.168.204.25 port 36104:11: disconnected by user May 25 04:54:22 oleg425-client sshd[91376]: Disconnected from user root 192.168.204.25 port 36104 May 25 04:54:22 oleg425-client sshd[91363]: pam_unix(sshd:session): session closed for user root May 25 04:54:22 oleg425-client systemd[1]: session-489.scope: Succeeded. May 25 04:54:22 oleg425-client systemd-logind[1020]: Session 489 logged out. Waiting for processes to exit. May 25 04:54:22 oleg425-client systemd-logind[1020]: Removed session 489. May 25 04:54:33 oleg425-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 04:55:01 oleg425-client anacron[47878]: Job `cron.monthly' started May 25 04:55:01 oleg425-client anacron[47878]: Job `cron.monthly' terminated May 25 04:55:01 oleg425-client anacron[47878]: Normal exit (3 jobs run) May 25 04:55:02 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:55:02 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:55:02 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00b1e913 to 0x799e3d1c00b20226 May 25 04:55:02 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 04:55:02 oleg425-client kernel: Lustre: MGC192.168.204.125@tcp: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 04:55:02 oleg425-client kernel: Lustre: Skipped 14 previous similar messages May 25 04:55:10 oleg425-client sshd[91840]: Accepted publickey for root from 192.168.204.25 port 43156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:10 oleg425-client systemd-logind[1020]: New session 490 of user root. May 25 04:55:10 oleg425-client systemd[1]: Started Session 490 of user root. May 25 04:55:10 oleg425-client sshd[91840]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:11 oleg425-client sshd[91853]: Received disconnect from 192.168.204.25 port 43156:11: disconnected by user May 25 04:55:11 oleg425-client sshd[91853]: Disconnected from user root 192.168.204.25 port 43156 May 25 04:55:11 oleg425-client sshd[91840]: pam_unix(sshd:session): session closed for user root May 25 04:55:11 oleg425-client systemd[1]: session-490.scope: Succeeded. May 25 04:55:11 oleg425-client systemd-logind[1020]: Session 490 logged out. Waiting for processes to exit. May 25 04:55:11 oleg425-client systemd-logind[1020]: Removed session 490. May 25 04:55:16 oleg425-client sshd[92074]: Accepted publickey for root from 192.168.204.25 port 58532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:16 oleg425-client systemd[1]: Started Session 491 of user root. May 25 04:55:16 oleg425-client systemd-logind[1020]: New session 491 of user root. May 25 04:55:16 oleg425-client sshd[92074]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:16 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:55:16 oleg425-client sshd[92087]: Received disconnect from 192.168.204.25 port 58532:11: disconnected by user May 25 04:55:16 oleg425-client sshd[92087]: Disconnected from user root 192.168.204.25 port 58532 May 25 04:55:16 oleg425-client sshd[92074]: pam_unix(sshd:session): session closed for user root May 25 04:55:17 oleg425-client systemd[1]: session-491.scope: Succeeded. May 25 04:55:17 oleg425-client systemd-logind[1020]: Session 491 logged out. Waiting for processes to exit. May 25 04:55:17 oleg425-client systemd-logind[1020]: Removed session 491. May 25 04:55:18 oleg425-client sshd[92228]: Accepted publickey for root from 192.168.204.25 port 58538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:18 oleg425-client systemd-logind[1020]: New session 492 of user root. May 25 04:55:18 oleg425-client systemd[1]: Started Session 492 of user root. May 25 04:55:18 oleg425-client sshd[92228]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:19 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:55:19 oleg425-client sshd[92241]: Received disconnect from 192.168.204.25 port 58538:11: disconnected by user May 25 04:55:19 oleg425-client sshd[92241]: Disconnected from user root 192.168.204.25 port 58538 May 25 04:55:19 oleg425-client sshd[92228]: pam_unix(sshd:session): session closed for user root May 25 04:55:19 oleg425-client systemd-logind[1020]: Session 492 logged out. Waiting for processes to exit. May 25 04:55:19 oleg425-client systemd[1]: session-492.scope: Succeeded. May 25 04:55:19 oleg425-client systemd-logind[1020]: Removed session 492. May 25 04:55:20 oleg425-client sshd[92282]: Accepted publickey for root from 192.168.204.25 port 58540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:20 oleg425-client systemd[1]: Started Session 493 of user root. May 25 04:55:20 oleg425-client systemd-logind[1020]: New session 493 of user root. May 25 04:55:20 oleg425-client sshd[92282]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:21 oleg425-client sshd[92296]: Received disconnect from 192.168.204.25 port 58540:11: disconnected by user May 25 04:55:21 oleg425-client sshd[92296]: Disconnected from user root 192.168.204.25 port 58540 May 25 04:55:21 oleg425-client sshd[92282]: pam_unix(sshd:session): session closed for user root May 25 04:55:21 oleg425-client systemd[1]: session-493.scope: Succeeded. May 25 04:55:21 oleg425-client systemd-logind[1020]: Session 493 logged out. Waiting for processes to exit. May 25 04:55:21 oleg425-client systemd-logind[1020]: Removed session 493. May 25 04:55:23 oleg425-client sshd[92426]: Accepted publickey for root from 192.168.204.25 port 58554 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:23 oleg425-client systemd[1]: Started Session 494 of user root. May 25 04:55:23 oleg425-client systemd-logind[1020]: New session 494 of user root. May 25 04:55:23 oleg425-client sshd[92426]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:23 oleg425-client sshd[92439]: Received disconnect from 192.168.204.25 port 58554:11: disconnected by user May 25 04:55:24 oleg425-client sshd[92439]: Disconnected from user root 192.168.204.25 port 58554 May 25 04:55:24 oleg425-client sshd[92426]: pam_unix(sshd:session): session closed for user root May 25 04:55:24 oleg425-client systemd[1]: session-494.scope: Succeeded. May 25 04:55:24 oleg425-client systemd-logind[1020]: Session 494 logged out. Waiting for processes to exit. May 25 04:55:24 oleg425-client systemd-logind[1020]: Removed session 494. May 25 04:55:24 oleg425-client sshd[92563]: Accepted publickey for root from 192.168.204.25 port 48032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:25 oleg425-client systemd-logind[1020]: New session 495 of user root. May 25 04:55:25 oleg425-client systemd[1]: Started Session 495 of user root. May 25 04:55:25 oleg425-client sshd[92563]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:25 oleg425-client sshd[92576]: Received disconnect from 192.168.204.25 port 48032:11: disconnected by user May 25 04:55:25 oleg425-client sshd[92576]: Disconnected from user root 192.168.204.25 port 48032 May 25 04:55:25 oleg425-client sshd[92563]: pam_unix(sshd:session): session closed for user root May 25 04:55:25 oleg425-client systemd-logind[1020]: Session 495 logged out. Waiting for processes to exit. May 25 04:55:25 oleg425-client systemd[1]: session-495.scope: Succeeded. May 25 04:55:25 oleg425-client systemd-logind[1020]: Removed session 495. May 25 04:55:27 oleg425-client sshd[92707]: Accepted publickey for root from 192.168.204.25 port 48046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:27 oleg425-client systemd-logind[1020]: New session 496 of user root. May 25 04:55:27 oleg425-client systemd[1]: Started Session 496 of user root. May 25 04:55:27 oleg425-client sshd[92707]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:27 oleg425-client sshd[92720]: Received disconnect from 192.168.204.25 port 48046:11: disconnected by user May 25 04:55:28 oleg425-client sshd[92720]: Disconnected from user root 192.168.204.25 port 48046 May 25 04:55:28 oleg425-client sshd[92707]: pam_unix(sshd:session): session closed for user root May 25 04:55:28 oleg425-client systemd-logind[1020]: Session 496 logged out. Waiting for processes to exit. May 25 04:55:28 oleg425-client systemd[1]: session-496.scope: Succeeded. May 25 04:55:28 oleg425-client systemd-logind[1020]: Removed session 496. May 25 04:55:30 oleg425-client sshd[92869]: Accepted publickey for root from 192.168.204.25 port 48062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:30 oleg425-client systemd-logind[1020]: New session 497 of user root. May 25 04:55:30 oleg425-client systemd[1]: Started Session 497 of user root. May 25 04:55:30 oleg425-client sshd[92869]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:31 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 141: do not lose locks on MGS restart ========================================================== 04:55:29 (1779699329) May 25 04:55:31 oleg425-client sshd[92882]: Received disconnect from 192.168.204.25 port 48062:11: disconnected by user May 25 04:55:31 oleg425-client sshd[92882]: Disconnected from user root 192.168.204.25 port 48062 May 25 04:55:31 oleg425-client sshd[92869]: pam_unix(sshd:session): session closed for user root May 25 04:55:31 oleg425-client systemd[1]: session-497.scope: Succeeded. May 25 04:55:31 oleg425-client systemd-logind[1020]: Session 497 logged out. Waiting for processes to exit. May 25 04:55:31 oleg425-client systemd-logind[1020]: Removed session 497. May 25 04:55:33 oleg425-client sshd[93131]: Accepted publickey for root from 192.168.204.25 port 48070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:33 oleg425-client systemd-logind[1020]: New session 498 of user root. May 25 04:55:33 oleg425-client systemd[1]: Started Session 498 of user root. May 25 04:55:33 oleg425-client sshd[93131]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:33 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_141 cannot run in local mode or from build tree May 25 04:55:33 oleg425-client sshd[93144]: Received disconnect from 192.168.204.25 port 48070:11: disconnected by user May 25 04:55:33 oleg425-client sshd[93144]: Disconnected from user root 192.168.204.25 port 48070 May 25 04:55:33 oleg425-client sshd[93131]: pam_unix(sshd:session): session closed for user root May 25 04:55:33 oleg425-client systemd-logind[1020]: Session 498 logged out. Waiting for processes to exit. May 25 04:55:33 oleg425-client systemd[1]: session-498.scope: Succeeded. May 25 04:55:33 oleg425-client systemd-logind[1020]: Removed session 498. May 25 04:55:34 oleg425-client sshd[93283]: Accepted publickey for root from 192.168.204.25 port 35284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:34 oleg425-client systemd[1]: Started Session 499 of user root. May 25 04:55:34 oleg425-client systemd-logind[1020]: New session 499 of user root. May 25 04:55:34 oleg425-client sshd[93283]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:35 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 142: orphan name stub can be cleaned up in startup ========================================================== 04:55:33 (1779699333) May 25 04:55:35 oleg425-client sshd[93297]: Received disconnect from 192.168.204.25 port 35284:11: disconnected by user May 25 04:55:35 oleg425-client sshd[93297]: Disconnected from user root 192.168.204.25 port 35284 May 25 04:55:35 oleg425-client sshd[93283]: pam_unix(sshd:session): session closed for user root May 25 04:55:35 oleg425-client systemd[1]: session-499.scope: Succeeded. May 25 04:55:35 oleg425-client systemd-logind[1020]: Session 499 logged out. Waiting for processes to exit. May 25 04:55:35 oleg425-client systemd-logind[1020]: Removed session 499. May 25 04:55:48 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:55:48 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00b20226 to 0x799e3d1c00b205de May 25 04:55:55 oleg425-client sshd[93647]: Accepted publickey for root from 192.168.204.25 port 50372 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:55 oleg425-client systemd[1]: Started Session 500 of user root. May 25 04:55:55 oleg425-client systemd-logind[1020]: New session 500 of user root. May 25 04:55:55 oleg425-client sshd[93647]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:56 oleg425-client sshd[93660]: Received disconnect from 192.168.204.25 port 50372:11: disconnected by user May 25 04:55:56 oleg425-client sshd[93660]: Disconnected from user root 192.168.204.25 port 50372 May 25 04:55:56 oleg425-client sshd[93647]: pam_unix(sshd:session): session closed for user root May 25 04:55:56 oleg425-client systemd-logind[1020]: Session 500 logged out. Waiting for processes to exit. May 25 04:55:56 oleg425-client systemd[1]: session-500.scope: Succeeded. May 25 04:55:56 oleg425-client systemd-logind[1020]: Removed session 500. May 25 04:55:57 oleg425-client sshd[93784]: Accepted publickey for root from 192.168.204.25 port 50376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:57 oleg425-client systemd-logind[1020]: New session 501 of user root. May 25 04:55:57 oleg425-client systemd[1]: Started Session 501 of user root. May 25 04:55:57 oleg425-client sshd[93784]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:57 oleg425-client sshd[93797]: Received disconnect from 192.168.204.25 port 50376:11: disconnected by user May 25 04:55:57 oleg425-client sshd[93797]: Disconnected from user root 192.168.204.25 port 50376 May 25 04:55:57 oleg425-client sshd[93784]: pam_unix(sshd:session): session closed for user root May 25 04:55:57 oleg425-client systemd[1]: session-501.scope: Succeeded. May 25 04:55:57 oleg425-client systemd-logind[1020]: Session 501 logged out. Waiting for processes to exit. May 25 04:55:57 oleg425-client systemd-logind[1020]: Removed session 501. May 25 04:55:58 oleg425-client sshd[93928]: Accepted publickey for root from 192.168.204.25 port 50388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:58 oleg425-client systemd-logind[1020]: New session 502 of user root. May 25 04:55:58 oleg425-client systemd[1]: Started Session 502 of user root. May 25 04:55:59 oleg425-client sshd[93928]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:59 oleg425-client sshd[93941]: Received disconnect from 192.168.204.25 port 50388:11: disconnected by user May 25 04:55:59 oleg425-client sshd[93941]: Disconnected from user root 192.168.204.25 port 50388 May 25 04:55:59 oleg425-client sshd[93928]: pam_unix(sshd:session): session closed for user root May 25 04:55:59 oleg425-client systemd[1]: session-502.scope: Succeeded. May 25 04:55:59 oleg425-client systemd-logind[1020]: Session 502 logged out. Waiting for processes to exit. May 25 04:55:59 oleg425-client systemd-logind[1020]: Removed session 502. May 25 04:56:01 oleg425-client sshd[94082]: Accepted publickey for root from 192.168.204.25 port 50402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:01 oleg425-client systemd[1]: Started Session 503 of user root. May 25 04:56:01 oleg425-client systemd-logind[1020]: New session 503 of user root. May 25 04:56:01 oleg425-client sshd[94082]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:01 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 143: orphan cleanup thread shouldn't be blocked even delete failed ========================================================== 04:55:59 (1779699359) May 25 04:56:01 oleg425-client sshd[94095]: Received disconnect from 192.168.204.25 port 50402:11: disconnected by user May 25 04:56:01 oleg425-client sshd[94095]: Disconnected from user root 192.168.204.25 port 50402 May 25 04:56:01 oleg425-client sshd[94082]: pam_unix(sshd:session): session closed for user root May 25 04:56:02 oleg425-client systemd[1]: session-503.scope: Succeeded. May 25 04:56:02 oleg425-client systemd-logind[1020]: Session 503 logged out. Waiting for processes to exit. May 25 04:56:02 oleg425-client systemd-logind[1020]: Removed session 503. May 25 04:56:47 oleg425-client sshd[94628]: Accepted publickey for root from 192.168.204.25 port 50876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:47 oleg425-client systemd-logind[1020]: New session 504 of user root. May 25 04:56:47 oleg425-client systemd[1]: Started Session 504 of user root. May 25 04:56:47 oleg425-client sshd[94628]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:48 oleg425-client sshd[94641]: Received disconnect from 192.168.204.25 port 50876:11: disconnected by user May 25 04:56:48 oleg425-client sshd[94641]: Disconnected from user root 192.168.204.25 port 50876 May 25 04:56:48 oleg425-client sshd[94628]: pam_unix(sshd:session): session closed for user root May 25 04:56:48 oleg425-client systemd[1]: session-504.scope: Succeeded. May 25 04:56:48 oleg425-client systemd-logind[1020]: Session 504 logged out. Waiting for processes to exit. May 25 04:56:48 oleg425-client systemd-logind[1020]: Removed session 504. May 25 04:56:49 oleg425-client sshd[94766]: Accepted publickey for root from 192.168.204.25 port 50892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:49 oleg425-client systemd-logind[1020]: New session 505 of user root. May 25 04:56:49 oleg425-client systemd[1]: Started Session 505 of user root. May 25 04:56:49 oleg425-client sshd[94766]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:49 oleg425-client sshd[94779]: Received disconnect from 192.168.204.25 port 50892:11: disconnected by user May 25 04:56:49 oleg425-client sshd[94779]: Disconnected from user root 192.168.204.25 port 50892 May 25 04:56:49 oleg425-client sshd[94766]: pam_unix(sshd:session): session closed for user root May 25 04:56:49 oleg425-client systemd[1]: session-505.scope: Succeeded. May 25 04:56:49 oleg425-client systemd-logind[1020]: Session 505 logged out. Waiting for processes to exit. May 25 04:56:49 oleg425-client systemd-logind[1020]: Removed session 505. May 25 04:56:50 oleg425-client sshd[94910]: Accepted publickey for root from 192.168.204.25 port 50896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:50 oleg425-client systemd-logind[1020]: New session 506 of user root. May 25 04:56:50 oleg425-client systemd[1]: Started Session 506 of user root. May 25 04:56:50 oleg425-client sshd[94910]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:51 oleg425-client sshd[94923]: Received disconnect from 192.168.204.25 port 50896:11: disconnected by user May 25 04:56:51 oleg425-client sshd[94923]: Disconnected from user root 192.168.204.25 port 50896 May 25 04:56:51 oleg425-client sshd[94910]: pam_unix(sshd:session): session closed for user root May 25 04:56:51 oleg425-client systemd[1]: session-506.scope: Succeeded. May 25 04:56:51 oleg425-client systemd-logind[1020]: Session 506 logged out. Waiting for processes to exit. May 25 04:56:51 oleg425-client systemd-logind[1020]: Removed session 506. May 25 04:56:52 oleg425-client sshd[95063]: Accepted publickey for root from 192.168.204.25 port 50898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:52 oleg425-client systemd-logind[1020]: New session 507 of user root. May 25 04:56:52 oleg425-client systemd[1]: Started Session 507 of user root. May 25 04:56:52 oleg425-client sshd[95063]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:53 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144a: MDT failover should stop precreation threads ========================================================== 04:56:51 (1779699411) May 25 04:56:53 oleg425-client sshd[95076]: Received disconnect from 192.168.204.25 port 50898:11: disconnected by user May 25 04:56:53 oleg425-client sshd[95076]: Disconnected from user root 192.168.204.25 port 50898 May 25 04:56:53 oleg425-client sshd[95063]: pam_unix(sshd:session): session closed for user root May 25 04:56:53 oleg425-client systemd[1]: session-507.scope: Succeeded. May 25 04:56:53 oleg425-client systemd-logind[1020]: Session 507 logged out. Waiting for processes to exit. May 25 04:56:53 oleg425-client systemd-logind[1020]: Removed session 507. May 25 04:56:59 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab46800: operation ost_setattr to node 192.168.204.125@tcp failed: rc = -19 May 25 04:56:59 oleg425-client kernel: LustreError: Skipped 9 previous similar messages May 25 04:57:41 oleg425-client sshd[95513]: Accepted publickey for root from 192.168.204.25 port 53760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:41 oleg425-client systemd[1]: Started Session 508 of user root. May 25 04:57:41 oleg425-client sshd[95513]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:41 oleg425-client systemd-logind[1020]: New session 508 of user root. May 25 04:57:43 oleg425-client sshd[95526]: Received disconnect from 192.168.204.25 port 53760:11: disconnected by user May 25 04:57:43 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:57:43 oleg425-client sshd[95526]: Disconnected from user root 192.168.204.25 port 53760 May 25 04:57:43 oleg425-client sshd[95513]: pam_unix(sshd:session): session closed for user root May 25 04:57:43 oleg425-client systemd[1]: session-508.scope: Succeeded. May 25 04:57:43 oleg425-client systemd-logind[1020]: Session 508 logged out. Waiting for processes to exit. May 25 04:57:43 oleg425-client systemd-logind[1020]: Removed session 508. May 25 04:57:51 oleg425-client sshd[95750]: Accepted publickey for root from 192.168.204.25 port 44384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:51 oleg425-client systemd[1]: Started Session 509 of user root. May 25 04:57:51 oleg425-client systemd-logind[1020]: New session 509 of user root. May 25 04:57:51 oleg425-client sshd[95750]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:52 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:57:52 oleg425-client sshd[95763]: Received disconnect from 192.168.204.25 port 44384:11: disconnected by user May 25 04:57:52 oleg425-client sshd[95763]: Disconnected from user root 192.168.204.25 port 44384 May 25 04:57:52 oleg425-client sshd[95750]: pam_unix(sshd:session): session closed for user root May 25 04:57:52 oleg425-client systemd[1]: session-509.scope: Succeeded. May 25 04:57:52 oleg425-client systemd-logind[1020]: Session 509 logged out. Waiting for processes to exit. May 25 04:57:52 oleg425-client systemd-logind[1020]: Removed session 509. May 25 04:57:56 oleg425-client sshd[95906]: Accepted publickey for root from 192.168.204.25 port 58940 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:56 oleg425-client systemd[1]: Started Session 510 of user root. May 25 04:57:56 oleg425-client systemd-logind[1020]: New session 510 of user root. May 25 04:57:56 oleg425-client sshd[95906]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:56 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:57:57 oleg425-client sshd[95919]: Received disconnect from 192.168.204.25 port 58940:11: disconnected by user May 25 04:57:57 oleg425-client sshd[95919]: Disconnected from user root 192.168.204.25 port 58940 May 25 04:57:57 oleg425-client sshd[95906]: pam_unix(sshd:session): session closed for user root May 25 04:57:57 oleg425-client systemd[1]: session-510.scope: Succeeded. May 25 04:57:57 oleg425-client systemd-logind[1020]: Session 510 logged out. Waiting for processes to exit. May 25 04:57:57 oleg425-client systemd-logind[1020]: Removed session 510. May 25 04:58:00 oleg425-client sshd[95960]: Accepted publickey for root from 192.168.204.25 port 58954 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:00 oleg425-client systemd-logind[1020]: New session 511 of user root. May 25 04:58:00 oleg425-client systemd[1]: Started Session 511 of user root. May 25 04:58:00 oleg425-client sshd[95960]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:00 oleg425-client sshd[95974]: Received disconnect from 192.168.204.25 port 58954:11: disconnected by user May 25 04:58:00 oleg425-client sshd[95974]: Disconnected from user root 192.168.204.25 port 58954 May 25 04:58:00 oleg425-client sshd[95960]: pam_unix(sshd:session): session closed for user root May 25 04:58:00 oleg425-client systemd[1]: session-511.scope: Succeeded. May 25 04:58:00 oleg425-client systemd-logind[1020]: Session 511 logged out. Waiting for processes to exit. May 25 04:58:00 oleg425-client systemd-logind[1020]: Removed session 511. May 25 04:59:22 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 04:59:22 oleg425-client kernel: LustreError: Skipped 1 previous similar message May 25 04:59:32 oleg425-client sshd[96282]: Accepted publickey for root from 192.168.204.25 port 53994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:32 oleg425-client systemd-logind[1020]: New session 512 of user root. May 25 04:59:32 oleg425-client systemd[1]: Started Session 512 of user root. May 25 04:59:32 oleg425-client sshd[96282]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:32 oleg425-client sshd[96295]: Received disconnect from 192.168.204.25 port 53994:11: disconnected by user May 25 04:59:32 oleg425-client sshd[96295]: Disconnected from user root 192.168.204.25 port 53994 May 25 04:59:32 oleg425-client sshd[96282]: pam_unix(sshd:session): session closed for user root May 25 04:59:32 oleg425-client systemd[1]: session-512.scope: Succeeded. May 25 04:59:32 oleg425-client systemd-logind[1020]: Session 512 logged out. Waiting for processes to exit. May 25 04:59:32 oleg425-client systemd-logind[1020]: Removed session 512. May 25 04:59:33 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00b208c4 to 0x799e3d1c00b21925 May 25 04:59:33 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 04:59:35 oleg425-client sshd[96519]: Accepted publickey for root from 192.168.204.25 port 40950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:35 oleg425-client systemd[1]: Started Session 513 of user root. May 25 04:59:35 oleg425-client systemd-logind[1020]: New session 513 of user root. May 25 04:59:35 oleg425-client sshd[96519]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:35 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:59:35 oleg425-client sshd[96532]: Received disconnect from 192.168.204.25 port 40950:11: disconnected by user May 25 04:59:35 oleg425-client sshd[96532]: Disconnected from user root 192.168.204.25 port 40950 May 25 04:59:36 oleg425-client sshd[96519]: pam_unix(sshd:session): session closed for user root May 25 04:59:36 oleg425-client systemd[1]: session-513.scope: Succeeded. May 25 04:59:36 oleg425-client systemd-logind[1020]: Session 513 logged out. Waiting for processes to exit. May 25 04:59:36 oleg425-client systemd-logind[1020]: Removed session 513. May 25 04:59:37 oleg425-client sshd[96673]: Accepted publickey for root from 192.168.204.25 port 40952 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:37 oleg425-client systemd-logind[1020]: New session 514 of user root. May 25 04:59:37 oleg425-client systemd[1]: Started Session 514 of user root. May 25 04:59:37 oleg425-client sshd[96673]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:37 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:59:37 oleg425-client sshd[96686]: Received disconnect from 192.168.204.25 port 40952:11: disconnected by user May 25 04:59:37 oleg425-client sshd[96686]: Disconnected from user root 192.168.204.25 port 40952 May 25 04:59:37 oleg425-client sshd[96673]: pam_unix(sshd:session): session closed for user root May 25 04:59:37 oleg425-client systemd-logind[1020]: Session 514 logged out. Waiting for processes to exit. May 25 04:59:37 oleg425-client systemd[1]: session-514.scope: Succeeded. May 25 04:59:37 oleg425-client systemd-logind[1020]: Removed session 514. May 25 04:59:39 oleg425-client sshd[96728]: Accepted publickey for root from 192.168.204.25 port 40960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:39 oleg425-client systemd-logind[1020]: New session 515 of user root. May 25 04:59:39 oleg425-client systemd[1]: Started Session 515 of user root. May 25 04:59:39 oleg425-client sshd[96728]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:39 oleg425-client sshd[96741]: Received disconnect from 192.168.204.25 port 40960:11: disconnected by user May 25 04:59:39 oleg425-client sshd[96741]: Disconnected from user root 192.168.204.25 port 40960 May 25 04:59:39 oleg425-client sshd[96728]: pam_unix(sshd:session): session closed for user root May 25 04:59:39 oleg425-client systemd-logind[1020]: Session 515 logged out. Waiting for processes to exit. May 25 04:59:39 oleg425-client systemd[1]: session-515.scope: Succeeded. May 25 04:59:39 oleg425-client systemd-logind[1020]: Removed session 515. May 25 05:00:01 oleg425-client kernel: Lustre: 67686:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.204.125@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 05:00:18 oleg425-client sshd[97042]: Accepted publickey for root from 192.168.204.25 port 42634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:18 oleg425-client systemd-logind[1020]: New session 516 of user root. May 25 05:00:18 oleg425-client systemd[1]: Started Session 516 of user root. May 25 05:00:19 oleg425-client sshd[97042]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:19 oleg425-client sshd[97055]: Received disconnect from 192.168.204.25 port 42634:11: disconnected by user May 25 05:00:19 oleg425-client sshd[97055]: Disconnected from user root 192.168.204.25 port 42634 May 25 05:00:19 oleg425-client sshd[97042]: pam_unix(sshd:session): session closed for user root May 25 05:00:19 oleg425-client systemd[1]: session-516.scope: Succeeded. May 25 05:00:19 oleg425-client systemd-logind[1020]: Session 516 logged out. Waiting for processes to exit. May 25 05:00:19 oleg425-client systemd-logind[1020]: Removed session 516. May 25 05:00:22 oleg425-client sshd[97276]: Accepted publickey for root from 192.168.204.25 port 42646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:22 oleg425-client systemd[1]: Started Session 517 of user root. May 25 05:00:22 oleg425-client systemd-logind[1020]: New session 517 of user root. May 25 05:00:22 oleg425-client sshd[97276]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:22 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 05:00:22 oleg425-client sshd[97289]: Received disconnect from 192.168.204.25 port 42646:11: disconnected by user May 25 05:00:22 oleg425-client sshd[97289]: Disconnected from user root 192.168.204.25 port 42646 May 25 05:00:22 oleg425-client sshd[97276]: pam_unix(sshd:session): session closed for user root May 25 05:00:23 oleg425-client systemd-logind[1020]: Session 517 logged out. Waiting for processes to exit. May 25 05:00:23 oleg425-client systemd[1]: session-517.scope: Succeeded. May 25 05:00:23 oleg425-client systemd-logind[1020]: Removed session 517. May 25 05:00:24 oleg425-client sshd[97430]: Accepted publickey for root from 192.168.204.25 port 42658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:24 oleg425-client systemd-logind[1020]: New session 518 of user root. May 25 05:00:24 oleg425-client systemd[1]: Started Session 518 of user root. May 25 05:00:24 oleg425-client sshd[97430]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:24 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 05:00:24 oleg425-client sshd[97443]: Received disconnect from 192.168.204.25 port 42658:11: disconnected by user May 25 05:00:24 oleg425-client sshd[97443]: Disconnected from user root 192.168.204.25 port 42658 May 25 05:00:24 oleg425-client sshd[97430]: pam_unix(sshd:session): session closed for user root May 25 05:00:25 oleg425-client systemd[1]: session-518.scope: Succeeded. May 25 05:00:25 oleg425-client systemd-logind[1020]: Session 518 logged out. Waiting for processes to exit. May 25 05:00:25 oleg425-client systemd-logind[1020]: Removed session 518. May 25 05:00:26 oleg425-client sshd[97484]: Accepted publickey for root from 192.168.204.25 port 52596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:26 oleg425-client systemd-logind[1020]: New session 519 of user root. May 25 05:00:26 oleg425-client systemd[1]: Started Session 519 of user root. May 25 05:00:26 oleg425-client sshd[97484]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:27 oleg425-client sshd[97497]: Received disconnect from 192.168.204.25 port 52596:11: disconnected by user May 25 05:00:27 oleg425-client sshd[97497]: Disconnected from user root 192.168.204.25 port 52596 May 25 05:00:27 oleg425-client sshd[97484]: pam_unix(sshd:session): session closed for user root May 25 05:00:27 oleg425-client systemd[1]: session-519.scope: Succeeded. May 25 05:00:27 oleg425-client systemd-logind[1020]: Session 519 logged out. Waiting for processes to exit. May 25 05:00:27 oleg425-client systemd-logind[1020]: Removed session 519. May 25 05:00:28 oleg425-client sshd[97616]: Accepted publickey for root from 192.168.204.25 port 52600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:28 oleg425-client systemd-logind[1020]: New session 520 of user root. May 25 05:00:28 oleg425-client systemd[1]: Started Session 520 of user root. May 25 05:00:28 oleg425-client sshd[97616]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:28 oleg425-client sshd[97630]: Received disconnect from 192.168.204.25 port 52600:11: disconnected by user May 25 05:00:28 oleg425-client sshd[97630]: Disconnected from user root 192.168.204.25 port 52600 May 25 05:00:28 oleg425-client sshd[97616]: pam_unix(sshd:session): session closed for user root May 25 05:00:28 oleg425-client systemd-logind[1020]: Session 520 logged out. Waiting for processes to exit. May 25 05:00:28 oleg425-client systemd[1]: session-520.scope: Succeeded. May 25 05:00:28 oleg425-client systemd-logind[1020]: Removed session 520. May 25 05:00:29 oleg425-client sshd[97754]: Accepted publickey for root from 192.168.204.25 port 52616 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:29 oleg425-client systemd[1]: Started Session 521 of user root. May 25 05:00:29 oleg425-client systemd-logind[1020]: New session 521 of user root. May 25 05:00:29 oleg425-client sshd[97754]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:30 oleg425-client sshd[97767]: Received disconnect from 192.168.204.25 port 52616:11: disconnected by user May 25 05:00:30 oleg425-client sshd[97767]: Disconnected from user root 192.168.204.25 port 52616 May 25 05:00:30 oleg425-client sshd[97754]: pam_unix(sshd:session): session closed for user root May 25 05:00:30 oleg425-client systemd[1]: session-521.scope: Succeeded. May 25 05:00:30 oleg425-client systemd-logind[1020]: Session 521 logged out. Waiting for processes to exit. May 25 05:00:30 oleg425-client systemd-logind[1020]: Removed session 521. May 25 05:00:31 oleg425-client sshd[97898]: Accepted publickey for root from 192.168.204.25 port 52630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:31 oleg425-client systemd-logind[1020]: New session 522 of user root. May 25 05:00:31 oleg425-client systemd[1]: Started Session 522 of user root. May 25 05:00:31 oleg425-client sshd[97898]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:31 oleg425-client sshd[97911]: Received disconnect from 192.168.204.25 port 52630:11: disconnected by user May 25 05:00:32 oleg425-client sshd[97911]: Disconnected from user root 192.168.204.25 port 52630 May 25 05:00:32 oleg425-client sshd[97898]: pam_unix(sshd:session): session closed for user root May 25 05:00:32 oleg425-client systemd[1]: session-522.scope: Succeeded. May 25 05:00:32 oleg425-client systemd-logind[1020]: Session 522 logged out. Waiting for processes to exit. May 25 05:00:32 oleg425-client systemd-logind[1020]: Removed session 522. May 25 05:01:01 oleg425-client CROND[97990]: (root) CMD (run-parts /etc/cron.hourly) May 25 05:01:02 oleg425-client run-parts[97990]: (/etc/cron.hourly) starting 0anacron May 25 05:01:02 oleg425-client run-parts[97990]: (/etc/cron.hourly) finished 0anacron May 25 05:02:46 oleg425-client sshd[98117]: Accepted publickey for root from 192.168.204.25 port 57510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:02:46 oleg425-client systemd-logind[1020]: New session 523 of user root. May 25 05:02:46 oleg425-client systemd[1]: Started Session 523 of user root. May 25 05:02:46 oleg425-client sshd[98117]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:02:46 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144b: orphan cleanup shouldn't be blocked for no objects+failover situation ========================================================== 05:02:45 (1779699765) May 25 05:02:46 oleg425-client sshd[98130]: Received disconnect from 192.168.204.25 port 57510:11: disconnected by user May 25 05:02:46 oleg425-client sshd[98130]: Disconnected from user root 192.168.204.25 port 57510 May 25 05:02:46 oleg425-client sshd[98117]: pam_unix(sshd:session): session closed for user root May 25 05:02:46 oleg425-client systemd-logind[1020]: Session 523 logged out. Waiting for processes to exit. May 25 05:02:46 oleg425-client systemd[1]: session-523.scope: Succeeded. May 25 05:02:46 oleg425-client systemd-logind[1020]: Removed session 523. May 25 05:02:57 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab46800: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:02:57 oleg425-client kernel: Lustre: Skipped 7 previous similar messages May 25 05:03:34 oleg425-client sshd[98569]: Accepted publickey for root from 192.168.204.25 port 46604 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:34 oleg425-client systemd-logind[1020]: New session 524 of user root. May 25 05:03:34 oleg425-client systemd[1]: Started Session 524 of user root. May 25 05:03:34 oleg425-client sshd[98569]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:35 oleg425-client sshd[98582]: Received disconnect from 192.168.204.25 port 46604:11: disconnected by user May 25 05:03:35 oleg425-client sshd[98582]: Disconnected from user root 192.168.204.25 port 46604 May 25 05:03:35 oleg425-client sshd[98569]: pam_unix(sshd:session): session closed for user root May 25 05:03:35 oleg425-client systemd[1]: session-524.scope: Succeeded. May 25 05:03:35 oleg425-client systemd-logind[1020]: Session 524 logged out. Waiting for processes to exit. May 25 05:03:35 oleg425-client systemd-logind[1020]: Removed session 524. May 25 05:03:43 oleg425-client sshd[98806]: Accepted publickey for root from 192.168.204.25 port 52092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:43 oleg425-client systemd[1]: Started Session 525 of user root. May 25 05:03:43 oleg425-client systemd-logind[1020]: New session 525 of user root. May 25 05:03:43 oleg425-client sshd[98806]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:44 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 05:03:44 oleg425-client sshd[98819]: Received disconnect from 192.168.204.25 port 52092:11: disconnected by user May 25 05:03:44 oleg425-client sshd[98819]: Disconnected from user root 192.168.204.25 port 52092 May 25 05:03:44 oleg425-client sshd[98806]: pam_unix(sshd:session): session closed for user root May 25 05:03:44 oleg425-client systemd[1]: session-525.scope: Succeeded. May 25 05:03:44 oleg425-client systemd-logind[1020]: Session 525 logged out. Waiting for processes to exit. May 25 05:03:44 oleg425-client systemd-logind[1020]: Removed session 525. May 25 05:03:48 oleg425-client sshd[98960]: Accepted publickey for root from 192.168.204.25 port 40088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:48 oleg425-client systemd[1]: Started Session 526 of user root. May 25 05:03:48 oleg425-client systemd-logind[1020]: New session 526 of user root. May 25 05:03:48 oleg425-client sshd[98960]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:49 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 05:03:49 oleg425-client sshd[98974]: Received disconnect from 192.168.204.25 port 40088:11: disconnected by user May 25 05:03:49 oleg425-client sshd[98974]: Disconnected from user root 192.168.204.25 port 40088 May 25 05:03:49 oleg425-client sshd[98960]: pam_unix(sshd:session): session closed for user root May 25 05:03:49 oleg425-client systemd[1]: session-526.scope: Succeeded. May 25 05:03:49 oleg425-client systemd-logind[1020]: Session 526 logged out. Waiting for processes to exit. May 25 05:03:49 oleg425-client systemd-logind[1020]: Removed session 526. May 25 05:03:52 oleg425-client sshd[99015]: Accepted publickey for root from 192.168.204.25 port 40090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:52 oleg425-client systemd-logind[1020]: New session 527 of user root. May 25 05:03:52 oleg425-client systemd[1]: Started Session 527 of user root. May 25 05:03:52 oleg425-client sshd[99015]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:53 oleg425-client sshd[99028]: Received disconnect from 192.168.204.25 port 40090:11: disconnected by user May 25 05:03:53 oleg425-client sshd[99028]: Disconnected from user root 192.168.204.25 port 40090 May 25 05:03:53 oleg425-client sshd[99015]: pam_unix(sshd:session): session closed for user root May 25 05:03:53 oleg425-client systemd[1]: session-527.scope: Succeeded. May 25 05:03:53 oleg425-client systemd-logind[1020]: Session 527 logged out. Waiting for processes to exit. May 25 05:03:53 oleg425-client systemd-logind[1020]: Removed session 527. May 25 05:05:57 oleg425-client sshd[99213]: Accepted publickey for root from 192.168.204.25 port 54608 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:57 oleg425-client systemd-logind[1020]: New session 528 of user root. May 25 05:05:57 oleg425-client systemd[1]: Started Session 528 of user root. May 25 05:05:57 oleg425-client sshd[99213]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:57 oleg425-client sshd[99227]: Received disconnect from 192.168.204.25 port 54608:11: disconnected by user May 25 05:05:57 oleg425-client sshd[99227]: Disconnected from user root 192.168.204.25 port 54608 May 25 05:05:57 oleg425-client sshd[99213]: pam_unix(sshd:session): session closed for user root May 25 05:05:58 oleg425-client systemd-logind[1020]: Session 528 logged out. Waiting for processes to exit. May 25 05:05:58 oleg425-client systemd[1]: session-528.scope: Succeeded. May 25 05:05:58 oleg425-client systemd-logind[1020]: Removed session 528. May 25 05:05:59 oleg425-client sshd[99353]: Accepted publickey for root from 192.168.204.25 port 54618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:59 oleg425-client systemd-logind[1020]: New session 529 of user root. May 25 05:05:59 oleg425-client systemd[1]: Started Session 529 of user root. May 25 05:05:59 oleg425-client sshd[99353]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:59 oleg425-client sshd[99366]: Received disconnect from 192.168.204.25 port 54618:11: disconnected by user May 25 05:05:59 oleg425-client sshd[99366]: Disconnected from user root 192.168.204.25 port 54618 May 25 05:05:59 oleg425-client sshd[99353]: pam_unix(sshd:session): session closed for user root May 25 05:06:00 oleg425-client systemd[1]: session-529.scope: Succeeded. May 25 05:06:00 oleg425-client systemd-logind[1020]: Session 529 logged out. Waiting for processes to exit. May 25 05:06:00 oleg425-client systemd-logind[1020]: Removed session 529. May 25 05:06:01 oleg425-client sshd[99498]: Accepted publickey for root from 192.168.204.25 port 54628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:06:01 oleg425-client systemd-logind[1020]: New session 530 of user root. May 25 05:06:01 oleg425-client systemd[1]: Started Session 530 of user root. May 25 05:06:01 oleg425-client sshd[99498]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:06:02 oleg425-client sshd[99512]: Received disconnect from 192.168.204.25 port 54628:11: disconnected by user May 25 05:06:02 oleg425-client sshd[99512]: Disconnected from user root 192.168.204.25 port 54628 May 25 05:06:02 oleg425-client sshd[99498]: pam_unix(sshd:session): session closed for user root May 25 05:06:02 oleg425-client systemd[1]: session-530.scope: Succeeded. May 25 05:06:02 oleg425-client systemd-logind[1020]: Session 530 logged out. Waiting for processes to exit. May 25 05:06:02 oleg425-client systemd-logind[1020]: Removed session 530. May 25 05:07:58 oleg425-client sshd[99706]: Accepted publickey for root from 192.168.204.25 port 35640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:07:58 oleg425-client systemd-logind[1020]: New session 531 of user root. May 25 05:07:58 oleg425-client systemd[1]: Started Session 531 of user root. May 25 05:07:58 oleg425-client sshd[99706]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:07:58 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144c: reconnection during orphan cleanup shouldn't lose LAST_ID synchronization ========================================================== 05:07:57 (1779700077) May 25 05:07:58 oleg425-client sshd[99719]: Received disconnect from 192.168.204.25 port 35640:11: disconnected by user May 25 05:07:58 oleg425-client sshd[99719]: Disconnected from user root 192.168.204.25 port 35640 May 25 05:07:58 oleg425-client sshd[99706]: pam_unix(sshd:session): session closed for user root May 25 05:07:58 oleg425-client systemd[1]: session-531.scope: Succeeded. May 25 05:07:58 oleg425-client systemd-logind[1020]: Session 531 logged out. Waiting for processes to exit. May 25 05:07:58 oleg425-client systemd-logind[1020]: Removed session 531. May 25 05:08:03 oleg425-client sshd[99898]: Accepted publickey for root from 192.168.204.25 port 35652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:08:03 oleg425-client systemd-logind[1020]: New session 532 of user root. May 25 05:08:03 oleg425-client systemd[1]: Started Session 532 of user root. May 25 05:08:03 oleg425-client sshd[99898]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:08:03 oleg425-client sshd[99911]: Received disconnect from 192.168.204.25 port 35652:11: disconnected by user May 25 05:08:03 oleg425-client sshd[99911]: Disconnected from user root 192.168.204.25 port 35652 May 25 05:08:03 oleg425-client sshd[99898]: pam_unix(sshd:session): session closed for user root May 25 05:08:03 oleg425-client systemd-logind[1020]: Session 532 logged out. Waiting for processes to exit. May 25 05:08:03 oleg425-client systemd[1]: session-532.scope: Succeeded. May 25 05:08:03 oleg425-client systemd-logind[1020]: Removed session 532. May 25 05:10:34 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 05:10:34 oleg425-client kernel: LustreError: Skipped 1 previous similar message May 25 05:10:34 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00b21964 to 0x799e3d1c00c1bd64 May 25 05:10:34 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 05:10:34 oleg425-client kernel: Lustre: MGC192.168.204.125@tcp: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 05:10:34 oleg425-client kernel: Lustre: Skipped 9 previous similar messages May 25 05:11:04 oleg425-client sshd[100407]: Accepted publickey for root from 192.168.204.25 port 51570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:04 oleg425-client systemd[1]: Started Session 533 of user root. May 25 05:11:04 oleg425-client systemd-logind[1020]: New session 533 of user root. May 25 05:11:04 oleg425-client sshd[100407]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:04 oleg425-client sshd[100420]: Received disconnect from 192.168.204.25 port 51570:11: disconnected by user May 25 05:11:04 oleg425-client sshd[100420]: Disconnected from user root 192.168.204.25 port 51570 May 25 05:11:04 oleg425-client sshd[100407]: pam_unix(sshd:session): session closed for user root May 25 05:11:04 oleg425-client systemd-logind[1020]: Session 533 logged out. Waiting for processes to exit. May 25 05:11:04 oleg425-client systemd[1]: session-533.scope: Succeeded. May 25 05:11:04 oleg425-client systemd-logind[1020]: Removed session 533. May 25 05:11:05 oleg425-client sshd[100546]: Accepted publickey for root from 192.168.204.25 port 39484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:05 oleg425-client systemd-logind[1020]: New session 534 of user root. May 25 05:11:05 oleg425-client systemd[1]: Started Session 534 of user root. May 25 05:11:05 oleg425-client sshd[100546]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:06 oleg425-client sshd[100560]: Received disconnect from 192.168.204.25 port 39484:11: disconnected by user May 25 05:11:06 oleg425-client sshd[100560]: Disconnected from user root 192.168.204.25 port 39484 May 25 05:11:06 oleg425-client sshd[100546]: pam_unix(sshd:session): session closed for user root May 25 05:11:06 oleg425-client systemd-logind[1020]: Session 534 logged out. Waiting for processes to exit. May 25 05:11:06 oleg425-client systemd[1]: session-534.scope: Succeeded. May 25 05:11:06 oleg425-client systemd-logind[1020]: Removed session 534. May 25 05:11:07 oleg425-client sshd[100691]: Accepted publickey for root from 192.168.204.25 port 39498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:07 oleg425-client systemd-logind[1020]: New session 535 of user root. May 25 05:11:07 oleg425-client systemd[1]: Started Session 535 of user root. May 25 05:11:07 oleg425-client sshd[100691]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:07 oleg425-client sshd[100704]: Received disconnect from 192.168.204.25 port 39498:11: disconnected by user May 25 05:11:07 oleg425-client sshd[100704]: Disconnected from user root 192.168.204.25 port 39498 May 25 05:11:07 oleg425-client sshd[100691]: pam_unix(sshd:session): session closed for user root May 25 05:11:07 oleg425-client systemd[1]: session-535.scope: Succeeded. May 25 05:11:07 oleg425-client systemd-logind[1020]: Session 535 logged out. Waiting for processes to exit. May 25 05:11:07 oleg425-client systemd-logind[1020]: Removed session 535. May 25 05:11:09 oleg425-client sshd[100844]: Accepted publickey for root from 192.168.204.25 port 39508 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:09 oleg425-client systemd-logind[1020]: New session 536 of user root. May 25 05:11:09 oleg425-client systemd[1]: Started Session 536 of user root. May 25 05:11:09 oleg425-client sshd[100844]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:09 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 145: connect mdtlovs and process update logs after recovery expire ========================================================== 05:11:08 (1779700268) May 25 05:11:09 oleg425-client sshd[100857]: Received disconnect from 192.168.204.25 port 39508:11: disconnected by user May 25 05:11:09 oleg425-client sshd[100857]: Disconnected from user root 192.168.204.25 port 39508 May 25 05:11:09 oleg425-client sshd[100844]: pam_unix(sshd:session): session closed for user root May 25 05:11:09 oleg425-client systemd[1]: session-536.scope: Succeeded. May 25 05:11:09 oleg425-client systemd-logind[1020]: Session 536 logged out. Waiting for processes to exit. May 25 05:11:09 oleg425-client systemd-logind[1020]: Removed session 536. May 25 05:11:10 oleg425-client sshd[100980]: Accepted publickey for root from 192.168.204.25 port 39516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:10 oleg425-client systemd-logind[1020]: New session 537 of user root. May 25 05:11:10 oleg425-client systemd[1]: Started Session 537 of user root. May 25 05:11:10 oleg425-client sshd[100980]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:11 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_145 needs >= 3 MDTs May 25 05:11:11 oleg425-client sshd[100993]: Received disconnect from 192.168.204.25 port 39516:11: disconnected by user May 25 05:11:11 oleg425-client sshd[100993]: Disconnected from user root 192.168.204.25 port 39516 May 25 05:11:11 oleg425-client sshd[100980]: pam_unix(sshd:session): session closed for user root May 25 05:11:11 oleg425-client systemd-logind[1020]: Session 537 logged out. Waiting for processes to exit. May 25 05:11:11 oleg425-client systemd[1]: session-537.scope: Succeeded. May 25 05:11:11 oleg425-client systemd-logind[1020]: Removed session 537. May 25 05:11:12 oleg425-client sshd[101132]: Accepted publickey for root from 192.168.204.25 port 39530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:12 oleg425-client systemd[1]: Started Session 538 of user root. May 25 05:11:12 oleg425-client systemd-logind[1020]: New session 538 of user root. May 25 05:11:12 oleg425-client sshd[101132]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:12 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 146: test eviction is counted properly ========================================================== 05:11:11 (1779700271) May 25 05:11:12 oleg425-client sshd[101145]: Received disconnect from 192.168.204.25 port 39530:11: disconnected by user May 25 05:11:12 oleg425-client sshd[101145]: Disconnected from user root 192.168.204.25 port 39530 May 25 05:11:12 oleg425-client sshd[101132]: pam_unix(sshd:session): session closed for user root May 25 05:11:12 oleg425-client systemd[1]: session-538.scope: Succeeded. May 25 05:11:12 oleg425-client systemd-logind[1020]: Session 538 logged out. Waiting for processes to exit. May 25 05:11:12 oleg425-client systemd-logind[1020]: Removed session 538. May 25 05:11:14 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: operation ldlm_enqueue to node 192.168.204.125@tcp failed: rc = -107 May 25 05:11:14 oleg425-client kernel: LustreError: Skipped 37 previous similar messages May 25 05:11:14 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b0ab46800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:11:14 oleg425-client kernel: LustreError: 101205:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffffa09b0ab46800: namespace resource [0x200000007:0x1:0x0].0x0 (ffffa09b217e6f00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:11:14 oleg425-client kernel: LustreError: 101205:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 05:11:16 oleg425-client sshd[101309]: Accepted publickey for root from 192.168.204.25 port 49556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:16 oleg425-client systemd-logind[1020]: New session 539 of user root. May 25 05:11:16 oleg425-client systemd[1]: Started Session 539 of user root. May 25 05:11:16 oleg425-client sshd[101309]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:16 oleg425-client sshd[101322]: Received disconnect from 192.168.204.25 port 49556:11: disconnected by user May 25 05:11:16 oleg425-client sshd[101322]: Disconnected from user root 192.168.204.25 port 49556 May 25 05:11:16 oleg425-client sshd[101309]: pam_unix(sshd:session): session closed for user root May 25 05:11:16 oleg425-client systemd[1]: session-539.scope: Succeeded. May 25 05:11:16 oleg425-client systemd-logind[1020]: Session 539 logged out. Waiting for processes to exit. May 25 05:11:16 oleg425-client systemd-logind[1020]: Removed session 539. May 25 05:11:17 oleg425-client sshd[101446]: Accepted publickey for root from 192.168.204.25 port 49570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:17 oleg425-client systemd-logind[1020]: New session 540 of user root. May 25 05:11:17 oleg425-client systemd[1]: Started Session 540 of user root. May 25 05:11:17 oleg425-client sshd[101446]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:18 oleg425-client sshd[101459]: Received disconnect from 192.168.204.25 port 49570:11: disconnected by user May 25 05:11:18 oleg425-client sshd[101459]: Disconnected from user root 192.168.204.25 port 49570 May 25 05:11:18 oleg425-client sshd[101446]: pam_unix(sshd:session): session closed for user root May 25 05:11:18 oleg425-client systemd-logind[1020]: Session 540 logged out. Waiting for processes to exit. May 25 05:11:18 oleg425-client systemd[1]: session-540.scope: Succeeded. May 25 05:11:18 oleg425-client systemd-logind[1020]: Removed session 540. May 25 05:11:19 oleg425-client sshd[101590]: Accepted publickey for root from 192.168.204.25 port 49574 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:19 oleg425-client systemd-logind[1020]: New session 541 of user root. May 25 05:11:19 oleg425-client systemd[1]: Started Session 541 of user root. May 25 05:11:19 oleg425-client sshd[101590]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:19 oleg425-client sshd[101604]: Received disconnect from 192.168.204.25 port 49574:11: disconnected by user May 25 05:11:19 oleg425-client sshd[101604]: Disconnected from user root 192.168.204.25 port 49574 May 25 05:11:19 oleg425-client sshd[101590]: pam_unix(sshd:session): session closed for user root May 25 05:11:19 oleg425-client systemd[1]: session-541.scope: Succeeded. May 25 05:11:19 oleg425-client systemd-logind[1020]: Session 541 logged out. Waiting for processes to exit. May 25 05:11:19 oleg425-client systemd-logind[1020]: Removed session 541. May 25 05:11:21 oleg425-client sshd[101745]: Accepted publickey for root from 192.168.204.25 port 49584 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:21 oleg425-client systemd-logind[1020]: New session 542 of user root. May 25 05:11:21 oleg425-client systemd[1]: Started Session 542 of user root. May 25 05:11:21 oleg425-client sshd[101745]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:21 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 147: Check client reconnect ======= 05:11:20 (1779700280) May 25 05:11:21 oleg425-client sshd[101758]: Received disconnect from 192.168.204.25 port 49584:11: disconnected by user May 25 05:11:21 oleg425-client sshd[101758]: Disconnected from user root 192.168.204.25 port 49584 May 25 05:11:21 oleg425-client sshd[101745]: pam_unix(sshd:session): session closed for user root May 25 05:11:21 oleg425-client systemd[1]: session-542.scope: Succeeded. May 25 05:11:21 oleg425-client systemd-logind[1020]: Session 542 logged out. Waiting for processes to exit. May 25 05:11:21 oleg425-client systemd-logind[1020]: Removed session 542. May 25 05:13:54 oleg425-client sshd[101936]: Accepted publickey for root from 192.168.204.25 port 51068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:54 oleg425-client systemd-logind[1020]: New session 543 of user root. May 25 05:13:54 oleg425-client systemd[1]: Started Session 543 of user root. May 25 05:13:54 oleg425-client sshd[101936]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:55 oleg425-client sshd[101949]: Received disconnect from 192.168.204.25 port 51068:11: disconnected by user May 25 05:13:55 oleg425-client sshd[101949]: Disconnected from user root 192.168.204.25 port 51068 May 25 05:13:55 oleg425-client sshd[101936]: pam_unix(sshd:session): session closed for user root May 25 05:13:55 oleg425-client systemd-logind[1020]: Session 543 logged out. Waiting for processes to exit. May 25 05:13:55 oleg425-client systemd[1]: session-543.scope: Succeeded. May 25 05:13:55 oleg425-client systemd-logind[1020]: Removed session 543. May 25 05:13:56 oleg425-client sshd[102073]: Accepted publickey for root from 192.168.204.25 port 51078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:56 oleg425-client systemd-logind[1020]: New session 544 of user root. May 25 05:13:56 oleg425-client systemd[1]: Started Session 544 of user root. May 25 05:13:56 oleg425-client sshd[102073]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:57 oleg425-client sshd[102086]: Received disconnect from 192.168.204.25 port 51078:11: disconnected by user May 25 05:13:57 oleg425-client sshd[102086]: Disconnected from user root 192.168.204.25 port 51078 May 25 05:13:57 oleg425-client sshd[102073]: pam_unix(sshd:session): session closed for user root May 25 05:13:57 oleg425-client systemd[1]: session-544.scope: Succeeded. May 25 05:13:57 oleg425-client systemd-logind[1020]: Session 544 logged out. Waiting for processes to exit. May 25 05:13:57 oleg425-client systemd-logind[1020]: Removed session 544. May 25 05:13:58 oleg425-client sshd[102219]: Accepted publickey for root from 192.168.204.25 port 51092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:58 oleg425-client systemd-logind[1020]: New session 545 of user root. May 25 05:13:58 oleg425-client systemd[1]: Started Session 545 of user root. May 25 05:13:58 oleg425-client sshd[102219]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:58 oleg425-client sshd[102232]: Received disconnect from 192.168.204.25 port 51092:11: disconnected by user May 25 05:13:58 oleg425-client sshd[102232]: Disconnected from user root 192.168.204.25 port 51092 May 25 05:13:58 oleg425-client sshd[102219]: pam_unix(sshd:session): session closed for user root May 25 05:13:58 oleg425-client systemd[1]: session-545.scope: Succeeded. May 25 05:13:58 oleg425-client systemd-logind[1020]: Session 545 logged out. Waiting for processes to exit. May 25 05:13:58 oleg425-client systemd-logind[1020]: Removed session 545. May 25 05:14:08 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b0ab46800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:14:10 oleg425-client sshd[102394]: Accepted publickey for root from 192.168.204.25 port 46950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:10 oleg425-client systemd-logind[1020]: New session 546 of user root. May 25 05:14:10 oleg425-client systemd[1]: Started Session 546 of user root. May 25 05:14:10 oleg425-client sshd[102394]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 148: data corruption through resend ========================================================== 05:14:09 (1779700449) May 25 05:14:11 oleg425-client sshd[102407]: Received disconnect from 192.168.204.25 port 46950:11: disconnected by user May 25 05:14:11 oleg425-client sshd[102407]: Disconnected from user root 192.168.204.25 port 46950 May 25 05:14:11 oleg425-client sshd[102394]: pam_unix(sshd:session): session closed for user root May 25 05:14:11 oleg425-client systemd[1]: session-546.scope: Succeeded. May 25 05:14:11 oleg425-client systemd-logind[1020]: Session 546 logged out. Waiting for processes to exit. May 25 05:14:11 oleg425-client systemd-logind[1020]: Removed session 546. May 25 05:14:39 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779700458/real 1779700458] req@ffffa09b061db480 x1866143463784448/t0(0) o4->lustre-OST0000-osc-ffffa09b0ab46800@192.168.204.125@tcp:6/4 lens 4584/448 e 0 to 1 dl 1779700478 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 May 25 05:14:39 oleg425-client kernel: Lustre: 2373:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 24 previous similar messages May 25 05:14:39 oleg425-client kernel: Lustre: lustre-OST0000-osc-ffffa09b0ab46800: Connection to lustre-OST0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:14:39 oleg425-client kernel: Lustre: Skipped 3 previous similar messages May 25 05:14:51 oleg425-client sshd[102758]: Accepted publickey for root from 192.168.204.25 port 42402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:51 oleg425-client systemd-logind[1020]: New session 547 of user root. May 25 05:14:51 oleg425-client systemd[1]: Started Session 547 of user root. May 25 05:14:51 oleg425-client sshd[102758]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:51 oleg425-client sshd[102771]: Received disconnect from 192.168.204.25 port 42402:11: disconnected by user May 25 05:14:51 oleg425-client sshd[102771]: Disconnected from user root 192.168.204.25 port 42402 May 25 05:14:51 oleg425-client sshd[102758]: pam_unix(sshd:session): session closed for user root May 25 05:14:51 oleg425-client systemd[1]: session-547.scope: Succeeded. May 25 05:14:51 oleg425-client systemd-logind[1020]: Session 547 logged out. Waiting for processes to exit. May 25 05:14:51 oleg425-client systemd-logind[1020]: Removed session 547. May 25 05:14:52 oleg425-client sshd[102895]: Accepted publickey for root from 192.168.204.25 port 42418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:53 oleg425-client systemd-logind[1020]: New session 548 of user root. May 25 05:14:53 oleg425-client systemd[1]: Started Session 548 of user root. May 25 05:14:53 oleg425-client sshd[102895]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:53 oleg425-client sshd[102908]: Received disconnect from 192.168.204.25 port 42418:11: disconnected by user May 25 05:14:53 oleg425-client sshd[102908]: Disconnected from user root 192.168.204.25 port 42418 May 25 05:14:53 oleg425-client sshd[102895]: pam_unix(sshd:session): session closed for user root May 25 05:14:53 oleg425-client systemd-logind[1020]: Session 548 logged out. Waiting for processes to exit. May 25 05:14:53 oleg425-client systemd[1]: session-548.scope: Succeeded. May 25 05:14:53 oleg425-client systemd-logind[1020]: Removed session 548. May 25 05:14:54 oleg425-client sshd[103039]: Accepted publickey for root from 192.168.204.25 port 57680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:54 oleg425-client systemd-logind[1020]: New session 549 of user root. May 25 05:14:54 oleg425-client systemd[1]: Started Session 549 of user root. May 25 05:14:54 oleg425-client sshd[103039]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:54 oleg425-client sshd[103052]: Received disconnect from 192.168.204.25 port 57680:11: disconnected by user May 25 05:14:54 oleg425-client sshd[103052]: Disconnected from user root 192.168.204.25 port 57680 May 25 05:14:54 oleg425-client sshd[103039]: pam_unix(sshd:session): session closed for user root May 25 05:14:54 oleg425-client systemd[1]: session-549.scope: Succeeded. May 25 05:14:54 oleg425-client systemd-logind[1020]: Session 549 logged out. Waiting for processes to exit. May 25 05:14:54 oleg425-client systemd-logind[1020]: Removed session 549. May 25 05:14:56 oleg425-client sshd[103193]: Accepted publickey for root from 192.168.204.25 port 57694 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:56 oleg425-client systemd[1]: Started Session 550 of user root. May 25 05:14:56 oleg425-client systemd-logind[1020]: New session 550 of user root. May 25 05:14:56 oleg425-client sshd[103193]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:56 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 149: skip orphan removal at umount ========================================================== 05:14:55 (1779700495) May 25 05:14:56 oleg425-client sshd[103206]: Received disconnect from 192.168.204.25 port 57694:11: disconnected by user May 25 05:14:56 oleg425-client sshd[103206]: Disconnected from user root 192.168.204.25 port 57694 May 25 05:14:56 oleg425-client sshd[103193]: pam_unix(sshd:session): session closed for user root May 25 05:14:56 oleg425-client systemd[1]: session-550.scope: Succeeded. May 25 05:14:56 oleg425-client systemd-logind[1020]: Session 550 logged out. Waiting for processes to exit. May 25 05:14:56 oleg425-client systemd-logind[1020]: Removed session 550. May 25 05:14:57 oleg425-client sshd[103329]: Accepted publickey for root from 192.168.204.25 port 57698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:57 oleg425-client systemd-logind[1020]: New session 551 of user root. May 25 05:14:57 oleg425-client systemd[1]: Started Session 551 of user root. May 25 05:14:57 oleg425-client sshd[103329]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:58 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_149 needs >= 2 MDTs May 25 05:14:58 oleg425-client sshd[103342]: Received disconnect from 192.168.204.25 port 57698:11: disconnected by user May 25 05:14:58 oleg425-client sshd[103342]: Disconnected from user root 192.168.204.25 port 57698 May 25 05:14:58 oleg425-client sshd[103329]: pam_unix(sshd:session): session closed for user root May 25 05:14:58 oleg425-client systemd[1]: session-551.scope: Succeeded. May 25 05:14:58 oleg425-client systemd-logind[1020]: Session 551 logged out. Waiting for processes to exit. May 25 05:14:58 oleg425-client systemd-logind[1020]: Removed session 551. May 25 05:14:59 oleg425-client sshd[103481]: Accepted publickey for root from 192.168.204.25 port 57700 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:59 oleg425-client systemd-logind[1020]: New session 552 of user root. May 25 05:14:59 oleg425-client systemd[1]: Started Session 552 of user root. May 25 05:14:59 oleg425-client sshd[103481]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:00 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 150: statfs when MDT0 offline with lazystatfs option ========================================================== 05:14:58 (1779700498) May 25 05:15:00 oleg425-client sshd[103494]: Received disconnect from 192.168.204.25 port 57700:11: disconnected by user May 25 05:15:00 oleg425-client sshd[103494]: Disconnected from user root 192.168.204.25 port 57700 May 25 05:15:00 oleg425-client sshd[103481]: pam_unix(sshd:session): session closed for user root May 25 05:15:00 oleg425-client systemd[1]: session-552.scope: Succeeded. May 25 05:15:00 oleg425-client systemd-logind[1020]: Session 552 logged out. Waiting for processes to exit. May 25 05:15:00 oleg425-client systemd-logind[1020]: Removed session 552. May 25 05:15:01 oleg425-client sshd[103617]: Accepted publickey for root from 192.168.204.25 port 57706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:01 oleg425-client systemd-logind[1020]: New session 553 of user root. May 25 05:15:01 oleg425-client systemd[1]: Started Session 553 of user root. May 25 05:15:01 oleg425-client sshd[103617]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:01 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_150 needs >= 2 MDTs May 25 05:15:01 oleg425-client sshd[103630]: Received disconnect from 192.168.204.25 port 57706:11: disconnected by user May 25 05:15:01 oleg425-client sshd[103630]: Disconnected from user root 192.168.204.25 port 57706 May 25 05:15:02 oleg425-client sshd[103617]: pam_unix(sshd:session): session closed for user root May 25 05:15:02 oleg425-client systemd[1]: session-553.scope: Succeeded. May 25 05:15:02 oleg425-client systemd-logind[1020]: Session 553 logged out. Waiting for processes to exit. May 25 05:15:02 oleg425-client systemd-logind[1020]: Removed session 553. May 25 05:15:03 oleg425-client sshd[103770]: Accepted publickey for root from 192.168.204.25 port 57722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:03 oleg425-client systemd[1]: Started Session 554 of user root. May 25 05:15:03 oleg425-client systemd-logind[1020]: New session 554 of user root. May 25 05:15:03 oleg425-client sshd[103770]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:03 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 152: QoS object allocation could be awakened in case of OST failover ========================================================== 05:15:02 (1779700502) May 25 05:15:03 oleg425-client sshd[103783]: Received disconnect from 192.168.204.25 port 57722:11: disconnected by user May 25 05:15:03 oleg425-client sshd[103783]: Disconnected from user root 192.168.204.25 port 57722 May 25 05:15:03 oleg425-client sshd[103770]: pam_unix(sshd:session): session closed for user root May 25 05:15:03 oleg425-client systemd[1]: session-554.scope: Succeeded. May 25 05:15:03 oleg425-client systemd-logind[1020]: Session 554 logged out. Waiting for processes to exit. May 25 05:15:03 oleg425-client systemd-logind[1020]: Removed session 554. May 25 05:15:28 oleg425-client sshd[103978]: Accepted publickey for root from 192.168.204.25 port 56054 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:28 oleg425-client systemd-logind[1020]: New session 555 of user root. May 25 05:15:28 oleg425-client systemd[1]: Started Session 555 of user root. May 25 05:15:28 oleg425-client sshd[103978]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:29 oleg425-client sshd[103991]: Received disconnect from 192.168.204.25 port 56054:11: disconnected by user May 25 05:15:29 oleg425-client sshd[103991]: Disconnected from user root 192.168.204.25 port 56054 May 25 05:15:29 oleg425-client sshd[103978]: pam_unix(sshd:session): session closed for user root May 25 05:15:29 oleg425-client systemd[1]: session-555.scope: Succeeded. May 25 05:15:29 oleg425-client systemd-logind[1020]: Session 555 logged out. Waiting for processes to exit. May 25 05:15:29 oleg425-client systemd-logind[1020]: Removed session 555. May 25 05:15:30 oleg425-client sshd[104115]: Accepted publickey for root from 192.168.204.25 port 56062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:30 oleg425-client systemd[1]: Started Session 556 of user root. May 25 05:15:30 oleg425-client systemd-logind[1020]: New session 556 of user root. May 25 05:15:30 oleg425-client sshd[104115]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:31 oleg425-client sshd[104128]: Received disconnect from 192.168.204.25 port 56062:11: disconnected by user May 25 05:15:31 oleg425-client sshd[104128]: Disconnected from user root 192.168.204.25 port 56062 May 25 05:15:31 oleg425-client sshd[104115]: pam_unix(sshd:session): session closed for user root May 25 05:15:31 oleg425-client systemd-logind[1020]: Session 556 logged out. Waiting for processes to exit. May 25 05:15:31 oleg425-client systemd[1]: session-556.scope: Succeeded. May 25 05:15:31 oleg425-client systemd-logind[1020]: Removed session 556. May 25 05:15:32 oleg425-client sshd[104259]: Accepted publickey for root from 192.168.204.25 port 56064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:32 oleg425-client systemd-logind[1020]: New session 557 of user root. May 25 05:15:32 oleg425-client systemd[1]: Started Session 557 of user root. May 25 05:15:32 oleg425-client sshd[104259]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:32 oleg425-client sshd[104272]: Received disconnect from 192.168.204.25 port 56064:11: disconnected by user May 25 05:15:32 oleg425-client sshd[104272]: Disconnected from user root 192.168.204.25 port 56064 May 25 05:15:32 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:15:32 oleg425-client sshd[104259]: pam_unix(sshd:session): session closed for user root May 25 05:15:32 oleg425-client systemd[1]: session-557.scope: Succeeded. May 25 05:15:32 oleg425-client systemd-logind[1020]: Session 557 logged out. Waiting for processes to exit. May 25 05:15:32 oleg425-client systemd-logind[1020]: Removed session 557. May 25 05:15:36 oleg425-client sshd[104425]: Accepted publickey for root from 192.168.204.25 port 34044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:15:36 oleg425-client systemd-logind[1020]: New session 558 of user root. May 25 05:15:36 oleg425-client systemd[1]: Started Session 558 of user root. May 25 05:15:36 oleg425-client sshd[104425]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:15:36 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 153: evict vs reconnect race ====== 05:15:35 (1779700535) May 25 05:15:36 oleg425-client sshd[104438]: Received disconnect from 192.168.204.25 port 34044:11: disconnected by user May 25 05:15:36 oleg425-client sshd[104438]: Disconnected from user root 192.168.204.25 port 34044 May 25 05:15:36 oleg425-client sshd[104425]: pam_unix(sshd:session): session closed for user root May 25 05:15:37 oleg425-client systemd-logind[1020]: Session 558 logged out. Waiting for processes to exit. May 25 05:15:37 oleg425-client systemd[1]: session-558.scope: Succeeded. May 25 05:15:37 oleg425-client systemd-logind[1020]: Removed session 558. May 25 05:16:16 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 05:16:16 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00c1bd64 to 0x799e3d1c00c1e5d5 May 25 05:16:16 oleg425-client kernel: Lustre: Skipped 1 previous similar message May 25 05:16:26 oleg425-client sshd[104836]: Accepted publickey for root from 192.168.204.25 port 33190 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:26 oleg425-client systemd[1]: Started Session 559 of user root. May 25 05:16:26 oleg425-client systemd-logind[1020]: New session 559 of user root. May 25 05:16:26 oleg425-client sshd[104836]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:27 oleg425-client sshd[104849]: Received disconnect from 192.168.204.25 port 33190:11: disconnected by user May 25 05:16:27 oleg425-client sshd[104849]: Disconnected from user root 192.168.204.25 port 33190 May 25 05:16:27 oleg425-client sshd[104836]: pam_unix(sshd:session): session closed for user root May 25 05:16:27 oleg425-client systemd[1]: session-559.scope: Succeeded. May 25 05:16:27 oleg425-client systemd-logind[1020]: Session 559 logged out. Waiting for processes to exit. May 25 05:16:27 oleg425-client systemd-logind[1020]: Removed session 559. May 25 05:16:28 oleg425-client sshd[104975]: Accepted publickey for root from 192.168.204.25 port 33202 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:28 oleg425-client systemd[1]: Started Session 560 of user root. May 25 05:16:28 oleg425-client systemd-logind[1020]: New session 560 of user root. May 25 05:16:28 oleg425-client sshd[104975]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:28 oleg425-client sshd[104988]: Received disconnect from 192.168.204.25 port 33202:11: disconnected by user May 25 05:16:28 oleg425-client sshd[104988]: Disconnected from user root 192.168.204.25 port 33202 May 25 05:16:28 oleg425-client sshd[104975]: pam_unix(sshd:session): session closed for user root May 25 05:16:28 oleg425-client systemd[1]: session-560.scope: Succeeded. May 25 05:16:28 oleg425-client systemd-logind[1020]: Session 560 logged out. Waiting for processes to exit. May 25 05:16:28 oleg425-client systemd-logind[1020]: Removed session 560. May 25 05:16:29 oleg425-client sshd[105120]: Accepted publickey for root from 192.168.204.25 port 33212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:29 oleg425-client systemd[1]: Started Session 561 of user root. May 25 05:16:29 oleg425-client systemd-logind[1020]: New session 561 of user root. May 25 05:16:29 oleg425-client sshd[105120]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:30 oleg425-client sshd[105133]: Received disconnect from 192.168.204.25 port 33212:11: disconnected by user May 25 05:16:30 oleg425-client sshd[105133]: Disconnected from user root 192.168.204.25 port 33212 May 25 05:16:30 oleg425-client sshd[105120]: pam_unix(sshd:session): session closed for user root May 25 05:16:30 oleg425-client systemd-logind[1020]: Session 561 logged out. Waiting for processes to exit. May 25 05:16:30 oleg425-client systemd[1]: session-561.scope: Succeeded. May 25 05:16:30 oleg425-client systemd-logind[1020]: Removed session 561. May 25 05:16:31 oleg425-client sshd[105275]: Accepted publickey for root from 192.168.204.25 port 33220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:31 oleg425-client systemd-logind[1020]: New session 562 of user root. May 25 05:16:31 oleg425-client systemd[1]: Started Session 562 of user root. May 25 05:16:31 oleg425-client sshd[105275]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:31 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154a: corruption update llog can be skipped ========================================================== 05:16:30 (1779700590) May 25 05:16:31 oleg425-client sshd[105288]: Received disconnect from 192.168.204.25 port 33220:11: disconnected by user May 25 05:16:31 oleg425-client sshd[105288]: Disconnected from user root 192.168.204.25 port 33220 May 25 05:16:31 oleg425-client sshd[105275]: pam_unix(sshd:session): session closed for user root May 25 05:16:32 oleg425-client systemd[1]: session-562.scope: Succeeded. May 25 05:16:32 oleg425-client systemd-logind[1020]: Session 562 logged out. Waiting for processes to exit. May 25 05:16:32 oleg425-client systemd-logind[1020]: Removed session 562. May 25 05:16:33 oleg425-client sshd[105414]: Accepted publickey for root from 192.168.204.25 port 33222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:33 oleg425-client systemd[1]: Started Session 563 of user root. May 25 05:16:33 oleg425-client systemd-logind[1020]: New session 563 of user root. May 25 05:16:33 oleg425-client sshd[105414]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:33 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_154a needs >= 2 MDTs May 25 05:16:33 oleg425-client sshd[105427]: Received disconnect from 192.168.204.25 port 33222:11: disconnected by user May 25 05:16:33 oleg425-client sshd[105427]: Disconnected from user root 192.168.204.25 port 33222 May 25 05:16:33 oleg425-client sshd[105414]: pam_unix(sshd:session): session closed for user root May 25 05:16:33 oleg425-client systemd[1]: session-563.scope: Succeeded. May 25 05:16:33 oleg425-client systemd-logind[1020]: Session 563 logged out. Waiting for processes to exit. May 25 05:16:33 oleg425-client systemd-logind[1020]: Removed session 563. May 25 05:16:34 oleg425-client sshd[105566]: Accepted publickey for root from 192.168.204.25 port 52760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:34 oleg425-client systemd[1]: Started Session 564 of user root. May 25 05:16:34 oleg425-client systemd-logind[1020]: New session 564 of user root. May 25 05:16:34 oleg425-client sshd[105566]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:35 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154b: restore update llog after failed recovery ========================================================== 05:16:33 (1779700593) May 25 05:16:35 oleg425-client sshd[105579]: Received disconnect from 192.168.204.25 port 52760:11: disconnected by user May 25 05:16:35 oleg425-client sshd[105579]: Disconnected from user root 192.168.204.25 port 52760 May 25 05:16:35 oleg425-client sshd[105566]: pam_unix(sshd:session): session closed for user root May 25 05:16:35 oleg425-client systemd[1]: session-564.scope: Succeeded. May 25 05:16:35 oleg425-client systemd-logind[1020]: Session 564 logged out. Waiting for processes to exit. May 25 05:16:35 oleg425-client systemd-logind[1020]: Removed session 564. May 25 05:16:36 oleg425-client sshd[105706]: Accepted publickey for root from 192.168.204.25 port 52776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:36 oleg425-client systemd-logind[1020]: New session 565 of user root. May 25 05:16:36 oleg425-client systemd[1]: Started Session 565 of user root. May 25 05:16:36 oleg425-client sshd[105706]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:36 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_154b needs >= 2 MDTs May 25 05:16:36 oleg425-client sshd[105719]: Received disconnect from 192.168.204.25 port 52776:11: disconnected by user May 25 05:16:36 oleg425-client sshd[105719]: Disconnected from user root 192.168.204.25 port 52776 May 25 05:16:36 oleg425-client sshd[105706]: pam_unix(sshd:session): session closed for user root May 25 05:16:36 oleg425-client systemd[1]: session-565.scope: Succeeded. May 25 05:16:36 oleg425-client systemd-logind[1020]: Session 565 logged out. Waiting for processes to exit. May 25 05:16:36 oleg425-client systemd-logind[1020]: Removed session 565. May 25 05:16:38 oleg425-client sshd[105858]: Accepted publickey for root from 192.168.204.25 port 52782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:38 oleg425-client systemd[1]: Started Session 566 of user root. May 25 05:16:38 oleg425-client systemd-logind[1020]: New session 566 of user root. May 25 05:16:38 oleg425-client sshd[105858]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:38 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 155: failover after client remount ========================================================== 05:16:37 (1779700597) May 25 05:16:38 oleg425-client sshd[105871]: Received disconnect from 192.168.204.25 port 52782:11: disconnected by user May 25 05:16:38 oleg425-client sshd[105871]: Disconnected from user root 192.168.204.25 port 52782 May 25 05:16:38 oleg425-client sshd[105858]: pam_unix(sshd:session): session closed for user root May 25 05:16:38 oleg425-client systemd-logind[1020]: Session 566 logged out. Waiting for processes to exit. May 25 05:16:38 oleg425-client systemd[1]: session-566.scope: Succeeded. May 25 05:16:38 oleg425-client systemd-logind[1020]: Removed session 566. May 25 05:16:41 oleg425-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:16:43 oleg425-client kernel: Lustre: 2375:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779700566/real 1779700566] req@ffffa09b10885c00 x1866143463939840/t0(0) o400->lustre-MDT0000-mdc-ffffa09b0ab46800@192.168.204.125@tcp:12/10 lens 224/224 e 0 to 1 dl 1779700602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 05:16:51 oleg425-client kernel: LustreError: 105941:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b0ab46800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:16:51 oleg425-client kernel: LustreError: 105941:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:16:51 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 05:16:53 oleg425-client systemd-udevd[105985]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:16:53 oleg425-client kernel: Lustre: Mounted lustre-client May 25 05:16:56 oleg425-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 05:17:22 oleg425-client sshd[106376]: Accepted publickey for root from 192.168.204.25 port 50576 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:22 oleg425-client systemd-logind[1020]: New session 567 of user root. May 25 05:17:22 oleg425-client systemd[1]: Started Session 567 of user root. May 25 05:17:22 oleg425-client sshd[106376]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:23 oleg425-client kernel: Lustre: DEBUG MARKER: recovery-small test_155: @@@@@@ FAIL: ls1 != ls2 May 25 05:17:23 oleg425-client sshd[106389]: Received disconnect from 192.168.204.25 port 50576:11: disconnected by user May 25 05:17:23 oleg425-client sshd[106389]: Disconnected from user root 192.168.204.25 port 50576 May 25 05:17:23 oleg425-client sshd[106376]: pam_unix(sshd:session): session closed for user root May 25 05:17:23 oleg425-client systemd[1]: session-567.scope: Succeeded. May 25 05:17:23 oleg425-client systemd-logind[1020]: Session 567 logged out. Waiting for processes to exit. May 25 05:17:23 oleg425-client systemd-logind[1020]: Removed session 567. May 25 05:17:24 oleg425-client sshd[106510]: Accepted publickey for root from 192.168.204.25 port 50580 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:24 oleg425-client systemd-logind[1020]: New session 568 of user root. May 25 05:17:24 oleg425-client systemd[1]: Started Session 568 of user root. May 25 05:17:24 oleg425-client sshd[106510]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:27 oleg425-client sshd[106523]: Received disconnect from 192.168.204.25 port 50580:11: disconnected by user May 25 05:17:27 oleg425-client sshd[106523]: Disconnected from user root 192.168.204.25 port 50580 May 25 05:17:27 oleg425-client sshd[106510]: pam_unix(sshd:session): session closed for user root May 25 05:17:27 oleg425-client systemd[1]: session-568.scope: Succeeded. May 25 05:17:27 oleg425-client systemd-logind[1020]: Session 568 logged out. Waiting for processes to exit. May 25 05:17:27 oleg425-client systemd-logind[1020]: Removed session 568. May 25 05:17:28 oleg425-client sshd[106668]: Accepted publickey for root from 192.168.204.25 port 47880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:28 oleg425-client systemd-logind[1020]: New session 569 of user root. May 25 05:17:28 oleg425-client systemd[1]: Started Session 569 of user root. May 25 05:17:28 oleg425-client sshd[106668]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:28 oleg425-client sshd[106682]: Received disconnect from 192.168.204.25 port 47880:11: disconnected by user May 25 05:17:28 oleg425-client sshd[106682]: Disconnected from user root 192.168.204.25 port 47880 May 25 05:17:28 oleg425-client sshd[106668]: pam_unix(sshd:session): session closed for user root May 25 05:17:28 oleg425-client systemd[1]: session-569.scope: Succeeded. May 25 05:17:28 oleg425-client systemd-logind[1020]: Session 569 logged out. Waiting for processes to exit. May 25 05:17:28 oleg425-client systemd-logind[1020]: Removed session 569. May 25 05:17:36 oleg425-client sshd[106954]: Accepted publickey for root from 192.168.204.25 port 55908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:36 oleg425-client systemd[1]: Started Session 570 of user root. May 25 05:17:36 oleg425-client systemd-logind[1020]: New session 570 of user root. May 25 05:17:36 oleg425-client sshd[106954]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:36 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 156: tot_granted miscount after client eviction ========================================================== 05:17:35 (1779700655) May 25 05:17:36 oleg425-client sshd[106967]: Received disconnect from 192.168.204.25 port 55908:11: disconnected by user May 25 05:17:36 oleg425-client sshd[106967]: Disconnected from user root 192.168.204.25 port 55908 May 25 05:17:36 oleg425-client sshd[106954]: pam_unix(sshd:session): session closed for user root May 25 05:17:37 oleg425-client systemd-logind[1020]: Session 570 logged out. Waiting for processes to exit. May 25 05:17:37 oleg425-client systemd[1]: session-570.scope: Succeeded. May 25 05:17:37 oleg425-client systemd-logind[1020]: Removed session 570. May 25 05:17:43 oleg425-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-OST0000 May 25 05:18:04 oleg425-client kernel: LustreError: 2371:0:(client.c:3523:ptlrpc_replay_req()) cfs_fail_timeout id 536 sleeping for 45000ms May 25 05:18:14 oleg425-client sshd[107357]: Accepted publickey for root from 192.168.204.25 port 47498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:14 oleg425-client systemd-logind[1020]: New session 571 of user root. May 25 05:18:14 oleg425-client systemd[1]: Started Session 571 of user root. May 25 05:18:14 oleg425-client sshd[107357]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:49 oleg425-client kernel: LustreError: 2371:0:(client.c:3523:ptlrpc_replay_req()) cfs_fail_timeout id 536 awake May 25 05:18:50 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b093bb000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:18:50 oleg425-client sshd[107370]: Received disconnect from 192.168.204.25 port 47498:11: disconnected by user May 25 05:18:50 oleg425-client sshd[107370]: Disconnected from user root 192.168.204.25 port 47498 May 25 05:18:50 oleg425-client sshd[107357]: pam_unix(sshd:session): session closed for user root May 25 05:18:50 oleg425-client systemd-logind[1020]: Session 571 logged out. Waiting for processes to exit. May 25 05:18:50 oleg425-client systemd[1]: session-571.scope: Succeeded. May 25 05:18:50 oleg425-client systemd-logind[1020]: Removed session 571. May 25 05:18:53 oleg425-client sshd[107598]: Accepted publickey for root from 192.168.204.25 port 35364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:53 oleg425-client systemd[1]: Started Session 572 of user root. May 25 05:18:53 oleg425-client systemd-logind[1020]: New session 572 of user root. May 25 05:18:53 oleg425-client sshd[107598]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:53 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 05:18:53 oleg425-client sshd[107611]: Received disconnect from 192.168.204.25 port 35364:11: disconnected by user May 25 05:18:53 oleg425-client sshd[107611]: Disconnected from user root 192.168.204.25 port 35364 May 25 05:18:53 oleg425-client sshd[107598]: pam_unix(sshd:session): session closed for user root May 25 05:18:54 oleg425-client systemd[1]: session-572.scope: Succeeded. May 25 05:18:54 oleg425-client systemd-logind[1020]: Session 572 logged out. Waiting for processes to exit. May 25 05:18:54 oleg425-client systemd-logind[1020]: Removed session 572. May 25 05:18:54 oleg425-client sshd[107752]: Accepted publickey for root from 192.168.204.25 port 49170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:54 oleg425-client systemd-logind[1020]: New session 573 of user root. May 25 05:18:54 oleg425-client systemd[1]: Started Session 573 of user root. May 25 05:18:54 oleg425-client sshd[107752]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:55 oleg425-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 05:18:55 oleg425-client sshd[107765]: Received disconnect from 192.168.204.25 port 49170:11: disconnected by user May 25 05:18:55 oleg425-client sshd[107765]: Disconnected from user root 192.168.204.25 port 49170 May 25 05:18:55 oleg425-client sshd[107752]: pam_unix(sshd:session): session closed for user root May 25 05:18:55 oleg425-client systemd[1]: session-573.scope: Succeeded. May 25 05:18:55 oleg425-client systemd-logind[1020]: Session 573 logged out. Waiting for processes to exit. May 25 05:18:55 oleg425-client systemd-logind[1020]: Removed session 573. May 25 05:18:56 oleg425-client sshd[107806]: Accepted publickey for root from 192.168.204.25 port 49176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:56 oleg425-client systemd-logind[1020]: New session 574 of user root. May 25 05:18:56 oleg425-client systemd[1]: Started Session 574 of user root. May 25 05:18:56 oleg425-client sshd[107806]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:57 oleg425-client sshd[107820]: Received disconnect from 192.168.204.25 port 49176:11: disconnected by user May 25 05:18:57 oleg425-client sshd[107820]: Disconnected from user root 192.168.204.25 port 49176 May 25 05:18:57 oleg425-client sshd[107806]: pam_unix(sshd:session): session closed for user root May 25 05:18:57 oleg425-client systemd[1]: session-574.scope: Succeeded. May 25 05:18:57 oleg425-client systemd-logind[1020]: Session 574 logged out. Waiting for processes to exit. May 25 05:18:57 oleg425-client systemd-logind[1020]: Removed session 574. May 25 05:19:00 oleg425-client sshd[107964]: Accepted publickey for root from 192.168.204.25 port 49192 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:00 oleg425-client systemd-logind[1020]: New session 575 of user root. May 25 05:19:00 oleg425-client systemd[1]: Started Session 575 of user root. May 25 05:19:00 oleg425-client sshd[107964]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:00 oleg425-client sshd[107977]: Received disconnect from 192.168.204.25 port 49192:11: disconnected by user May 25 05:19:00 oleg425-client sshd[107977]: Disconnected from user root 192.168.204.25 port 49192 May 25 05:19:00 oleg425-client sshd[107964]: pam_unix(sshd:session): session closed for user root May 25 05:19:00 oleg425-client systemd-logind[1020]: Session 575 logged out. Waiting for processes to exit. May 25 05:19:00 oleg425-client systemd[1]: session-575.scope: Succeeded. May 25 05:19:00 oleg425-client systemd-logind[1020]: Removed session 575. May 25 05:19:01 oleg425-client sshd[108101]: Accepted publickey for root from 192.168.204.25 port 49198 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:01 oleg425-client systemd-logind[1020]: New session 576 of user root. May 25 05:19:01 oleg425-client systemd[1]: Started Session 576 of user root. May 25 05:19:01 oleg425-client sshd[108101]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:01 oleg425-client sshd[108114]: Received disconnect from 192.168.204.25 port 49198:11: disconnected by user May 25 05:19:01 oleg425-client sshd[108114]: Disconnected from user root 192.168.204.25 port 49198 May 25 05:19:02 oleg425-client sshd[108101]: pam_unix(sshd:session): session closed for user root May 25 05:19:02 oleg425-client systemd[1]: session-576.scope: Succeeded. May 25 05:19:02 oleg425-client systemd-logind[1020]: Session 576 logged out. Waiting for processes to exit. May 25 05:19:02 oleg425-client systemd-logind[1020]: Removed session 576. May 25 05:19:03 oleg425-client sshd[108245]: Accepted publickey for root from 192.168.204.25 port 49212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:03 oleg425-client systemd-logind[1020]: New session 577 of user root. May 25 05:19:03 oleg425-client systemd[1]: Started Session 577 of user root. May 25 05:19:03 oleg425-client sshd[108245]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:03 oleg425-client sshd[108258]: Received disconnect from 192.168.204.25 port 49212:11: disconnected by user May 25 05:19:03 oleg425-client sshd[108258]: Disconnected from user root 192.168.204.25 port 49212 May 25 05:19:03 oleg425-client sshd[108245]: pam_unix(sshd:session): session closed for user root May 25 05:19:03 oleg425-client systemd[1]: session-577.scope: Succeeded. May 25 05:19:03 oleg425-client systemd-logind[1020]: Session 577 logged out. Waiting for processes to exit. May 25 05:19:03 oleg425-client systemd-logind[1020]: Removed session 577. May 25 05:19:05 oleg425-client sshd[108407]: Accepted publickey for root from 192.168.204.25 port 49030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:05 oleg425-client systemd-logind[1020]: New session 578 of user root. May 25 05:19:05 oleg425-client systemd[1]: Started Session 578 of user root. May 25 05:19:05 oleg425-client sshd[108407]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:06 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 157: eviction during mmaped i/o === 05:19:04 (1779700744) May 25 05:19:06 oleg425-client sshd[108420]: Received disconnect from 192.168.204.25 port 49030:11: disconnected by user May 25 05:19:06 oleg425-client sshd[108420]: Disconnected from user root 192.168.204.25 port 49030 May 25 05:19:06 oleg425-client sshd[108407]: pam_unix(sshd:session): session closed for user root May 25 05:19:06 oleg425-client systemd-logind[1020]: Session 578 logged out. Waiting for processes to exit. May 25 05:19:06 oleg425-client systemd[1]: session-578.scope: Succeeded. May 25 05:19:06 oleg425-client systemd-logind[1020]: Removed session 578. May 25 05:19:06 oleg425-client kernel: LustreError: 108468:0:(vvp_io.c:1484:vvp_io_fault_start()) cfs_fail_timeout id 1432 sleeping for 3000ms May 25 05:19:09 oleg425-client kernel: LustreError: 108468:0:(vvp_io.c:1484:vvp_io_fault_start()) cfs_fail_timeout id 1432 awake May 25 05:19:09 oleg425-client kernel: LustreError: lustre-OST0000-osc-ffffa09b093bb000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:19:09 oleg425-client kernel: LustreError: 108481:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffffa09b093bb000: namespace resource [0x240000401:0x2983:0x0].0x0 (ffffa09b0773af00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:19:09 oleg425-client systemd[1]: Created slice system-systemd\x2dcoredump.slice. May 25 05:19:09 oleg425-client systemd[1]: Started Process Core Dump (PID 108482/UID 0). May 25 05:19:09 oleg425-client systemd[108483]: systemd-coredump@0-108482-0.service: Failed to set up special execution directory in /var/lib: Read-only file system May 25 05:19:09 oleg425-client systemd[108483]: systemd-coredump@0-108482-0.service: Failed at step STATE_DIRECTORY spawning /usr/lib/systemd/systemd-coredump: Read-only file system May 25 05:19:09 oleg425-client systemd[1]: systemd-coredump@0-108482-0.service: Succeeded. May 25 05:19:10 oleg425-client sshd[108573]: Accepted publickey for root from 192.168.204.25 port 49040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:10 oleg425-client systemd-logind[1020]: New session 579 of user root. May 25 05:19:10 oleg425-client systemd[1]: Started Session 579 of user root. May 25 05:19:10 oleg425-client sshd[108573]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:11 oleg425-client sshd[108586]: Received disconnect from 192.168.204.25 port 49040:11: disconnected by user May 25 05:19:11 oleg425-client sshd[108586]: Disconnected from user root 192.168.204.25 port 49040 May 25 05:19:11 oleg425-client sshd[108573]: pam_unix(sshd:session): session closed for user root May 25 05:19:11 oleg425-client systemd[1]: session-579.scope: Succeeded. May 25 05:19:11 oleg425-client systemd-logind[1020]: Session 579 logged out. Waiting for processes to exit. May 25 05:19:11 oleg425-client systemd-logind[1020]: Removed session 579. May 25 05:19:12 oleg425-client sshd[108711]: Accepted publickey for root from 192.168.204.25 port 49042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:12 oleg425-client systemd[1]: Started Session 580 of user root. May 25 05:19:12 oleg425-client systemd-logind[1020]: New session 580 of user root. May 25 05:19:12 oleg425-client sshd[108711]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:12 oleg425-client sshd[108724]: Received disconnect from 192.168.204.25 port 49042:11: disconnected by user May 25 05:19:12 oleg425-client sshd[108724]: Disconnected from user root 192.168.204.25 port 49042 May 25 05:19:12 oleg425-client sshd[108711]: pam_unix(sshd:session): session closed for user root May 25 05:19:12 oleg425-client systemd[1]: session-580.scope: Succeeded. May 25 05:19:12 oleg425-client systemd-logind[1020]: Session 580 logged out. Waiting for processes to exit. May 25 05:19:12 oleg425-client systemd-logind[1020]: Removed session 580. May 25 05:19:13 oleg425-client sshd[108855]: Accepted publickey for root from 192.168.204.25 port 49046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:13 oleg425-client systemd-logind[1020]: New session 581 of user root. May 25 05:19:13 oleg425-client systemd[1]: Started Session 581 of user root. May 25 05:19:13 oleg425-client sshd[108855]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:14 oleg425-client sshd[108868]: Received disconnect from 192.168.204.25 port 49046:11: disconnected by user May 25 05:19:14 oleg425-client sshd[108868]: Disconnected from user root 192.168.204.25 port 49046 May 25 05:19:14 oleg425-client sshd[108855]: pam_unix(sshd:session): session closed for user root May 25 05:19:14 oleg425-client systemd[1]: session-581.scope: Succeeded. May 25 05:19:14 oleg425-client systemd-logind[1020]: Session 581 logged out. Waiting for processes to exit. May 25 05:19:14 oleg425-client systemd-logind[1020]: Removed session 581. May 25 05:19:15 oleg425-client sshd[109008]: Accepted publickey for root from 192.168.204.25 port 56558 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:15 oleg425-client systemd[1]: Started Session 582 of user root. May 25 05:19:15 oleg425-client systemd-logind[1020]: New session 582 of user root. May 25 05:19:15 oleg425-client sshd[109008]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:15 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 158a: connect without access right ========================================================== 05:19:14 (1779700754) May 25 05:19:15 oleg425-client sshd[109021]: Received disconnect from 192.168.204.25 port 56558:11: disconnected by user May 25 05:19:15 oleg425-client sshd[109021]: Disconnected from user root 192.168.204.25 port 56558 May 25 05:19:15 oleg425-client sshd[109008]: pam_unix(sshd:session): session closed for user root May 25 05:19:16 oleg425-client systemd[1]: session-582.scope: Succeeded. May 25 05:19:16 oleg425-client systemd-logind[1020]: Session 582 logged out. Waiting for processes to exit. May 25 05:19:16 oleg425-client systemd-logind[1020]: Removed session 582. May 25 05:19:16 oleg425-client sshd[109148]: Accepted publickey for root from 192.168.204.25 port 56564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:16 oleg425-client systemd[1]: Started Session 583 of user root. May 25 05:19:16 oleg425-client systemd-logind[1020]: New session 583 of user root. May 25 05:19:16 oleg425-client sshd[109148]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:17 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_158a needs >= 2 MDTS May 25 05:19:17 oleg425-client sshd[109161]: Received disconnect from 192.168.204.25 port 56564:11: disconnected by user May 25 05:19:17 oleg425-client sshd[109161]: Disconnected from user root 192.168.204.25 port 56564 May 25 05:19:17 oleg425-client sshd[109148]: pam_unix(sshd:session): session closed for user root May 25 05:19:17 oleg425-client systemd[1]: session-583.scope: Succeeded. May 25 05:19:17 oleg425-client systemd-logind[1020]: Session 583 logged out. Waiting for processes to exit. May 25 05:19:17 oleg425-client systemd-logind[1020]: Removed session 583. May 25 05:19:18 oleg425-client sshd[109300]: Accepted publickey for root from 192.168.204.25 port 56570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:18 oleg425-client systemd-logind[1020]: New session 584 of user root. May 25 05:19:18 oleg425-client systemd[1]: Started Session 584 of user root. May 25 05:19:18 oleg425-client sshd[109300]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:18 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 160: MDT destroys are blocked by grouplocks ========================================================== 05:19:17 (1779700757) May 25 05:19:18 oleg425-client sshd[109313]: Received disconnect from 192.168.204.25 port 56570:11: disconnected by user May 25 05:19:18 oleg425-client sshd[109313]: Disconnected from user root 192.168.204.25 port 56570 May 25 05:19:18 oleg425-client sshd[109300]: pam_unix(sshd:session): session closed for user root May 25 05:19:18 oleg425-client systemd[1]: session-584.scope: Succeeded. May 25 05:19:18 oleg425-client systemd-logind[1020]: Session 584 logged out. Waiting for processes to exit. May 25 05:19:18 oleg425-client systemd-logind[1020]: Removed session 584. May 25 05:19:22 oleg425-client kernel: LustreError: lustre-MDT0000-mdc-ffffa09b093bb000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:20:06 oleg425-client sshd[109570]: Accepted publickey for root from 192.168.204.25 port 58014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:06 oleg425-client systemd[1]: Started Session 585 of user root. May 25 05:20:06 oleg425-client systemd-logind[1020]: New session 585 of user root. May 25 05:20:06 oleg425-client sshd[109570]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:07 oleg425-client sshd[109583]: Received disconnect from 192.168.204.25 port 58014:11: disconnected by user May 25 05:20:07 oleg425-client sshd[109583]: Disconnected from user root 192.168.204.25 port 58014 May 25 05:20:07 oleg425-client sshd[109570]: pam_unix(sshd:session): session closed for user root May 25 05:20:07 oleg425-client systemd[1]: session-585.scope: Succeeded. May 25 05:20:07 oleg425-client systemd-logind[1020]: Session 585 logged out. Waiting for processes to exit. May 25 05:20:07 oleg425-client systemd-logind[1020]: Removed session 585. May 25 05:20:08 oleg425-client sshd[109707]: Accepted publickey for root from 192.168.204.25 port 58026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:08 oleg425-client systemd-logind[1020]: New session 586 of user root. May 25 05:20:08 oleg425-client systemd[1]: Started Session 586 of user root. May 25 05:20:08 oleg425-client sshd[109707]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:08 oleg425-client sshd[109720]: Received disconnect from 192.168.204.25 port 58026:11: disconnected by user May 25 05:20:08 oleg425-client sshd[109720]: Disconnected from user root 192.168.204.25 port 58026 May 25 05:20:08 oleg425-client sshd[109707]: pam_unix(sshd:session): session closed for user root May 25 05:20:08 oleg425-client systemd[1]: session-586.scope: Succeeded. May 25 05:20:08 oleg425-client systemd-logind[1020]: Session 586 logged out. Waiting for processes to exit. May 25 05:20:08 oleg425-client systemd-logind[1020]: Removed session 586. May 25 05:20:09 oleg425-client sshd[109852]: Accepted publickey for root from 192.168.204.25 port 58032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:09 oleg425-client systemd[1]: Started Session 587 of user root. May 25 05:20:09 oleg425-client systemd-logind[1020]: New session 587 of user root. May 25 05:20:09 oleg425-client sshd[109852]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:09 oleg425-client sshd[109865]: Received disconnect from 192.168.204.25 port 58032:11: disconnected by user May 25 05:20:09 oleg425-client sshd[109865]: Disconnected from user root 192.168.204.25 port 58032 May 25 05:20:09 oleg425-client sshd[109852]: pam_unix(sshd:session): session closed for user root May 25 05:20:10 oleg425-client systemd[1]: session-587.scope: Succeeded. May 25 05:20:10 oleg425-client systemd-logind[1020]: Session 587 logged out. Waiting for processes to exit. May 25 05:20:10 oleg425-client systemd-logind[1020]: Removed session 587. May 25 05:20:11 oleg425-client sshd[110006]: Accepted publickey for root from 192.168.204.25 port 58036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:11 oleg425-client systemd[1]: Started Session 588 of user root. May 25 05:20:11 oleg425-client systemd-logind[1020]: New session 588 of user root. May 25 05:20:11 oleg425-client sshd[110006]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:11 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 161: evict osp by ping evictor ==== 05:20:10 (1779700810) May 25 05:20:11 oleg425-client sshd[110019]: Received disconnect from 192.168.204.25 port 58036:11: disconnected by user May 25 05:20:11 oleg425-client sshd[110019]: Disconnected from user root 192.168.204.25 port 58036 May 25 05:20:11 oleg425-client sshd[110006]: pam_unix(sshd:session): session closed for user root May 25 05:20:11 oleg425-client systemd[1]: session-588.scope: Succeeded. May 25 05:20:11 oleg425-client systemd-logind[1020]: Session 588 logged out. Waiting for processes to exit. May 25 05:20:11 oleg425-client systemd-logind[1020]: Removed session 588. May 25 05:20:12 oleg425-client sshd[110142]: Accepted publickey for root from 192.168.204.25 port 58046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:12 oleg425-client systemd-logind[1020]: New session 589 of user root. May 25 05:20:12 oleg425-client systemd[1]: Started Session 589 of user root. May 25 05:20:12 oleg425-client sshd[110142]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:12 oleg425-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_161 needs >= 2 MDTs May 25 05:20:12 oleg425-client sshd[110155]: Received disconnect from 192.168.204.25 port 58046:11: disconnected by user May 25 05:20:12 oleg425-client sshd[110155]: Disconnected from user root 192.168.204.25 port 58046 May 25 05:20:12 oleg425-client sshd[110142]: pam_unix(sshd:session): session closed for user root May 25 05:20:13 oleg425-client systemd[1]: session-589.scope: Succeeded. May 25 05:20:13 oleg425-client systemd-logind[1020]: Session 589 logged out. Waiting for processes to exit. May 25 05:20:13 oleg425-client systemd-logind[1020]: Removed session 589. May 25 05:20:14 oleg425-client sshd[110294]: Accepted publickey for root from 192.168.204.25 port 58058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:14 oleg425-client systemd-logind[1020]: New session 590 of user root. May 25 05:20:14 oleg425-client systemd[1]: Started Session 590 of user root. May 25 05:20:14 oleg425-client sshd[110294]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:14 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 162: File attributes should be persisted after MDS failover ========================================================== 05:20:13 (1779700813) May 25 05:20:14 oleg425-client sshd[110307]: Received disconnect from 192.168.204.25 port 58058:11: disconnected by user May 25 05:20:14 oleg425-client sshd[110307]: Disconnected from user root 192.168.204.25 port 58058 May 25 05:20:14 oleg425-client sshd[110294]: pam_unix(sshd:session): session closed for user root May 25 05:20:14 oleg425-client systemd-logind[1020]: Session 590 logged out. Waiting for processes to exit. May 25 05:20:14 oleg425-client systemd[1]: session-590.scope: Succeeded. May 25 05:20:14 oleg425-client systemd-logind[1020]: Removed session 590. May 25 05:20:29 oleg425-client kernel: LustreError: 2371:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffffa09b10884000 x1866143464063104/t133143986232(133143986232) o101->lustre-MDT0000-mdc-ffffa09b093bb000@192.168.204.125@tcp:12/10 lens 576/608 e 0 to 0 dl 1779700864 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'chattr.0' uid:0 gid:0 projid:0 May 25 05:20:35 oleg425-client sshd[110705]: Accepted publickey for root from 192.168.204.25 port 52236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:35 oleg425-client systemd[1]: Started Session 591 of user root. May 25 05:20:35 oleg425-client systemd-logind[1020]: New session 591 of user root. May 25 05:20:35 oleg425-client sshd[110705]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:35 oleg425-client sshd[110718]: Received disconnect from 192.168.204.25 port 52236:11: disconnected by user May 25 05:20:35 oleg425-client sshd[110718]: Disconnected from user root 192.168.204.25 port 52236 May 25 05:20:35 oleg425-client sshd[110705]: pam_unix(sshd:session): session closed for user root May 25 05:20:36 oleg425-client systemd[1]: session-591.scope: Succeeded. May 25 05:20:36 oleg425-client systemd-logind[1020]: Session 591 logged out. Waiting for processes to exit. May 25 05:20:36 oleg425-client systemd-logind[1020]: Removed session 591. May 25 05:20:36 oleg425-client sshd[110842]: Accepted publickey for root from 192.168.204.25 port 52246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:37 oleg425-client systemd-logind[1020]: New session 592 of user root. May 25 05:20:37 oleg425-client systemd[1]: Started Session 592 of user root. May 25 05:20:37 oleg425-client sshd[110842]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:37 oleg425-client sshd[110855]: Received disconnect from 192.168.204.25 port 52246:11: disconnected by user May 25 05:20:37 oleg425-client sshd[110855]: Disconnected from user root 192.168.204.25 port 52246 May 25 05:20:37 oleg425-client sshd[110842]: pam_unix(sshd:session): session closed for user root May 25 05:20:37 oleg425-client systemd-logind[1020]: Session 592 logged out. Waiting for processes to exit. May 25 05:20:37 oleg425-client systemd[1]: session-592.scope: Succeeded. May 25 05:20:37 oleg425-client systemd-logind[1020]: Removed session 592. May 25 05:20:38 oleg425-client sshd[110987]: Accepted publickey for root from 192.168.204.25 port 52254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:38 oleg425-client systemd-logind[1020]: New session 593 of user root. May 25 05:20:38 oleg425-client systemd[1]: Started Session 593 of user root. May 25 05:20:38 oleg425-client sshd[110987]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:38 oleg425-client sshd[111000]: Received disconnect from 192.168.204.25 port 52254:11: disconnected by user May 25 05:20:38 oleg425-client sshd[111000]: Disconnected from user root 192.168.204.25 port 52254 May 25 05:20:38 oleg425-client sshd[110987]: pam_unix(sshd:session): session closed for user root May 25 05:20:39 oleg425-client systemd[1]: session-593.scope: Succeeded. May 25 05:20:39 oleg425-client systemd-logind[1020]: Session 593 logged out. Waiting for processes to exit. May 25 05:20:39 oleg425-client systemd-logind[1020]: Removed session 593. May 25 05:20:40 oleg425-client sshd[111142]: Accepted publickey for root from 192.168.204.25 port 52270 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:40 oleg425-client systemd-logind[1020]: New session 594 of user root. May 25 05:20:40 oleg425-client systemd[1]: Started Session 594 of user root. May 25 05:20:40 oleg425-client sshd[111142]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:41 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test 163: changelog check for fail write and processing records ========================================================== 05:20:39 (1779700839) May 25 05:20:41 oleg425-client sshd[111155]: Received disconnect from 192.168.204.25 port 52270:11: disconnected by user May 25 05:20:41 oleg425-client sshd[111155]: Disconnected from user root 192.168.204.25 port 52270 May 25 05:20:41 oleg425-client sshd[111142]: pam_unix(sshd:session): session closed for user root May 25 05:20:41 oleg425-client systemd-logind[1020]: Session 594 logged out. Waiting for processes to exit. May 25 05:20:41 oleg425-client systemd[1]: session-594.scope: Succeeded. May 25 05:20:41 oleg425-client systemd-logind[1020]: Removed session 594. May 25 05:20:48 oleg425-client sshd[111461]: Accepted publickey for root from 192.168.204.25 port 38938 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:48 oleg425-client systemd-logind[1020]: New session 595 of user root. May 25 05:20:48 oleg425-client systemd[1]: Started Session 595 of user root. May 25 05:20:48 oleg425-client sshd[111461]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:48 oleg425-client sshd[111474]: Received disconnect from 192.168.204.25 port 38938:11: disconnected by user May 25 05:20:48 oleg425-client sshd[111474]: Disconnected from user root 192.168.204.25 port 38938 May 25 05:20:49 oleg425-client sshd[111461]: pam_unix(sshd:session): session closed for user root May 25 05:20:49 oleg425-client systemd[1]: session-595.scope: Succeeded. May 25 05:20:49 oleg425-client systemd-logind[1020]: Session 595 logged out. Waiting for processes to exit. May 25 05:20:49 oleg425-client systemd-logind[1020]: Removed session 595. May 25 05:20:50 oleg425-client sshd[111598]: Accepted publickey for root from 192.168.204.25 port 38950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:50 oleg425-client systemd-logind[1020]: New session 596 of user root. May 25 05:20:50 oleg425-client systemd[1]: Started Session 596 of user root. May 25 05:20:50 oleg425-client sshd[111598]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:50 oleg425-client sshd[111611]: Received disconnect from 192.168.204.25 port 38950:11: disconnected by user May 25 05:20:50 oleg425-client sshd[111611]: Disconnected from user root 192.168.204.25 port 38950 May 25 05:20:50 oleg425-client sshd[111598]: pam_unix(sshd:session): session closed for user root May 25 05:20:51 oleg425-client systemd-logind[1020]: Session 596 logged out. Waiting for processes to exit. May 25 05:20:51 oleg425-client systemd[1]: session-596.scope: Succeeded. May 25 05:20:51 oleg425-client systemd-logind[1020]: Removed session 596. May 25 05:20:52 oleg425-client sshd[111742]: Accepted publickey for root from 192.168.204.25 port 38958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:52 oleg425-client systemd-logind[1020]: New session 597 of user root. May 25 05:20:52 oleg425-client systemd[1]: Started Session 597 of user root. May 25 05:20:52 oleg425-client sshd[111742]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:52 oleg425-client sshd[111755]: Received disconnect from 192.168.204.25 port 38958:11: disconnected by user May 25 05:20:52 oleg425-client sshd[111755]: Disconnected from user root 192.168.204.25 port 38958 May 25 05:20:52 oleg425-client sshd[111742]: pam_unix(sshd:session): session closed for user root May 25 05:20:52 oleg425-client systemd[1]: session-597.scope: Succeeded. May 25 05:20:52 oleg425-client systemd-logind[1020]: Session 597 logged out. Waiting for processes to exit. May 25 05:20:52 oleg425-client systemd-logind[1020]: Removed session 597. May 25 05:20:55 oleg425-client kernel: Lustre: 2374:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779700819/real 1779700819] req@ffffa09b06d65c00 x1866143464068608/t0(0) o400->lustre-MDT0000-mdc-ffffa09b093bb000@192.168.204.125@tcp:12/10 lens 224/224 e 0 to 1 dl 1779700854 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 05:20:55 oleg425-client kernel: Lustre: 2374:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 6 previous similar messages May 25 05:20:59 oleg425-client sshd[111949]: Accepted publickey for root from 192.168.204.25 port 52734 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:59 oleg425-client systemd-logind[1020]: New session 598 of user root. May 25 05:20:59 oleg425-client systemd[1]: Started Session 598 of user root. May 25 05:20:59 oleg425-client sshd[111949]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:59 oleg425-client kernel: Lustre: DEBUG MARKER: == recovery-small test complete, duration 7644 sec ======= 05:20:57 (1779700857) May 25 05:20:59 oleg425-client sshd[111962]: Received disconnect from 192.168.204.25 port 52734:11: disconnected by user May 25 05:20:59 oleg425-client sshd[111962]: Disconnected from user root 192.168.204.25 port 52734 May 25 05:20:59 oleg425-client sshd[111949]: pam_unix(sshd:session): session closed for user root May 25 05:20:59 oleg425-client systemd[1]: session-598.scope: Succeeded. May 25 05:20:59 oleg425-client systemd-logind[1020]: Session 598 logged out. Waiting for processes to exit. May 25 05:20:59 oleg425-client systemd-logind[1020]: Removed session 598. May 25 05:21:00 oleg425-client sshd[112093]: Accepted publickey for root from 192.168.204.25 port 52744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:00 oleg425-client systemd-logind[1020]: New session 599 of user root. May 25 05:21:00 oleg425-client systemd[1]: Started Session 599 of user root. May 25 05:21:00 oleg425-client sshd[112093]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:00 oleg425-client kernel: Lustre: DEBUG MARKER: === recovery-small: start cleanup 05:20:59 (1779700859) === May 25 05:21:00 oleg425-client sshd[112106]: Received disconnect from 192.168.204.25 port 52744:11: disconnected by user May 25 05:21:00 oleg425-client sshd[112106]: Disconnected from user root 192.168.204.25 port 52744 May 25 05:21:01 oleg425-client sshd[112093]: pam_unix(sshd:session): session closed for user root May 25 05:21:01 oleg425-client systemd[1]: session-599.scope: Succeeded. May 25 05:21:01 oleg425-client systemd-logind[1020]: Session 599 logged out. Waiting for processes to exit. May 25 05:21:01 oleg425-client systemd-logind[1020]: Removed session 599. May 25 05:23:36 oleg425-client systemd[1]: Starting dnf makecache... May 25 05:23:42 oleg425-client dnf[112172]: Failed determining last makecache time. May 25 05:23:42 oleg425-client dnf[112172]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' May 25 05:23:42 oleg425-client dnf[112172]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' May 25 05:23:43 oleg425-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE May 25 05:23:43 oleg425-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. May 25 05:23:43 oleg425-client systemd[1]: Failed to start dnf makecache. May 25 05:25:58 oleg425-client sshd[112286]: Accepted publickey for root from 192.168.204.25 port 50578 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:25:58 oleg425-client systemd-logind[1020]: New session 600 of user root. May 25 05:25:58 oleg425-client systemd[1]: Started Session 600 of user root. May 25 05:25:58 oleg425-client sshd[112286]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:25:58 oleg425-client sshd[112300]: Received disconnect from 192.168.204.25 port 50578:11: disconnected by user May 25 05:25:58 oleg425-client sshd[112300]: Disconnected from user root 192.168.204.25 port 50578 May 25 05:25:58 oleg425-client sshd[112286]: pam_unix(sshd:session): session closed for user root May 25 05:25:59 oleg425-client systemd[1]: session-600.scope: Succeeded. May 25 05:25:59 oleg425-client systemd-logind[1020]: Session 600 logged out. Waiting for processes to exit. May 25 05:25:59 oleg425-client systemd-logind[1020]: Removed session 600. May 25 05:26:00 oleg425-client sshd[112425]: Accepted publickey for root from 192.168.204.25 port 50586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:00 oleg425-client systemd-logind[1020]: New session 601 of user root. May 25 05:26:00 oleg425-client systemd[1]: Started Session 601 of user root. May 25 05:26:00 oleg425-client sshd[112425]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:00 oleg425-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish cleanup 05:25:59 (1779701159) === May 25 05:26:00 oleg425-client sshd[112438]: Received disconnect from 192.168.204.25 port 50586:11: disconnected by user May 25 05:26:00 oleg425-client sshd[112438]: Disconnected from user root 192.168.204.25 port 50586 May 25 05:26:00 oleg425-client sshd[112425]: pam_unix(sshd:session): session closed for user root May 25 05:26:01 oleg425-client systemd-logind[1020]: Session 601 logged out. Waiting for processes to exit. May 25 05:26:01 oleg425-client systemd[1]: session-601.scope: Succeeded. May 25 05:26:01 oleg425-client systemd-logind[1020]: Removed session 601. May 25 05:26:22 oleg425-client kernel: LustreError: MGC192.168.204.125@tcp: Connection to MGS (at 192.168.204.125@tcp) was lost; in progress operations using this service will fail May 25 05:26:22 oleg425-client kernel: LustreError: Skipped 2 previous similar messages May 25 05:26:22 oleg425-client kernel: Lustre: lustre-MDT0000-mdc-ffffa09b093bb000: Connection to lustre-MDT0000 (at 192.168.204.125@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:26:22 oleg425-client kernel: Lustre: Skipped 6 previous similar messages May 25 05:26:22 oleg425-client kernel: Lustre: Evicted from MGS (at 192.168.204.125@tcp) after server handle changed from 0x799e3d1c00c204a6 to 0x799e3d1c00cb1a20 May 25 05:26:22 oleg425-client kernel: Lustre: Skipped 2 previous similar messages May 25 05:26:22 oleg425-client kernel: Lustre: MGC192.168.204.125@tcp: Connection restored to 192.168.204.125@tcp (at 192.168.204.125@tcp) May 25 05:26:22 oleg425-client kernel: Lustre: Skipped 11 previous similar messages May 25 05:26:30 oleg425-client sshd[112754]: Accepted publickey for root from 192.168.204.25 port 48814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:30 oleg425-client systemd-logind[1020]: New session 602 of user root. May 25 05:26:30 oleg425-client systemd[1]: Started Session 602 of user root. May 25 05:26:30 oleg425-client sshd[112754]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:31 oleg425-client sshd[112767]: Received disconnect from 192.168.204.25 port 48814:11: disconnected by user May 25 05:26:31 oleg425-client sshd[112767]: Disconnected from user root 192.168.204.25 port 48814 May 25 05:26:31 oleg425-client sshd[112754]: pam_unix(sshd:session): session closed for user root May 25 05:26:31 oleg425-client systemd[1]: session-602.scope: Succeeded. May 25 05:26:31 oleg425-client systemd-logind[1020]: Session 602 logged out. Waiting for processes to exit. May 25 05:26:31 oleg425-client systemd-logind[1020]: Removed session 602. May 25 05:26:34 oleg425-client sshd[112988]: Accepted publickey for root from 192.168.204.25 port 55132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:34 oleg425-client systemd-logind[1020]: New session 603 of user root. May 25 05:26:34 oleg425-client systemd[1]: Started Session 603 of user root. May 25 05:26:34 oleg425-client sshd[112988]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:35 oleg425-client kernel: Lustre: DEBUG MARKER: oleg425-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 05:26:35 oleg425-client sshd[113002]: Received disconnect from 192.168.204.25 port 55132:11: disconnected by user May 25 05:26:35 oleg425-client sshd[113002]: Disconnected from user root 192.168.204.25 port 55132 May 25 05:26:35 oleg425-client sshd[112988]: pam_unix(sshd:session): session closed for user root May 25 05:26:35 oleg425-client systemd[1]: session-603.scope: Succeeded. May 25 05:26:35 oleg425-client systemd-logind[1020]: Session 603 logged out. Waiting for processes to exit. May 25 05:26:35 oleg425-client systemd-logind[1020]: Removed session 603. May 25 05:26:35 oleg425-client rsyslogd[1083]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:26:36 oleg425-client sshd[113144]: Accepted publickey for root from 192.168.204.25 port 55138 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:36 oleg425-client systemd-logind[1020]: New session 604 of user root. May 25 05:26:36 oleg425-client systemd[1]: Started Session 604 of user root. May 25 05:26:36 oleg425-client sshd[113144]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:36 oleg425-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 05:26:36 oleg425-client sshd[113157]: Received disconnect from 192.168.204.25 port 55138:11: disconnected by user May 25 05:26:36 oleg425-client sshd[113157]: Disconnected from user root 192.168.204.25 port 55138 May 25 05:26:36 oleg425-client sshd[113144]: pam_unix(sshd:session): session closed for user root May 25 05:26:36 oleg425-client systemd[1]: session-604.scope: Succeeded. May 25 05:26:36 oleg425-client systemd-logind[1020]: Session 604 logged out. Waiting for processes to exit. May 25 05:26:36 oleg425-client systemd-logind[1020]: Removed session 604. May 25 05:26:38 oleg425-client sshd[113199]: Accepted publickey for root from 192.168.204.25 port 55140 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:38 oleg425-client systemd-logind[1020]: New session 605 of user root. May 25 05:26:38 oleg425-client systemd[1]: Started Session 605 of user root. May 25 05:26:38 oleg425-client sshd[113199]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:38 oleg425-client sshd[113212]: Received disconnect from 192.168.204.25 port 55140:11: disconnected by user May 25 05:26:38 oleg425-client sshd[113212]: Disconnected from user root 192.168.204.25 port 55140 May 25 05:26:38 oleg425-client sshd[113199]: pam_unix(sshd:session): session closed for user root May 25 05:26:38 oleg425-client systemd[1]: session-605.scope: Succeeded. May 25 05:26:38 oleg425-client systemd-logind[1020]: Session 605 logged out. Waiting for processes to exit. May 25 05:26:38 oleg425-client systemd-logind[1020]: Removed session 605. May 25 05:26:40 oleg425-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:26:40 oleg425-client kernel: LustreError: 113255:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffffa09b093bb000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:26:40 oleg425-client kernel: LustreError: 113255:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:26:40 oleg425-client kernel: Lustre: Unmounted lustre-client May 25 05:26:57 oleg425-client kernel: Key type lgssc unregistered May 25 05:26:57 oleg425-client kernel: LNet: 113735:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit May 25 05:26:57 oleg425-client kernel: LNetError: 113735:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found May 25 05:26:57 oleg425-client kernel: LNet: Removed LNI 192.168.204.25@tcp May 25 05:26:58 oleg425-client kernel: Key type .llcrypt unregistered May 25 05:26:58 oleg425-client kernel: Key type ._llcrypt unregistered May 25 05:26:58 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 05:26:58 oleg425-client systemd-udevd[113808]: Using default interface naming scheme 'rhel-8.0'. May 25 05:26:58 oleg425-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 05:27:05 oleg425-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. May 25 05:27:05 oleg425-client sshd[1545]: Received disconnect from 192.168.200.253 port 41304:11: disconnected by user May 25 05:27:05 oleg425-client sshd[1545]: Disconnected from user root 192.168.200.253 port 41304 May 25 05:27:05 oleg425-client sshd[1522]: pam_unix(sshd:session): session closed for user root May 25 05:27:05 oleg425-client systemd[1]: session-3.scope: Succeeded. May 25 05:27:05 oleg425-client systemd-logind[1020]: Session 3 logged out. Waiting for processes to exit. May 25 05:27:05 oleg425-client systemd-logind[1020]: Removed session 3.