May 25 03:09:11 oleg113-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 May 25 03:09:11 oleg113-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:09:11 oleg113-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' May 25 03:09:11 oleg113-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' May 25 03:09:11 oleg113-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' May 25 03:09:11 oleg113-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 May 25 03:09:11 oleg113-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. May 25 03:09:11 oleg113-client kernel: signal: max sigframe size: 1776 May 25 03:09:11 oleg113-client kernel: BIOS-provided physical RAM map: May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved May 25 03:09:11 oleg113-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable May 25 03:09:11 oleg113-client kernel: NX (Execute Disable) protection: active May 25 03:09:11 oleg113-client kernel: SMBIOS 2.8 present. May 25 03:09:11 oleg113-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 May 25 03:09:11 oleg113-client kernel: Hypervisor detected: KVM May 25 03:09:11 oleg113-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 May 25 03:09:11 oleg113-client kernel: kvm-clock: using sched offset of 1632306375 cycles May 25 03:09:11 oleg113-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns May 25 03:09:11 oleg113-client kernel: tsc: Detected 2399.980 MHz processor May 25 03:09:11 oleg113-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved May 25 03:09:11 oleg113-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable May 25 03:09:11 oleg113-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 May 25 03:09:11 oleg113-client kernel: MTRR default type: write-back May 25 03:09:11 oleg113-client kernel: MTRR fixed ranges enabled: May 25 03:09:11 oleg113-client kernel: 00000-9FFFF write-back May 25 03:09:11 oleg113-client kernel: A0000-BFFFF uncachable May 25 03:09:11 oleg113-client kernel: C0000-FFFFF write-protect May 25 03:09:11 oleg113-client kernel: MTRR variable ranges enabled: May 25 03:09:11 oleg113-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable May 25 03:09:11 oleg113-client kernel: 1 disabled May 25 03:09:11 oleg113-client kernel: 2 disabled May 25 03:09:11 oleg113-client kernel: 3 disabled May 25 03:09:11 oleg113-client kernel: 4 disabled May 25 03:09:11 oleg113-client kernel: 5 disabled May 25 03:09:11 oleg113-client kernel: 6 disabled May 25 03:09:11 oleg113-client kernel: 7 disabled May 25 03:09:11 oleg113-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT May 25 03:09:11 oleg113-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 May 25 03:09:11 oleg113-client kernel: found SMP MP-table at [mem 0x000f54d0-0x000f54df] May 25 03:09:11 oleg113-client kernel: BRK [0x116a01000, 0x116a01fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a02000, 0x116a02fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a03000, 0x116a03fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a04000, 0x116a04fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a05000, 0x116a05fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a06000, 0x116a06fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a07000, 0x116a07fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a08000, 0x116a08fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a09000, 0x116a09fff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a0a000, 0x116a0afff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a0b000, 0x116a0bfff] PGTABLE May 25 03:09:11 oleg113-client kernel: BRK [0x116a0c000, 0x116a0cfff] PGTABLE May 25 03:09:11 oleg113-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] May 25 03:09:11 oleg113-client kernel: ACPI: Early table checksum verification disabled May 25 03:09:11 oleg113-client kernel: ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) May 25 03:09:11 oleg113-client kernel: ACPI: RSDT 0x00000000BFFE2464 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: FACP 0x00000000BFFE2300 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: DSDT 0x00000000BFFE0040 0022C0 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 May 25 03:09:11 oleg113-client kernel: ACPI: APIC 0x00000000BFFE2374 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: HPET 0x00000000BFFE2404 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: WAET 0x00000000BFFE243C 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) May 25 03:09:11 oleg113-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe2300-0xbffe2373] May 25 03:09:11 oleg113-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22ff] May 25 03:09:11 oleg113-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] May 25 03:09:11 oleg113-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe2374-0xbffe2403] May 25 03:09:11 oleg113-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe2404-0xbffe243b] May 25 03:09:11 oleg113-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe243c-0xbffe2463] May 25 03:09:11 oleg113-client kernel: ACPI: Local APIC address 0xfee00000 May 25 03:09:11 oleg113-client kernel: No NUMA configuration found May 25 03:09:11 oleg113-client kernel: Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] May 25 03:09:11 oleg113-client kernel: NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] May 25 03:09:11 oleg113-client kernel: Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) May 25 03:09:11 oleg113-client kernel: Zone ranges: May 25 03:09:11 oleg113-client kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] May 25 03:09:11 oleg113-client kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] May 25 03:09:11 oleg113-client kernel: Normal [mem 0x0000000100000000-0x0000000146dfffff] May 25 03:09:11 oleg113-client kernel: Device empty May 25 03:09:11 oleg113-client kernel: Movable zone start for each node May 25 03:09:11 oleg113-client kernel: Early memory node ranges May 25 03:09:11 oleg113-client kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] May 25 03:09:11 oleg113-client kernel: node 0: [mem 0x0000000000100000-0x00000000bffd9fff] May 25 03:09:11 oleg113-client kernel: node 0: [mem 0x0000000100000000-0x0000000146dfffff] May 25 03:09:11 oleg113-client kernel: Zeroed struct page in unavailable ranges: 4744 pages May 25 03:09:11 oleg113-client kernel: Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] May 25 03:09:11 oleg113-client kernel: On node 0 totalpages: 1076600 May 25 03:09:11 oleg113-client kernel: DMA zone: 64 pages used for memmap May 25 03:09:11 oleg113-client kernel: DMA zone: 158 pages reserved May 25 03:09:11 oleg113-client kernel: DMA zone: 3998 pages, LIFO batch:0 May 25 03:09:11 oleg113-client kernel: DMA32 zone: 12224 pages used for memmap May 25 03:09:11 oleg113-client kernel: DMA32 zone: 782298 pages, LIFO batch:63 May 25 03:09:11 oleg113-client kernel: Normal zone: 4536 pages used for memmap May 25 03:09:11 oleg113-client kernel: Normal zone: 290304 pages, LIFO batch:63 May 25 03:09:11 oleg113-client kernel: ACPI: PM-Timer IO Port: 0x608 May 25 03:09:11 oleg113-client kernel: ACPI: Local APIC address 0xfee00000 May 25 03:09:11 oleg113-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) May 25 03:09:11 oleg113-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 May 25 03:09:11 oleg113-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) May 25 03:09:11 oleg113-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) May 25 03:09:11 oleg113-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) May 25 03:09:11 oleg113-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) May 25 03:09:11 oleg113-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) May 25 03:09:11 oleg113-client kernel: ACPI: IRQ0 used by override. May 25 03:09:11 oleg113-client kernel: ACPI: IRQ5 used by override. May 25 03:09:11 oleg113-client kernel: ACPI: IRQ9 used by override. May 25 03:09:11 oleg113-client kernel: ACPI: IRQ10 used by override. May 25 03:09:11 oleg113-client kernel: ACPI: IRQ11 used by override. May 25 03:09:11 oleg113-client kernel: Using ACPI (MADT) for SMP configuration information May 25 03:09:11 oleg113-client kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000 May 25 03:09:11 oleg113-client kernel: TSC deadline timer available May 25 03:09:11 oleg113-client kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs May 25 03:09:11 oleg113-client kernel: kvm-guest: KVM setup pv remote TLB flush May 25 03:09:11 oleg113-client kernel: kvm-guest: setup PV sched yield May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] May 25 03:09:11 oleg113-client kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] May 25 03:09:11 oleg113-client kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices May 25 03:09:11 oleg113-client kernel: Booting paravirtualized kernel on KVM May 25 03:09:11 oleg113-client kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns May 25 03:09:11 oleg113-client kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 May 25 03:09:11 oleg113-client kernel: percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 May 25 03:09:11 oleg113-client kernel: pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 May 25 03:09:11 oleg113-client kernel: pcpu-alloc: [0] 0 1 2 3 May 25 03:09:11 oleg113-client kernel: kvm-guest: PV spinlocks enabled May 25 03:09:11 oleg113-client kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) May 25 03:09:11 oleg113-client kernel: Built 1 zonelists, mobility grouping on. Total pages: 1059618 May 25 03:09:11 oleg113-client kernel: Policy zone: Normal May 25 03:09:11 oleg113-client kernel: Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:09:11 oleg113-client kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. May 25 03:09:11 oleg113-client kernel: audit: disabled (until reboot) May 25 03:09:11 oleg113-client kernel: software IO TLB: area num 4. May 25 03:09:11 oleg113-client kernel: Memory: 2895288K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) May 25 03:09:11 oleg113-client kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 May 25 03:09:11 oleg113-client kernel: kmemleak: Kernel memory leak detector disabled May 25 03:09:11 oleg113-client kernel: ftrace: allocating 41240 entries in 162 pages May 25 03:09:11 oleg113-client kernel: ftrace: allocated 162 pages with 3 groups May 25 03:09:11 oleg113-client kernel: rcu: Hierarchical RCU implementation. May 25 03:09:11 oleg113-client kernel: rcu: #011RCU event tracing is enabled. May 25 03:09:11 oleg113-client kernel: rcu: #011RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. May 25 03:09:11 oleg113-client kernel: rcu: #011RCU callback double-/use-after-free debug enabled. May 25 03:09:11 oleg113-client kernel: #011Rude variant of Tasks RCU enabled. May 25 03:09:11 oleg113-client kernel: #011Tracing variant of Tasks RCU enabled. May 25 03:09:11 oleg113-client kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. May 25 03:09:11 oleg113-client kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 May 25 03:09:11 oleg113-client kernel: NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 May 25 03:09:11 oleg113-client kernel: random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 May 25 03:09:11 oleg113-client kernel: Console: colour *CGA 80x25 May 25 03:09:11 oleg113-client kernel: printk: console [ttyS1] enabled May 25 03:09:11 oleg113-client kernel: ACPI: Core revision 20220331 May 25 03:09:11 oleg113-client kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns May 25 03:09:11 oleg113-client kernel: hpet clockevent registered May 25 03:09:11 oleg113-client kernel: APIC: Switch to symmetric I/O mode setup May 25 03:09:11 oleg113-client kernel: x2apic enabled May 25 03:09:11 oleg113-client kernel: Switched APIC routing to physical x2apic. May 25 03:09:11 oleg113-client kernel: kvm-guest: setup PV IPIs May 25 03:09:11 oleg113-client kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 May 25 03:09:11 oleg113-client kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22982479f67, max_idle_ns: 440795221274 ns May 25 03:09:11 oleg113-client kernel: Calibrating delay loop (skipped) preset value.. 4799.96 BogoMIPS (lpj=2399980) May 25 03:09:11 oleg113-client kernel: pid_max: default: 32768 minimum: 301 May 25 03:09:11 oleg113-client kernel: LSM: Security Framework initializing May 25 03:09:11 oleg113-client kernel: Yama: becoming mindful. May 25 03:09:11 oleg113-client kernel: SELinux: Initializing. May 25 03:09:11 oleg113-client kernel: *** VALIDATE selinux *** May 25 03:09:11 oleg113-client kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: *** VALIDATE tmpfs *** May 25 03:09:11 oleg113-client kernel: *** VALIDATE proc *** May 25 03:09:11 oleg113-client kernel: *** VALIDATE cgroup *** May 25 03:09:11 oleg113-client kernel: *** VALIDATE cgroup2 *** May 25 03:09:11 oleg113-client kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated May 25 03:09:11 oleg113-client kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 May 25 03:09:11 oleg113-client kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 May 25 03:09:11 oleg113-client kernel: Spectre V2 : User space: Vulnerable May 25 03:09:11 oleg113-client kernel: Speculative Store Bypass: Vulnerable May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffffffff93c59000-0xffffffff93c60fff] May 25 03:09:11 oleg113-client kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) May 25 03:09:11 oleg113-client kernel: Performance Events: IvyBridge events, full-width counters, Intel PMU driver. May 25 03:09:11 oleg113-client kernel: ... version: 2 May 25 03:09:11 oleg113-client kernel: ... bit width: 48 May 25 03:09:11 oleg113-client kernel: ... generic registers: 4 May 25 03:09:11 oleg113-client kernel: ... value mask: 0000ffffffffffff May 25 03:09:11 oleg113-client kernel: ... max period: 00007fffffffffff May 25 03:09:11 oleg113-client kernel: ... fixed-purpose events: 3 May 25 03:09:11 oleg113-client kernel: ... event mask: 000000070000000f May 25 03:09:11 oleg113-client kernel: rcu: Hierarchical SRCU implementation. May 25 03:09:11 oleg113-client kernel: smp: Bringing up secondary CPUs ... May 25 03:09:11 oleg113-client kernel: x86: Booting SMP configuration: May 25 03:09:11 oleg113-client kernel: .... node #0, CPUs: #1 #2 #3 May 25 03:09:11 oleg113-client kernel: smp: Brought up 1 node, 4 CPUs May 25 03:09:11 oleg113-client kernel: smpboot: Max logical packages: 1 May 25 03:09:11 oleg113-client kernel: smpboot: Total of 4 processors activated (19199.84 BogoMIPS) May 25 03:09:11 oleg113-client kernel: node 0 deferred pages initialised in 35ms May 25 03:09:11 oleg113-client kernel: devtmpfs: initialized May 25 03:09:11 oleg113-client kernel: x86/mm: Memory block size: 128MB May 25 03:09:11 oleg113-client kernel: gcov: version magic: 0x41383552 May 25 03:09:11 oleg113-client kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns May 25 03:09:11 oleg113-client kernel: futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: pinctrl core: initialized pinctrl subsystem May 25 03:09:11 oleg113-client kernel: May 25 03:09:11 oleg113-client kernel: ************************************************************* May 25 03:09:11 oleg113-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** May 25 03:09:11 oleg113-client kernel: ** ** May 25 03:09:11 oleg113-client kernel: ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** May 25 03:09:11 oleg113-client kernel: ** ** May 25 03:09:11 oleg113-client kernel: ** This means that this kernel is built to expose internal ** May 25 03:09:11 oleg113-client kernel: ** IOMMU data structures, which may compromise security on ** May 25 03:09:11 oleg113-client kernel: ** your system. ** May 25 03:09:11 oleg113-client kernel: ** ** May 25 03:09:11 oleg113-client kernel: ** If you see this message and you are not debugging the ** May 25 03:09:11 oleg113-client kernel: ** kernel, report this immediately to your vendor! ** May 25 03:09:11 oleg113-client kernel: ** ** May 25 03:09:11 oleg113-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** May 25 03:09:11 oleg113-client kernel: ************************************************************* May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 16 May 25 03:09:11 oleg113-client kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations May 25 03:09:11 oleg113-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations May 25 03:09:11 oleg113-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations May 25 03:09:11 oleg113-client kernel: cpuidle: using governor menu May 25 03:09:11 oleg113-client kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 May 25 03:09:11 oleg113-client kernel: PCI: Using configuration type 1 for base access May 25 03:09:11 oleg113-client kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on May 25 03:09:11 oleg113-client kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages May 25 03:09:11 oleg113-client kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages May 25 03:09:11 oleg113-client kernel: cryptd: max_cpu_qlen set to 1000 May 25 03:09:11 oleg113-client kernel: ACPI: Added _OSI(Module Device) May 25 03:09:11 oleg113-client kernel: ACPI: Added _OSI(Processor Device) May 25 03:09:11 oleg113-client kernel: ACPI: Added _OSI(3.0 _SCP Extensions) May 25 03:09:11 oleg113-client kernel: ACPI: Added _OSI(Processor Aggregator Device) May 25 03:09:11 oleg113-client kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded May 25 03:09:11 oleg113-client kernel: ACPI: Interpreter enabled May 25 03:09:11 oleg113-client kernel: ACPI: PM: (supports S0 S3 S4 S5) May 25 03:09:11 oleg113-client kernel: ACPI: Using IOAPIC for interrupt routing May 25 03:09:11 oleg113-client kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug May 25 03:09:11 oleg113-client kernel: ACPI: Enabled 2 GPEs in block 00 to 0F May 25 03:09:11 oleg113-client kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) May 25 03:09:11 oleg113-client kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] May 25 03:09:11 oleg113-client kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] May 25 03:09:11 oleg113-client kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [2] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [5] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [6] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [3] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [4] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [7] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [8] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [9] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [10] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [11] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [12] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [13] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [14] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [15] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [16] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [17] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [18] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [19] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [20] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [21] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [22] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [23] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [24] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [25] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [26] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [27] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [28] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [29] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [30] registered May 25 03:09:11 oleg113-client kernel: acpiphp: Slot [31] registered May 25 03:09:11 oleg113-client kernel: PCI host bridge to bus 0000:00 May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: root bus resource [bus 00-ff] May 25 03:09:11 oleg113-client kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB May 25 03:09:11 oleg113-client kernel: pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 May 25 03:09:11 oleg113-client kernel: pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] May 25 03:09:11 oleg113-client kernel: pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] May 25 03:09:11 oleg113-client kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] May 25 03:09:11 oleg113-client kernel: pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 May 25 03:09:11 oleg113-client kernel: pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] May 25 03:09:11 oleg113-client kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] May 25 03:09:11 oleg113-client kernel: pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] May 25 03:09:11 oleg113-client kernel: pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 May 25 03:09:11 oleg113-client kernel: pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] May 25 03:09:11 oleg113-client kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] May 25 03:09:11 oleg113-client kernel: pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] May 25 03:09:11 oleg113-client kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 May 25 03:09:11 oleg113-client kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 May 25 03:09:11 oleg113-client kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 May 25 03:09:11 oleg113-client kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 May 25 03:09:11 oleg113-client kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 May 25 03:09:11 oleg113-client kernel: iommu: Default domain type: Passthrough May 25 03:09:11 oleg113-client kernel: SCSI subsystem initialized May 25 03:09:11 oleg113-client kernel: ACPI: bus type USB registered May 25 03:09:11 oleg113-client kernel: usbcore: registered new interface driver usbfs May 25 03:09:11 oleg113-client kernel: usbcore: registered new interface driver hub May 25 03:09:11 oleg113-client kernel: usbcore: registered new device driver usb May 25 03:09:11 oleg113-client kernel: pps_core: LinuxPPS API ver. 1 registered May 25 03:09:11 oleg113-client kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti May 25 03:09:11 oleg113-client kernel: PTP clock support registered May 25 03:09:11 oleg113-client kernel: EDAC MC: Ver: 3.0.0 May 25 03:09:11 oleg113-client kernel: PCI: Using ACPI for IRQ routing May 25 03:09:11 oleg113-client kernel: PCI: pci_cache_line_size set to 64 bytes May 25 03:09:11 oleg113-client kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] May 25 03:09:11 oleg113-client kernel: e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] May 25 03:09:11 oleg113-client kernel: e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] May 25 03:09:11 oleg113-client kernel: NetLabel: Initializing May 25 03:09:11 oleg113-client kernel: NetLabel: domain hash size = 128 May 25 03:09:11 oleg113-client kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO May 25 03:09:11 oleg113-client kernel: NetLabel: unlabeled traffic allowed by default May 25 03:09:11 oleg113-client kernel: vgaarb: loaded May 25 03:09:11 oleg113-client kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 May 25 03:09:11 oleg113-client kernel: hpet0: 3 comparators, 64-bit 100.000000 MHz counter May 25 03:09:11 oleg113-client kernel: clocksource: Switched to clocksource kvm-clock May 25 03:09:11 oleg113-client kernel: VFS: Disk quotas dquot_6.6.0 May 25 03:09:11 oleg113-client kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) May 25 03:09:11 oleg113-client kernel: *** VALIDATE ramfs *** May 25 03:09:11 oleg113-client kernel: *** VALIDATE hugetlbfs *** May 25 03:09:11 oleg113-client kernel: pnp: PnP ACPI init May 25 03:09:11 oleg113-client kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) May 25 03:09:11 oleg113-client kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) May 25 03:09:11 oleg113-client kernel: pnp 00:02: [dma 2] May 25 03:09:11 oleg113-client kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) May 25 03:09:11 oleg113-client kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) May 25 03:09:11 oleg113-client kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) May 25 03:09:11 oleg113-client kernel: pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) May 25 03:09:11 oleg113-client kernel: pnp: PnP ACPI: found 6 devices May 25 03:09:11 oleg113-client kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] May 25 03:09:11 oleg113-client kernel: pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 2 May 25 03:09:11 oleg113-client kernel: IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: TCP: Hash tables configured (established 65536 bind 65536) May 25 03:09:11 oleg113-client kernel: MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 1 May 25 03:09:11 oleg113-client kernel: RPC: Registered named UNIX socket transport module. May 25 03:09:11 oleg113-client kernel: RPC: Registered udp transport module. May 25 03:09:11 oleg113-client kernel: RPC: Registered tcp transport module. May 25 03:09:11 oleg113-client kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 44 May 25 03:09:11 oleg113-client kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release May 25 03:09:11 oleg113-client kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds May 25 03:09:11 oleg113-client kernel: PCI: CLS 0 bytes, default 64 May 25 03:09:11 oleg113-client kernel: Unpacking initramfs... May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffff9b157cc64000-0xffff9b157ffcffff] May 25 03:09:11 oleg113-client kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) May 25 03:09:11 oleg113-client kernel: software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) May 25 03:09:11 oleg113-client kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22982479f67, max_idle_ns: 440795221274 ns May 25 03:09:11 oleg113-client kernel: Initialise system trusted keyrings May 25 03:09:11 oleg113-client kernel: Key type blacklist registered May 25 03:09:11 oleg113-client kernel: workingset: timestamp_bits=36 max_order=20 bucket_order=0 May 25 03:09:11 oleg113-client kernel: zbud: loaded May 25 03:09:11 oleg113-client kernel: *** VALIDATE nfs *** May 25 03:09:11 oleg113-client kernel: *** VALIDATE nfs4 *** May 25 03:09:11 oleg113-client kernel: pstore: using deflate compression May 25 03:09:11 oleg113-client kernel: Platform Keyring initialized May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 38 May 25 03:09:11 oleg113-client kernel: Key type asymmetric registered May 25 03:09:11 oleg113-client kernel: Asymmetric key parser 'x509' registered May 25 03:09:11 oleg113-client kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) May 25 03:09:11 oleg113-client kernel: io scheduler mq-deadline registered May 25 03:09:11 oleg113-client kernel: io scheduler kyber registered May 25 03:09:11 oleg113-client kernel: io scheduler bfq registered May 25 03:09:11 oleg113-client kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE May 25 03:09:11 oleg113-client kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 May 25 03:09:11 oleg113-client kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 May 25 03:09:11 oleg113-client kernel: ACPI: Power Button [PWRF] May 25 03:09:11 oleg113-client kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 May 25 03:09:11 oleg113-client kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 11 May 25 03:09:11 oleg113-client kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled May 25 03:09:11 oleg113-client kernel: 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A May 25 03:09:11 oleg113-client kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A May 25 03:09:11 oleg113-client kernel: Non-volatile memory driver v1.3 May 25 03:09:11 oleg113-client kernel: Linux agpgart interface v0.103 May 25 03:09:11 oleg113-client kernel: virtio_blk virtio1: [vda] 134776 512-byte logical blocks (69.0 MB/65.8 MiB) May 25 03:09:11 oleg113-client kernel: vda: detected capacity change from 0 to 69005312 May 25 03:09:11 oleg113-client kernel: virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) May 25 03:09:11 oleg113-client kernel: vdb: detected capacity change from 0 to 1073741824 May 25 03:09:11 oleg113-client kernel: libphy: Fixed MDIO Bus: probed May 25 03:09:11 oleg113-client kernel: usbcore: registered new interface driver usbserial_generic May 25 03:09:11 oleg113-client kernel: usbserial: USB Serial support registered for generic May 25 03:09:11 oleg113-client kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 May 25 03:09:11 oleg113-client kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 May 25 03:09:11 oleg113-client kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 May 25 03:09:11 oleg113-client kernel: mousedev: PS/2 mouse device common for all mice May 25 03:09:11 oleg113-client kernel: rtc_cmos 00:05: RTC can wake from S4 May 25 03:09:11 oleg113-client kernel: rtc_cmos 00:05: registered as rtc0 May 25 03:09:11 oleg113-client kernel: rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs May 25 03:09:11 oleg113-client kernel: intel_pstate: CPU model not supported May 25 03:09:11 oleg113-client kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 May 25 03:09:11 oleg113-client kernel: hid: raw HID events driver (C) Jiri Kosina May 25 03:09:11 oleg113-client kernel: usbcore: registered new interface driver usbhid May 25 03:09:11 oleg113-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 May 25 03:09:11 oleg113-client kernel: usbhid: USB HID core driver May 25 03:09:11 oleg113-client kernel: drop_monitor: Initializing network drop monitor service May 25 03:09:11 oleg113-client kernel: Initializing XFRM netlink socket May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 10 May 25 03:09:11 oleg113-client kernel: Segment Routing with IPv6 May 25 03:09:11 oleg113-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 May 25 03:09:11 oleg113-client kernel: NET: Registered protocol family 17 May 25 03:09:11 oleg113-client kernel: mpls_gso: MPLS GSO support May 25 03:09:11 oleg113-client kernel: start plist test May 25 03:09:11 oleg113-client kernel: end plist test May 25 03:09:11 oleg113-client kernel: RAS: Correctable Errors collector initialized. May 25 03:09:11 oleg113-client kernel: AVX version of gcm_enc/dec engaged. May 25 03:09:11 oleg113-client kernel: AES CTR mode by8 optimization enabled May 25 03:09:11 oleg113-client kernel: sched_clock: Marking stable (10974164849, 0)->(13976434271, -3002269422) May 25 03:09:11 oleg113-client kernel: registered taskstats version 1 May 25 03:09:11 oleg113-client kernel: Loading compiled-in X.509 certificates May 25 03:09:11 oleg113-client kernel: zswap: loaded using pool lzo/zbud May 25 03:09:11 oleg113-client kernel: Key type big_key registered May 25 03:09:11 oleg113-client kernel: Key type encrypted registered May 25 03:09:11 oleg113-client kernel: ima: No TPM chip found, activating TPM-bypass! May 25 03:09:11 oleg113-client kernel: ima: Allocated hash algorithm: sha1 May 25 03:09:11 oleg113-client kernel: ima: No architecture policies found May 25 03:09:11 oleg113-client kernel: evm: Initialising EVM extended attributes: May 25 03:09:11 oleg113-client kernel: evm: security.selinux May 25 03:09:11 oleg113-client kernel: evm: security.ima May 25 03:09:11 oleg113-client kernel: evm: security.capability May 25 03:09:11 oleg113-client kernel: evm: HMAC attrs: 0x1 May 25 03:09:11 oleg113-client kernel: rtc_cmos 00:05: setting system clock to 2026-05-25 07:09:07 UTC (1779692947) May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffffffff94c03000-0xffffffff94dfffff] May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffffffff93982000-0xffffffff93c58fff] May 25 03:09:11 oleg113-client kernel: Write protecting the kernel read-only data: 28672k May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffffffff92003000-0xffffffff921fffff] May 25 03:09:11 oleg113-client kernel: debug: unmapping init [mem 0xffffffff92914000-0xffffffff929fffff] May 25 03:09:11 oleg113-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) May 25 03:09:11 oleg113-client systemd[1]: Detected virtualization kvm. May 25 03:09:11 oleg113-client systemd[1]: Detected architecture x86-64. May 25 03:09:11 oleg113-client systemd[1]: Running in initial RAM disk. May 25 03:09:11 oleg113-client systemd[1]: No hostname configured. May 25 03:09:11 oleg113-client systemd[1]: Set hostname to . May 25 03:09:11 oleg113-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:09:11 oleg113-client systemd[1]: Initializing machine ID from random generator. May 25 03:09:11 oleg113-client kernel: random: ln: uninitialized urandom read (6 bytes read) May 25 03:09:11 oleg113-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:09:11 oleg113-client systemd[1]: Listening on Journal Socket (/dev/log). May 25 03:09:11 oleg113-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:09:11 oleg113-client systemd[1]: Started Dispatch Password Requests to Console Directory Watch. May 25 03:09:11 oleg113-client kernel: random: systemd: uninitialized urandom read (16 bytes read) May 25 03:09:11 oleg113-client systemd[1]: Reached target Paths. May 25 03:09:11 oleg113-client systemd-journald[237]: Journal started May 25 03:09:11 oleg113-client systemd-journald[237]: Runtime journal (/run/log/journal/db9c8bbadb454601b09fc6a8c670d730) is 8.0M, max 184.6M, 176.6M free. May 25 03:09:11 oleg113-client systemd-vconsole-setup[233]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument May 25 03:09:11 oleg113-client systemd-vconsole-setup[233]: Fonts will not be copied to remaining consoles May 25 03:09:11 oleg113-client dracut-cmdline[258]: dracut-8.10 (Green Obsidian) dracut-049-233.git20240115.el8 May 25 03:09:11 oleg113-client dracut-cmdline[258]: Using kernel command line parameters: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 May 25 03:09:13 oleg113-client systemd[1]: Started dracut cmdline hook. May 25 03:09:13 oleg113-client systemd[1]: Starting dracut pre-udev hook... May 25 03:09:13 oleg113-client kernel: device-mapper: uevent: version 1.0.3 May 25 03:09:13 oleg113-client kernel: device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com May 25 03:09:14 oleg113-client rpc.statd[387]: Version 2.3.3 starting May 25 03:09:14 oleg113-client rpc.statd[387]: Initializing NSM state May 25 03:09:14 oleg113-client rpc.idmapd[392]: Setting log level to 0 May 25 03:09:15 oleg113-client systemd[1]: Started dracut pre-udev hook. May 25 03:09:15 oleg113-client systemd[1]: Starting udev Kernel Device Manager... May 25 03:09:15 oleg113-client systemd[1]: Started udev Kernel Device Manager. May 25 03:09:15 oleg113-client systemd[1]: Starting dracut pre-trigger hook... May 25 03:09:16 oleg113-client systemd[1]: Started dracut pre-trigger hook. May 25 03:09:16 oleg113-client systemd[1]: Starting udev Coldplug all Devices... May 25 03:09:17 oleg113-client systemd[1]: Mounting Kernel Configuration File System... May 25 03:09:17 oleg113-client systemd[1]: Mounted Kernel Configuration File System. May 25 03:09:18 oleg113-client systemd[1]: Started udev Coldplug all Devices. May 25 03:09:18 oleg113-client systemd[1]: Starting dracut initqueue hook... May 25 03:09:18 oleg113-client systemd[1]: Reached target System Initialization. May 25 03:09:18 oleg113-client systemd[1]: Reached target Basic System. May 25 03:09:18 oleg113-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. May 25 03:09:19 oleg113-client kernel: libata version 3.00 loaded. May 25 03:09:19 oleg113-client rngd[455]: Disabling 7: PKCS11 Entropy generator (pkcs11) May 25 03:09:19 oleg113-client rngd[455]: Disabling 5: NIST Network Entropy Beacon (nist) May 25 03:09:19 oleg113-client rngd[455]: Disabling 9: Qrypt quantum entropy beacon (qrypt) May 25 03:09:19 oleg113-client rngd[455]: Initializing available sources May 25 03:09:19 oleg113-client rngd[455]: [hwrng ]: Initialization Failed May 25 03:09:19 oleg113-client rngd[455]: [rdrand]: Enabling RDRAND rng support May 25 03:09:19 oleg113-client rngd[455]: [rdrand]: Initialized May 25 03:09:19 oleg113-client rngd[455]: [jitter]: JITTER timeout set to 5 sec May 25 03:09:19 oleg113-client kernel: random: fast init done May 25 03:09:19 oleg113-client kernel: ata_piix 0000:00:01.1: version 2.13 May 25 03:09:19 oleg113-client kernel: scsi host0: ata_piix May 25 03:09:19 oleg113-client kernel: virtio_net virtio0 ens2: renamed from eth0 May 25 03:09:19 oleg113-client kernel: scsi host1: ata_piix May 25 03:09:19 oleg113-client kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 May 25 03:09:19 oleg113-client kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 May 25 03:09:19 oleg113-client systemd-udevd[446]: Using default interface naming scheme 'rhel-8.0'. May 25 03:09:19 oleg113-client systemd-udevd[446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:20 oleg113-client systemd-udevd[457]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:21 oleg113-client rngd[455]: [jitter]: Initializing AES buffer May 25 03:09:26 oleg113-client rngd[455]: [jitter]: Unable to obtain AES key, disabling JITTER source May 25 03:09:26 oleg113-client rngd[455]: [jitter]: Initialization Failed May 25 03:09:26 oleg113-client kernel: random: crng init done May 25 03:09:26 oleg113-client kernel: random: 5 urandom warning(s) missed due to ratelimiting May 25 03:09:26 oleg113-client dracut-initqueue[506]: Starting dhcp for interface ens2 May 25 03:09:26 oleg113-client dracut-initqueue[539]: dhcp: PREINIT ens2 up May 25 03:09:27 oleg113-client dhclient[538]: Created duid "\000\004\333\234\213\272\333EF\001\260\237\306\250\306p\3270". May 25 03:09:27 oleg113-client dhclient[538]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 8 (xid=0x3ca83a6d) May 25 03:09:27 oleg113-client dhclient[538]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0x3ca83a6d) May 25 03:09:27 oleg113-client dhclient[538]: DHCPOFFER from 192.168.201.254 May 25 03:09:27 oleg113-client dhclient[538]: DHCPACK from 192.168.201.254 (xid=0x3ca83a6d) May 25 03:09:27 oleg113-client dracut-initqueue[557]: dhcp: BOND setting ens2 May 25 03:09:29 oleg113-client dhclient[538]: bound to 192.168.201.13 -- renewal in 22653 seconds. May 25 03:09:29 oleg113-client dracut-initqueue[585]: RTNETLINK answers: File exists May 25 03:09:31 oleg113-client systemd[1]: Reloading. May 25 03:09:31 oleg113-client systemd[619]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. May 25 03:09:31 oleg113-client systemd[1]: Starting nbd nbd0... May 25 03:09:31 oleg113-client nbd-client[653]: Negotiation: ..size = 30720MB May 25 03:09:31 oleg113-client nbd-client[653]: Connected /dev/nbd0 May 25 03:09:31 oleg113-client systemd[1]: nbd0.service: Succeeded. May 25 03:09:31 oleg113-client systemd[1]: Started nbd nbd0. May 25 03:09:32 oleg113-client systemd[1]: Started dracut initqueue hook. May 25 03:09:32 oleg113-client systemd[1]: Reached target Remote File Systems (Pre). May 25 03:09:32 oleg113-client systemd[1]: Reached target Remote File Systems. May 25 03:09:32 oleg113-client systemd[1]: Mounting /sysroot... May 25 03:09:32 oleg113-client kernel: EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) May 25 03:09:32 oleg113-client systemd[1]: Mounted /sysroot. May 25 03:09:32 oleg113-client systemd[1]: Reached target Initrd Root File System. May 25 03:09:32 oleg113-client systemd[1]: Starting Reload Configuration from the Real Root... May 25 03:09:32 oleg113-client systemd[1]: Reloading. May 25 03:09:33 oleg113-client systemd[679]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. May 25 03:09:33 oleg113-client systemd[1]: initrd-parse-etc.service: Succeeded. May 25 03:09:33 oleg113-client systemd[1]: Started Reload Configuration from the Real Root. May 25 03:09:33 oleg113-client systemd[1]: Reached target Initrd File Systems. May 25 03:09:33 oleg113-client systemd[1]: Reached target Initrd Default Target. May 25 03:09:33 oleg113-client systemd[1]: Starting dracut pre-pivot and cleanup hook... May 25 03:09:35 oleg113-client systemd[1]: var-lib-nfs-rpc_pipefs.mount: Succeeded. May 25 03:09:35 oleg113-client systemd[1]: Started dracut pre-pivot and cleanup hook. May 25 03:09:35 oleg113-client systemd[1]: Starting Cleaning Up and Shutting Down Daemons... May 25 03:09:35 oleg113-client systemd[1]: dracut-pre-pivot.service: Succeeded. May 25 03:09:35 oleg113-client systemd[1]: Stopped dracut pre-pivot and cleanup hook. May 25 03:09:35 oleg113-client systemd[1]: Stopped target Initrd Default Target. May 25 03:09:35 oleg113-client rngd[455]: [rdrand]: Shutting down May 25 03:09:35 oleg113-client systemd[1]: Stopping Hardware RNG Entropy Gatherer Daemon... May 25 03:09:35 oleg113-client systemd[1]: Stopped target Timers. May 25 03:09:35 oleg113-client systemd[1]: Stopped target Initrd Root Device. May 25 03:09:35 oleg113-client systemd[1]: Stopped target Remote File Systems. May 25 03:09:35 oleg113-client systemd[1]: Stopped target Remote File Systems (Pre). May 25 03:09:35 oleg113-client systemd[1]: dracut-initqueue.service: Succeeded. May 25 03:09:35 oleg113-client systemd[1]: Stopped dracut initqueue hook. May 25 03:09:35 oleg113-client systemd[1]: rngd.service: Succeeded. May 25 03:09:35 oleg113-client systemd[1]: Stopped Hardware RNG Entropy Gatherer Daemon. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Basic System. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Paths. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Sockets. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Slices. May 25 03:09:36 oleg113-client systemd[1]: Stopped target System Initialization. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Swap. May 25 03:09:36 oleg113-client systemd[1]: systemd-tmpfiles-setup.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped Create Volatile Files and Directories. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Local Encrypted Volumes. May 25 03:09:36 oleg113-client systemd[1]: systemd-ask-password-console.path: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. May 25 03:09:36 oleg113-client systemd[1]: Stopped target Local File Systems. May 25 03:09:36 oleg113-client systemd[1]: systemd-udev-trigger.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped udev Coldplug all Devices. May 25 03:09:36 oleg113-client systemd[1]: dracut-pre-trigger.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped dracut pre-trigger hook. May 25 03:09:36 oleg113-client systemd[1]: Stopping udev Kernel Device Manager... May 25 03:09:36 oleg113-client systemd[1]: systemd-sysctl.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped Apply Kernel Variables. May 25 03:09:36 oleg113-client systemd[1]: systemd-udevd.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped udev Kernel Device Manager. May 25 03:09:36 oleg113-client systemd[1]: dracut-pre-udev.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped dracut pre-udev hook. May 25 03:09:36 oleg113-client systemd[1]: dracut-cmdline.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped dracut cmdline hook. May 25 03:09:36 oleg113-client systemd[1]: systemd-tmpfiles-setup-dev.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped Create Static Device Nodes in /dev. May 25 03:09:36 oleg113-client systemd[1]: kmod-static-nodes.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Stopped Create list of required static device nodes for the current kernel. May 25 03:09:36 oleg113-client systemd[1]: systemd-udevd-control.socket: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Closed udev Control Socket. May 25 03:09:36 oleg113-client systemd[1]: systemd-udevd-kernel.socket: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Closed udev Kernel Socket. May 25 03:09:36 oleg113-client systemd[1]: Starting Cleanup udevd DB... May 25 03:09:36 oleg113-client systemd[1]: initrd-cleanup.service: Succeeded. May 25 03:09:36 oleg113-client systemd[1]: Started Cleaning Up and Shutting Down Daemons. May 25 03:09:37 oleg113-client systemd[1]: initrd-udevadm-cleanup-db.service: Succeeded. May 25 03:09:37 oleg113-client systemd[1]: Started Cleanup udevd DB. May 25 03:09:37 oleg113-client systemd[1]: Reached target Switch Root. May 25 03:09:37 oleg113-client systemd[1]: Starting Switch Root... May 25 03:09:37 oleg113-client systemd[1]: Switching root. May 25 03:09:37 oleg113-client systemd-journald[237]: Journal stopped May 25 03:09:44 oleg113-client kernel: printk: systemd: 26 output lines suppressed due to ratelimiting May 25 03:09:44 oleg113-client kernel: SELinux: Disabled at runtime. May 25 03:09:44 oleg113-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) May 25 03:09:44 oleg113-client systemd[1]: Detected virtualization kvm. May 25 03:09:44 oleg113-client systemd[1]: Detected architecture x86-64. May 25 03:09:44 oleg113-client systemd[1]: initrd-switch-root.service: Succeeded. May 25 03:09:44 oleg113-client systemd[1]: Stopped Switch Root. May 25 03:09:44 oleg113-client systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. May 25 03:09:44 oleg113-client systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. May 25 03:09:44 oleg113-client systemd[1]: Stopped Journal Service. May 25 03:09:44 oleg113-client systemd[1]: Starting Journal Service... May 25 03:09:44 oleg113-client systemd[1]: Mounting POSIX Message Queue File System... May 25 03:09:44 oleg113-client kernel: Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS May 25 03:09:44 oleg113-client systemd-journald[792]: Journal started May 25 03:09:44 oleg113-client systemd-journald[792]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. May 25 03:09:44 oleg113-client systemd[1]: systemd-journald.service: Succeeded. May 25 03:09:45 oleg113-client systemd[1]: Mounted POSIX Message Queue File System. May 25 03:09:45 oleg113-client systemd[1]: Activated swap /dev/disk/by-label/SWAP. May 25 03:09:45 oleg113-client systemd[1]: Started Create list of required static device nodes for the current kernel. May 25 03:09:45 oleg113-client systemd[1]: Mounted Kernel Debug File System. May 25 03:09:45 oleg113-client systemd-remount-fs[809]: mount.nfs: access denied by server while mounting 192.168.10.1:/exports/rhel8.5-nfsroot May 25 03:09:45 oleg113-client systemd[1]: Mounted Huge Pages File System. May 25 03:09:45 oleg113-client systemd-remount-fs[805]: /usr/bin/mount for / exited with exit status 32. May 25 03:09:45 oleg113-client systemd[1]: Started Apply Kernel Variables. May 25 03:09:45 oleg113-client systemd[1]: systemd-remount-fs.service: Main process exited, code=exited, status=1/FAILURE May 25 03:09:45 oleg113-client systemd[1]: systemd-remount-fs.service: Failed with result 'exit-code'. May 25 03:09:45 oleg113-client systemd[1]: Failed to start Remount Root and Kernel File Systems. May 25 03:09:45 oleg113-client systemd[1]: Starting Configure read-only root support... May 25 03:09:45 oleg113-client systemd[1]: Starting Create Static Device Nodes in /dev... May 25 03:09:45 oleg113-client systemd[1]: Reached target Swap. May 25 03:09:45 oleg113-client systemd[1]: Starting Flush Journal to Persistent Storage... May 25 03:09:45 oleg113-client systemd-journald[792]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. May 25 03:09:45 oleg113-client systemd[1]: Started Flush Journal to Persistent Storage. May 25 03:09:45 oleg113-client systemd[1]: Started Create Static Device Nodes in /dev. May 25 03:09:46 oleg113-client systemd[1]: Reached target Local File Systems (Pre). May 25 03:09:46 oleg113-client systemd[1]: Mounting /home/green/git/lustre-release... May 25 03:09:46 oleg113-client systemd[1]: Mounting /mnt... May 25 03:09:46 oleg113-client systemd[1]: Starting udev Kernel Device Manager... May 25 03:09:46 oleg113-client systemd[1]: Started udev Coldplug all Devices. May 25 03:09:46 oleg113-client systemd[1]: Mounted /mnt. May 25 03:09:46 oleg113-client kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher May 25 03:09:46 oleg113-client systemd[1]: Mounted /home/green/git/lustre-release. May 25 03:09:48 oleg113-client systemd[1]: Started udev Kernel Device Manager. May 25 03:09:49 oleg113-client kernel: input: PC Speaker as /devices/platform/pcspkr/input/input5 May 25 03:09:49 oleg113-client kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 May 25 03:09:50 oleg113-client systemd-udevd[875]: Using default interface naming scheme 'rhel-8.0'. May 25 03:09:50 oleg113-client systemd-udevd[875]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:50 oleg113-client kernel: RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer May 25 03:09:50 oleg113-client kernel: EDAC sbridge: Seeking for: PCI ID 8086:0ea0 May 25 03:09:50 oleg113-client kernel: EDAC sbridge: Ver: 1.1.2 May 25 03:09:51 oleg113-client systemd-udevd[879]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. May 25 03:09:55 oleg113-client kernel: Key type dns_resolver registered May 25 03:09:56 oleg113-client kernel: NFS: Registering the id_resolver key type May 25 03:09:56 oleg113-client kernel: Key type id_resolver registered May 25 03:09:56 oleg113-client kernel: Key type id_legacy registered May 25 03:09:56 oleg113-client nfsrahead[990]: setting /var/lib/stateless/state readahead to 128 May 25 03:09:56 oleg113-client systemd[1]: Started Configure read-only root support. May 25 03:09:56 oleg113-client systemd[1]: Reached target Local File Systems. May 25 03:09:56 oleg113-client systemd[1]: Starting Rebuild Dynamic Linker Cache... May 25 03:09:56 oleg113-client systemd[1]: Starting Mark the need to relabel after reboot... May 25 03:09:56 oleg113-client systemd[1]: Starting Load/Save Random Seed... May 25 03:09:56 oleg113-client touch[1002]: /bin/touch: cannot touch '/.autorelabel': Read-only file system May 25 03:09:56 oleg113-client systemd[1]: Starting Create Volatile Files and Directories... May 25 03:09:56 oleg113-client systemd[1]: Started Mark the need to relabel after reboot. May 25 03:09:56 oleg113-client systemd[1]: Started Load/Save Random Seed. May 25 03:09:57 oleg113-client systemd-tmpfiles[1005]: rm(/var/lib/rpm/__db.003): Read-only file system May 25 03:09:57 oleg113-client systemd-tmpfiles[1005]: rm(/var/lib/rpm/__db.002): Read-only file system May 25 03:09:57 oleg113-client systemd-tmpfiles[1005]: rm(/var/lib/rpm/__db.001): Read-only file system May 25 03:09:57 oleg113-client systemd[1]: Started Create Volatile Files and Directories. May 25 03:09:57 oleg113-client systemd[1]: Starting RPC Bind... May 25 03:09:57 oleg113-client systemd[1]: Starting Update UTMP about System Boot/Shutdown... May 25 03:09:57 oleg113-client systemd[1]: Started Update UTMP about System Boot/Shutdown. May 25 03:09:57 oleg113-client systemd[1]: Started RPC Bind. May 25 03:09:59 oleg113-client systemd[1]: Started Rebuild Dynamic Linker Cache. May 25 03:09:59 oleg113-client systemd[1]: Starting Update is Completed... May 25 03:09:59 oleg113-client systemd[1]: Started Update is Completed. May 25 03:09:59 oleg113-client systemd[1]: Reached target System Initialization. May 25 03:09:59 oleg113-client systemd[1]: Started Daily Cleanup of Temporary Directories. May 25 03:09:59 oleg113-client systemd[1]: Started dnf makecache --timer. May 25 03:09:59 oleg113-client systemd[1]: Started daily update of the root trust anchor for DNSSEC. May 25 03:09:59 oleg113-client systemd[1]: Reached target Timers. May 25 03:09:59 oleg113-client systemd[1]: Listening on D-Bus System Message Bus Socket. May 25 03:09:59 oleg113-client systemd[1]: Reached target Sockets. May 25 03:09:59 oleg113-client systemd[1]: Reached target Basic System. May 25 03:10:00 oleg113-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. May 25 03:10:00 oleg113-client systemd[1]: Started irqbalance daemon. May 25 03:10:00 oleg113-client systemd[1]: Started D-Bus System Message Bus. May 25 03:10:00 oleg113-client systemd[1]: Starting Network Manager... May 25 03:10:00 oleg113-client systemd[1]: Starting Restore /run/initramfs on shutdown... May 25 03:10:00 oleg113-client rngd[1015]: Disabling 7: PKCS11 Entropy generator (pkcs11) May 25 03:10:00 oleg113-client rngd[1015]: Disabling 5: NIST Network Entropy Beacon (nist) May 25 03:10:00 oleg113-client rngd[1015]: Disabling 9: Qrypt quantum entropy beacon (qrypt) May 25 03:10:00 oleg113-client rngd[1015]: Initializing available sources May 25 03:10:00 oleg113-client rngd[1015]: [hwrng ]: Initialization Failed May 25 03:10:00 oleg113-client rngd[1015]: [rdrand]: Enabling RDRAND rng support May 25 03:10:00 oleg113-client rngd[1015]: [rdrand]: Initialized May 25 03:10:00 oleg113-client rngd[1015]: [jitter]: JITTER timeout set to 5 sec May 25 03:10:00 oleg113-client systemd[1]: Starting Login Service... May 25 03:10:00 oleg113-client systemd[1]: Reached target sshd-keygen.target. May 25 03:10:00 oleg113-client systemd[1]: Started Restore /run/initramfs on shutdown. May 25 03:10:00 oleg113-client NetworkManager[1018]: [1779693000.6695] NetworkManager (version 1.40.16-19.el8_10) is starting... (boot:e59efd12-16e4-454c-a18c-2129a455decf) May 25 03:10:00 oleg113-client NetworkManager[1018]: [1779693000.6945] Read config: /etc/NetworkManager/NetworkManager.conf (run: 10-dracut-dhclient.conf) May 25 03:10:00 oleg113-client rngd[1015]: [jitter]: Initializing AES buffer May 25 03:10:00 oleg113-client systemd[1]: Started Network Manager. May 25 03:10:00 oleg113-client systemd[1]: Reached target Network. May 25 03:10:00 oleg113-client systemd[1]: Starting Dynamic System Tuning Daemon... May 25 03:10:00 oleg113-client NetworkManager[1018]: [1779693000.7389] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" May 25 03:10:00 oleg113-client systemd[1]: Starting GSSAPI Proxy Daemon... May 25 03:10:00 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:10:00 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:10:00 oleg113-client systemd-logind[1020]: New seat seat0. May 25 03:10:00 oleg113-client NetworkManager[1018]: [1779693000.8676] manager[0x560bb7032020]: monitoring kernel firmware directory '/lib/firmware'. May 25 03:10:00 oleg113-client dbus-daemon[1017]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.1' (uid=0 pid=1018 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:10:00 oleg113-client systemd[1]: Starting OpenSSH server daemon... May 25 03:10:00 oleg113-client systemd[1]: Starting Network Manager Wait Online... May 25 03:10:00 oleg113-client systemd[1]: Started Login Service. May 25 03:10:01 oleg113-client systemd[1]: Started GSSAPI Proxy Daemon. May 25 03:10:01 oleg113-client systemd[1]: Reached target NFS client services. May 25 03:10:01 oleg113-client systemd[1]: Reached target Remote File Systems (Pre). May 25 03:10:01 oleg113-client systemd[1]: Reached target Remote File Systems. May 25 03:10:01 oleg113-client systemd[1]: Starting Permit User Sessions... May 25 03:10:01 oleg113-client systemd[1]: Starting Hostname Service... May 25 03:10:01 oleg113-client systemd[1]: Started Permit User Sessions. May 25 03:10:01 oleg113-client sshd[1040]: Server listening on 0.0.0.0 port 22. May 25 03:10:01 oleg113-client sshd[1040]: Server listening on :: port 22. May 25 03:10:01 oleg113-client systemd[1]: Started OpenSSH server daemon. May 25 03:10:01 oleg113-client systemd[1]: Started Serial Getty on ttyS1. May 25 03:10:01 oleg113-client systemd[1]: Started Getty on tty1. May 25 03:10:01 oleg113-client systemd[1]: Started Serial Getty on ttyS0. May 25 03:10:01 oleg113-client systemd[1]: Reached target Login Prompts. May 25 03:10:01 oleg113-client systemd[1]: Started Command Scheduler. May 25 03:10:01 oleg113-client crond[1059]: (CRON) STARTUP (1.5.2) May 25 03:10:01 oleg113-client crond[1059]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 42% if used.) May 25 03:10:01 oleg113-client crond[1059]: (CRON) INFO (running with inotify support) May 25 03:10:03 oleg113-client dbus-daemon[1017]: [system] Successfully activated service 'org.freedesktop.hostname1' May 25 03:10:03 oleg113-client systemd[1]: Started Hostname Service. May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.0373] hostname: hostname: using hostnamed May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.0383] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2084] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-device-plugin-team.so) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2085] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2086] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2099] manager: Networking is enabled by state file May 25 03:10:03 oleg113-client dbus-daemon[1017]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.1' (uid=0 pid=1018 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2771] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-settings-plugin-ifcfg-rh.so") May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.2781] settings: Loaded settings plugin: keyfile (internal) May 25 03:10:03 oleg113-client systemd[1]: Starting Network Manager Script Dispatcher Service... May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.4731] dhcp: init: Using DHCP client 'dhclient' May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.4754] device (lo): carrier: link connected May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.4774] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.4876] device (ens2): carrier: link connected May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5023] manager: (ens2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5114] manager: (ens2): assume: will attempt to assume matching connection 'ens2' (5c53f467-34c5-4a34-b8e4-054efbe480b9) (guessed) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5129] manager: (ens2): assume: taking over an initramfs-configured connection May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5144] device (ens2): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'assume') May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5327] device (ens2): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'assume') May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.5449] device (ens2): Activation: starting connection 'ens2' (5c53f467-34c5-4a34-b8e4-054efbe480b9) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.6177] device (ens2): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'assume') May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.6267] device (ens2): state change: prepare -> config (reason 'none', sys-iface-state: 'assume') May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.6343] device (ens2): state change: config -> ip-config (reason 'none', sys-iface-state: 'assume') May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.6486] dhcp4 (ens2): activation: beginning transaction (timeout in 45 seconds) May 25 03:10:03 oleg113-client NetworkManager[1018]: [1779693003.8324] dhcp4 (ens2): dhclient started with pid 1063 May 25 03:10:03 oleg113-client dbus-daemon[1017]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.1' (uid=0 pid=1018 comm="/usr/sbin/NetworkManager --no-daemon ") May 25 03:10:03 oleg113-client dbus-daemon[1017]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. May 25 03:10:03 oleg113-client dbus-daemon[1017]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' May 25 03:10:03 oleg113-client systemd[1]: Started Network Manager Script Dispatcher Service. May 25 03:10:04 oleg113-client dhclient[1063]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0xe48ed521) May 25 03:10:04 oleg113-client dhclient[1063]: DHCPACK from 192.168.201.254 (xid=0xe48ed521) May 25 03:10:05 oleg113-client rngd[1015]: [jitter]: Unable to obtain AES key, disabling JITTER source May 25 03:10:05 oleg113-client rngd[1015]: [jitter]: Initialization Failed May 25 03:10:05 oleg113-client rngd[1015]: Process privileges have been dropped to 2:2 May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1146] dhcp4 (ens2): address 192.168.201.13 May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1147] dhcp4 (ens2): plen 24 (255.255.255.0) May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1147] dhcp4 (ens2): gateway 192.168.201.254 May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1147] dhcp4 (ens2): lease time 60000 May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1148] dhcp4 (ens2): hostname 'oleg113-client.virtnet' May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1148] dhcp4 (ens2): nameserver '192.168.200.253' May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1148] dhcp4 (ens2): domain name 'virtnet' May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1148] dhcp4 (ens2): state changed new lease, address=192.168.201.13 May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1240] policy: set 'ens2' (ens2) as default for IPv4 routing and DNS May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1260] device (ens2): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'assume') May 25 03:10:05 oleg113-client dhclient[1063]: bound to 192.168.201.13 -- renewal in 25620 seconds. May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1978] device (ens2): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'assume') May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.1985] device (ens2): state change: secondaries -> activated (reason 'none', sys-iface-state: 'assume') May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.2018] manager: NetworkManager state is now CONNECTED_SITE May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.2187] device (ens2): Activation: successful, device activated. May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.2198] manager: NetworkManager state is now CONNECTED_GLOBAL May 25 03:10:05 oleg113-client NetworkManager[1018]: [1779693005.2296] manager: startup complete May 25 03:10:05 oleg113-client systemd[1]: Started Network Manager Wait Online. May 25 03:10:05 oleg113-client systemd[1]: Reached target Network is Online. May 25 03:10:05 oleg113-client systemd[1]: Starting Crash recovery kernel arming... May 25 03:10:05 oleg113-client systemd[1]: Starting Notify NFS peers of a restart... May 25 03:10:05 oleg113-client systemd[1]: Starting System Logging Service... May 25 03:10:05 oleg113-client sm-notify[1081]: Version 2.3.3 starting May 25 03:10:05 oleg113-client systemd[1]: Started Notify NFS peers of a restart. May 25 03:10:06 oleg113-client rsyslogd[1082]: [origin software="rsyslogd" swVersion="8.2102.0-15.el8_10.1" x-pid="1082" x-info="https://www.rsyslog.com"] start May 25 03:10:06 oleg113-client systemd[1]: Started System Logging Service. May 25 03:10:07 oleg113-client rsyslogd[1082]: imjournal: No statefile exists, /var/lib/rsyslog/imjournal.state will be created (ignore if this is first run): No such file or directory [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/2040 ] May 25 03:10:07 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:10:07 oleg113-client kdumpctl[1174]: basename: missing operand May 25 03:10:07 oleg113-client kdumpctl[1174]: Try 'basename --help' for more information. May 25 03:10:09 oleg113-client sshd[1249]: Accepted publickey for root from 192.168.200.253 port 41390 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I May 25 03:10:10 oleg113-client systemd[1]: Created slice User Slice of UID 0. May 25 03:10:10 oleg113-client systemd-logind[1020]: New session 1 of user root. May 25 03:10:10 oleg113-client systemd[1]: Starting User runtime directory /run/user/0... May 25 03:10:10 oleg113-client systemd[1]: Started User runtime directory /run/user/0. May 25 03:10:10 oleg113-client systemd[1]: Starting User Manager for UID 0... May 25 03:10:10 oleg113-client systemd[1372]: pam_unix(systemd-user:session): session opened for user root by (uid=0) May 25 03:10:11 oleg113-client dbus-daemon[1017]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.9' (uid=0 pid=1030 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") May 25 03:10:11 oleg113-client systemd[1]: Starting Authorization Manager... May 25 03:10:11 oleg113-client polkitd[1380]: Started polkitd version 0.115 May 25 03:10:11 oleg113-client systemd[1372]: Reached target Paths. May 25 03:10:12 oleg113-client systemd[1372]: Reached target Timers. May 25 03:10:12 oleg113-client systemd[1372]: Starting D-Bus User Message Bus Socket. May 25 03:10:12 oleg113-client systemd[1372]: Listening on D-Bus User Message Bus Socket. May 25 03:10:12 oleg113-client systemd[1372]: Reached target Sockets. May 25 03:10:12 oleg113-client systemd[1372]: Reached target Basic System. May 25 03:10:12 oleg113-client systemd[1]: Started User Manager for UID 0. May 25 03:10:12 oleg113-client systemd[1]: Started Session 1 of user root. May 25 03:10:12 oleg113-client systemd[1372]: Reached target Default. May 25 03:10:12 oleg113-client systemd[1372]: Startup finished in 1.494s. May 25 03:10:12 oleg113-client sshd[1249]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:10:12 oleg113-client systemd[1]: Started Dynamic System Tuning Daemon. May 25 03:10:12 oleg113-client systemd[1]: Reached target Multi-User System. May 25 03:10:12 oleg113-client systemd[1]: Reached target Graphical Interface. May 25 03:10:12 oleg113-client systemd[1]: Starting Update UTMP about System Runlevel Changes... May 25 03:10:12 oleg113-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. May 25 03:10:12 oleg113-client systemd[1]: Started Update UTMP about System Runlevel Changes. May 25 03:10:13 oleg113-client polkitd[1380]: Loading rules from directory /etc/polkit-1/rules.d May 25 03:10:13 oleg113-client polkitd[1380]: Loading rules from directory /usr/share/polkit-1/rules.d May 25 03:10:13 oleg113-client polkitd[1380]: Finished loading, compiling and executing 2 rules May 25 03:10:13 oleg113-client dbus-daemon[1017]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' May 25 03:10:13 oleg113-client systemd[1]: Started Authorization Manager. May 25 03:10:13 oleg113-client polkitd[1380]: Acquired the name org.freedesktop.PolicyKit1 on the system bus May 25 03:10:15 oleg113-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. May 25 03:10:33 oleg113-client systemd[1]: systemd-hostnamed.service: Succeeded. May 25 03:10:38 oleg113-client kdumpctl[1085]: kdump: kexec: loaded kdump kernel May 25 03:10:38 oleg113-client kdumpctl[1085]: kdump: Starting kdump: [OK] May 25 03:10:38 oleg113-client systemd[1]: Started Crash recovery kernel arming. May 25 03:10:38 oleg113-client systemd[1]: Startup finished in 11.622s (kernel) + 32.005s (initrd) + 58.563s (userspace) = 1min 42.191s. May 25 03:10:38 oleg113-client sshd[1405]: Received disconnect from 192.168.200.253 port 41390:11: disconnected by user May 25 03:10:39 oleg113-client sshd[1405]: Disconnected from user root 192.168.200.253 port 41390 May 25 03:10:39 oleg113-client sshd[1249]: pam_unix(sshd:session): session closed for user root May 25 03:10:39 oleg113-client systemd-logind[1020]: Session 1 logged out. Waiting for processes to exit. May 25 03:10:39 oleg113-client systemd[1]: session-1.scope: Succeeded. May 25 03:10:39 oleg113-client systemd-logind[1020]: Removed session 1. May 25 03:10:39 oleg113-client sshd[1526]: Accepted publickey for root from 192.168.200.253 port 47094 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I May 25 03:10:40 oleg113-client systemd-logind[1020]: New session 3 of user root. May 25 03:10:40 oleg113-client systemd[1]: Started Session 3 of user root. May 25 03:10:40 oleg113-client sshd[1526]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:10:41 oleg113-client kernel: hrtimer: interrupt took 3380116 ns May 25 03:11:48 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:11:48 oleg113-client systemd-udevd[2310]: Using default interface naming scheme 'rhel-8.0'. May 25 03:11:48 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:11:48 oleg113-client kernel: libcfs: loading out-of-tree module taints kernel. May 25 03:11:48 oleg113-client kernel: Key type ._llcrypt registered May 25 03:11:48 oleg113-client kernel: Key type .llcrypt registered May 25 03:11:49 oleg113-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 May 25 03:11:49 oleg113-client kernel: alg: No test for adler32 (adler32-zlib) May 25 03:11:51 oleg113-client kernel: Lustre: Lustre: Build Version: 2.17.53_24_gacb3840 May 25 03:11:52 oleg113-client kernel: LNet: Added LNI 192.168.201.13@tcp [8/256/0/180] May 25 03:11:54 oleg113-client kernel: Key type lgssc registered May 25 03:11:56 oleg113-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 25 03:13:26 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 03:13:26 oleg113-client systemd-udevd[4498]: Using default interface naming scheme 'rhel-8.0'. May 25 03:13:26 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 03:15:35 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:15:38 oleg113-client sshd[6262]: Accepted publickey for root from 192.168.201.13 port 43944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:15:38 oleg113-client systemd-logind[1020]: New session 4 of user root. May 25 03:15:38 oleg113-client systemd[1]: Started Session 4 of user root. May 25 03:15:38 oleg113-client sshd[6262]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:15:39 oleg113-client sshd[6275]: Received disconnect from 192.168.201.13 port 43944:11: disconnected by user May 25 03:15:39 oleg113-client sshd[6275]: Disconnected from user root 192.168.201.13 port 43944 May 25 03:15:39 oleg113-client sshd[6262]: pam_unix(sshd:session): session closed for user root May 25 03:15:39 oleg113-client systemd-logind[1020]: Session 4 logged out. Waiting for processes to exit. May 25 03:15:39 oleg113-client systemd[1]: session-4.scope: Succeeded. May 25 03:15:39 oleg113-client systemd-logind[1020]: Removed session 4. May 25 03:15:42 oleg113-client sshd[6440]: Accepted publickey for root from 192.168.201.13 port 55406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:15:42 oleg113-client systemd-logind[1020]: New session 5 of user root. May 25 03:15:42 oleg113-client systemd[1]: Started Session 5 of user root. May 25 03:15:42 oleg113-client sshd[6440]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:15:43 oleg113-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 25 03:15:43 oleg113-client sshd[6453]: Received disconnect from 192.168.201.13 port 55406:11: disconnected by user May 25 03:15:43 oleg113-client sshd[6453]: Disconnected from user root 192.168.201.13 port 55406 May 25 03:15:43 oleg113-client sshd[6440]: pam_unix(sshd:session): session closed for user root May 25 03:15:43 oleg113-client systemd[1]: session-5.scope: Succeeded. May 25 03:15:43 oleg113-client systemd-logind[1020]: Session 5 logged out. Waiting for processes to exit. May 25 03:15:43 oleg113-client systemd-logind[1020]: Removed session 5. May 25 03:15:44 oleg113-client sshd[6575]: Accepted publickey for root from 192.168.201.13 port 55410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:15:44 oleg113-client systemd-logind[1020]: New session 6 of user root. May 25 03:15:44 oleg113-client systemd[1]: Started Session 6 of user root. May 25 03:15:44 oleg113-client sshd[6575]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:15:45 oleg113-client sshd[6588]: Received disconnect from 192.168.201.13 port 55410:11: disconnected by user May 25 03:15:45 oleg113-client sshd[6588]: Disconnected from user root 192.168.201.13 port 55410 May 25 03:15:45 oleg113-client sshd[6575]: pam_unix(sshd:session): session closed for user root May 25 03:15:45 oleg113-client systemd-logind[1020]: Session 6 logged out. Waiting for processes to exit. May 25 03:15:45 oleg113-client systemd[1]: session-6.scope: Succeeded. May 25 03:15:45 oleg113-client systemd-logind[1020]: Removed session 6. May 25 03:15:51 oleg113-client systemd-udevd[6724]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:15:55 oleg113-client sshd[6859]: Accepted publickey for root from 192.168.201.13 port 36860 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:15:55 oleg113-client systemd[1]: Started Session 7 of user root. May 25 03:15:55 oleg113-client systemd-logind[1020]: New session 7 of user root. May 25 03:15:55 oleg113-client sshd[6859]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:15:59 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing check_logdir /tmp/testlogs/ May 25 03:15:59 oleg113-client sshd[6873]: Received disconnect from 192.168.201.13 port 36860:11: disconnected by user May 25 03:15:59 oleg113-client sshd[6873]: Disconnected from user root 192.168.201.13 port 36860 May 25 03:15:59 oleg113-client sshd[6859]: pam_unix(sshd:session): session closed for user root May 25 03:15:59 oleg113-client systemd[1]: session-7.scope: Succeeded. May 25 03:15:59 oleg113-client systemd-logind[1020]: Session 7 logged out. Waiting for processes to exit. May 25 03:15:59 oleg113-client systemd-logind[1020]: Removed session 7. May 25 03:16:01 oleg113-client kernel: Lustre: lustre-OST0000-osc-ffff9b15c64c8000: disconnect after 22s idle May 25 03:16:02 oleg113-client sshd[7123]: Accepted publickey for root from 192.168.201.13 port 42456 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:02 oleg113-client systemd[1]: Started Session 8 of user root. May 25 03:16:02 oleg113-client systemd-logind[1020]: New session 8 of user root. May 25 03:16:02 oleg113-client sshd[7123]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:07 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing yml_node May 25 03:16:09 oleg113-client sshd[7136]: Received disconnect from 192.168.201.13 port 42456:11: disconnected by user May 25 03:16:09 oleg113-client sshd[7136]: Disconnected from user root 192.168.201.13 port 42456 May 25 03:16:09 oleg113-client sshd[7123]: pam_unix(sshd:session): session closed for user root May 25 03:16:09 oleg113-client systemd[1]: session-8.scope: Succeeded. May 25 03:16:09 oleg113-client systemd-logind[1020]: Session 8 logged out. Waiting for processes to exit. May 25 03:16:09 oleg113-client systemd-logind[1020]: Removed session 8. May 25 03:16:13 oleg113-client sshd[7705]: Accepted publickey for root from 192.168.201.13 port 59614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:13 oleg113-client systemd[1]: Started Session 9 of user root. May 25 03:16:13 oleg113-client systemd-logind[1020]: New session 9 of user root. May 25 03:16:13 oleg113-client sshd[7705]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:14 oleg113-client kernel: Lustre: DEBUG MARKER: Client: 2.17.53.24 May 25 03:16:14 oleg113-client sshd[7718]: Received disconnect from 192.168.201.13 port 59614:11: disconnected by user May 25 03:16:14 oleg113-client sshd[7718]: Disconnected from user root 192.168.201.13 port 59614 May 25 03:16:14 oleg113-client sshd[7705]: pam_unix(sshd:session): session closed for user root May 25 03:16:14 oleg113-client systemd[1]: session-9.scope: Succeeded. May 25 03:16:14 oleg113-client systemd-logind[1020]: Session 9 logged out. Waiting for processes to exit. May 25 03:16:14 oleg113-client systemd-logind[1020]: Removed session 9. May 25 03:16:17 oleg113-client sshd[7862]: Accepted publickey for root from 192.168.201.13 port 59628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:17 oleg113-client systemd-logind[1020]: New session 10 of user root. May 25 03:16:17 oleg113-client systemd[1]: Started Session 10 of user root. May 25 03:16:17 oleg113-client sshd[7862]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:18 oleg113-client kernel: Lustre: DEBUG MARKER: MDS: 2.17.53.24 May 25 03:16:18 oleg113-client sshd[7875]: Received disconnect from 192.168.201.13 port 59628:11: disconnected by user May 25 03:16:18 oleg113-client sshd[7875]: Disconnected from user root 192.168.201.13 port 59628 May 25 03:16:18 oleg113-client sshd[7862]: pam_unix(sshd:session): session closed for user root May 25 03:16:19 oleg113-client systemd[1]: session-10.scope: Succeeded. May 25 03:16:19 oleg113-client systemd-logind[1020]: Session 10 logged out. Waiting for processes to exit. May 25 03:16:19 oleg113-client systemd-logind[1020]: Removed session 10. May 25 03:16:21 oleg113-client sshd[8020]: Accepted publickey for root from 192.168.201.13 port 52112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:21 oleg113-client systemd[1]: Started Session 11 of user root. May 25 03:16:21 oleg113-client systemd-logind[1020]: New session 11 of user root. May 25 03:16:21 oleg113-client sshd[8020]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:22 oleg113-client kernel: Lustre: DEBUG MARKER: OSS: 2.17.53.24 May 25 03:16:22 oleg113-client sshd[8033]: Received disconnect from 192.168.201.13 port 52112:11: disconnected by user May 25 03:16:22 oleg113-client sshd[8033]: Disconnected from user root 192.168.201.13 port 52112 May 25 03:16:22 oleg113-client sshd[8020]: pam_unix(sshd:session): session closed for user root May 25 03:16:23 oleg113-client systemd[1]: session-11.scope: Succeeded. May 25 03:16:23 oleg113-client systemd-logind[1020]: Session 11 logged out. Waiting for processes to exit. May 25 03:16:23 oleg113-client systemd-logind[1020]: Removed session 11. May 25 03:16:24 oleg113-client sshd[8168]: Accepted publickey for root from 192.168.201.13 port 52124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:25 oleg113-client systemd-logind[1020]: New session 12 of user root. May 25 03:16:25 oleg113-client systemd[1]: Started Session 12 of user root. May 25 03:16:25 oleg113-client sshd[8168]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:25 oleg113-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Mon May 25 03:16:22 EDT 2026 May 25 03:16:25 oleg113-client sshd[8181]: Received disconnect from 192.168.201.13 port 52124:11: disconnected by user May 25 03:16:25 oleg113-client sshd[8181]: Disconnected from user root 192.168.201.13 port 52124 May 25 03:16:25 oleg113-client sshd[8168]: pam_unix(sshd:session): session closed for user root May 25 03:16:25 oleg113-client systemd-logind[1020]: Session 12 logged out. Waiting for processes to exit. May 25 03:16:26 oleg113-client systemd[1]: session-12.scope: Succeeded. May 25 03:16:26 oleg113-client systemd-logind[1020]: Removed session 12. May 25 03:16:52 oleg113-client sshd[8702]: Accepted publickey for root from 192.168.201.13 port 35934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:52 oleg113-client systemd-logind[1020]: New session 13 of user root. May 25 03:16:52 oleg113-client systemd[1]: Started Session 13 of user root. May 25 03:16:53 oleg113-client sshd[8702]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:53 oleg113-client kernel: Lustre: DEBUG MARKER: excepting tests: 136 May 25 03:16:53 oleg113-client sshd[8715]: Received disconnect from 192.168.201.13 port 35934:11: disconnected by user May 25 03:16:53 oleg113-client sshd[8715]: Disconnected from user root 192.168.201.13 port 35934 May 25 03:16:53 oleg113-client sshd[8702]: pam_unix(sshd:session): session closed for user root May 25 03:16:53 oleg113-client systemd[1]: session-13.scope: Succeeded. May 25 03:16:53 oleg113-client systemd-logind[1020]: Session 13 logged out. Waiting for processes to exit. May 25 03:16:53 oleg113-client systemd-logind[1020]: Removed session 13. May 25 03:16:56 oleg113-client sshd[8888]: Accepted publickey for root from 192.168.201.13 port 35936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:16:56 oleg113-client systemd-logind[1020]: New session 14 of user root. May 25 03:16:56 oleg113-client systemd[1]: Started Session 14 of user root. May 25 03:16:56 oleg113-client sshd[8888]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:16:57 oleg113-client kernel: Lustre: DEBUG MARKER: === recovery-small: start setup 03:16:54 (1779693414) === May 25 03:16:57 oleg113-client sshd[8901]: Received disconnect from 192.168.201.13 port 35936:11: disconnected by user May 25 03:16:57 oleg113-client sshd[8901]: Disconnected from user root 192.168.201.13 port 35936 May 25 03:16:57 oleg113-client sshd[8888]: pam_unix(sshd:session): session closed for user root May 25 03:16:57 oleg113-client systemd-logind[1020]: Session 14 logged out. Waiting for processes to exit. May 25 03:16:57 oleg113-client systemd[1]: session-14.scope: Succeeded. May 25 03:16:57 oleg113-client systemd-logind[1020]: Removed session 14. May 25 03:17:03 oleg113-client sshd[9137]: Accepted publickey for root from 192.168.201.13 port 58394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:03 oleg113-client systemd-logind[1020]: New session 15 of user root. May 25 03:17:03 oleg113-client systemd[1]: Started Session 15 of user root. May 25 03:17:03 oleg113-client sshd[9137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:04 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing check_config_client /mnt/lustre May 25 03:17:04 oleg113-client sshd[9150]: Received disconnect from 192.168.201.13 port 58394:11: disconnected by user May 25 03:17:04 oleg113-client sshd[9150]: Disconnected from user root 192.168.201.13 port 58394 May 25 03:17:04 oleg113-client sshd[9137]: pam_unix(sshd:session): session closed for user root May 25 03:17:04 oleg113-client systemd[1]: session-15.scope: Succeeded. May 25 03:17:04 oleg113-client systemd-logind[1020]: Session 15 logged out. Waiting for processes to exit. May 25 03:17:04 oleg113-client systemd-logind[1020]: Removed session 15. May 25 03:17:38 oleg113-client sshd[9877]: Accepted publickey for root from 192.168.201.13 port 43090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:38 oleg113-client systemd-logind[1020]: New session 16 of user root. May 25 03:17:38 oleg113-client systemd[1]: Started Session 16 of user root. May 25 03:17:38 oleg113-client sshd[9877]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:39 oleg113-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 25 03:17:39 oleg113-client sshd[9890]: Received disconnect from 192.168.201.13 port 43090:11: disconnected by user May 25 03:17:39 oleg113-client sshd[9890]: Disconnected from user root 192.168.201.13 port 43090 May 25 03:17:39 oleg113-client sshd[9877]: pam_unix(sshd:session): session closed for user root May 25 03:17:39 oleg113-client systemd[1]: session-16.scope: Succeeded. May 25 03:17:39 oleg113-client systemd-logind[1020]: Session 16 logged out. Waiting for processes to exit. May 25 03:17:39 oleg113-client systemd-logind[1020]: Removed session 16. May 25 03:17:40 oleg113-client sshd[10014]: Accepted publickey for root from 192.168.201.13 port 60158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:40 oleg113-client systemd-logind[1020]: New session 17 of user root. May 25 03:17:40 oleg113-client systemd[1]: Started Session 17 of user root. May 25 03:17:40 oleg113-client sshd[10014]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:41 oleg113-client sshd[10027]: Received disconnect from 192.168.201.13 port 60158:11: disconnected by user May 25 03:17:41 oleg113-client sshd[10027]: Disconnected from user root 192.168.201.13 port 60158 May 25 03:17:41 oleg113-client sshd[10014]: pam_unix(sshd:session): session closed for user root May 25 03:17:41 oleg113-client systemd-logind[1020]: Session 17 logged out. Waiting for processes to exit. May 25 03:17:41 oleg113-client systemd[1]: session-17.scope: Succeeded. May 25 03:17:41 oleg113-client systemd-logind[1020]: Removed session 17. May 25 03:17:59 oleg113-client sshd[10476]: Accepted publickey for root from 192.168.201.13 port 49730 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:17:59 oleg113-client systemd-logind[1020]: New session 18 of user root. May 25 03:17:59 oleg113-client systemd[1]: Started Session 18 of user root. May 25 03:17:59 oleg113-client sshd[10476]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:17:59 oleg113-client sshd[10489]: Received disconnect from 192.168.201.13 port 49730:11: disconnected by user May 25 03:17:59 oleg113-client sshd[10489]: Disconnected from user root 192.168.201.13 port 49730 May 25 03:17:59 oleg113-client sshd[10476]: pam_unix(sshd:session): session closed for user root May 25 03:18:00 oleg113-client systemd[1]: session-18.scope: Succeeded. May 25 03:18:00 oleg113-client systemd-logind[1020]: Session 18 logged out. Waiting for processes to exit. May 25 03:18:00 oleg113-client systemd-logind[1020]: Removed session 18. May 25 03:18:02 oleg113-client sshd[10616]: Accepted publickey for root from 192.168.201.13 port 45548 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:18:02 oleg113-client systemd-logind[1020]: New session 19 of user root. May 25 03:18:02 oleg113-client systemd[1]: Started Session 19 of user root. May 25 03:18:02 oleg113-client sshd[10616]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:18:02 oleg113-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish setup 03:18:00 (1779693480) === May 25 03:18:02 oleg113-client sshd[10629]: Received disconnect from 192.168.201.13 port 45548:11: disconnected by user May 25 03:18:02 oleg113-client sshd[10629]: Disconnected from user root 192.168.201.13 port 45548 May 25 03:18:02 oleg113-client sshd[10616]: pam_unix(sshd:session): session closed for user root May 25 03:18:03 oleg113-client systemd[1]: session-19.scope: Succeeded. May 25 03:18:03 oleg113-client systemd-logind[1020]: Session 19 logged out. Waiting for processes to exit. May 25 03:18:03 oleg113-client systemd-logind[1020]: Removed session 19. May 25 03:18:05 oleg113-client sshd[10772]: Accepted publickey for root from 192.168.201.13 port 45550 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:18:05 oleg113-client systemd-logind[1020]: New session 20 of user root. May 25 03:18:05 oleg113-client systemd[1]: Started Session 20 of user root. May 25 03:18:05 oleg113-client sshd[10772]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:18:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 1: create, chmod, stat: drop req, drop rep ========================================================== 03:18:03 (1779693483) May 25 03:18:05 oleg113-client sshd[10785]: Received disconnect from 192.168.201.13 port 45550:11: disconnected by user May 25 03:18:05 oleg113-client sshd[10785]: Disconnected from user root 192.168.201.13 port 45550 May 25 03:18:05 oleg113-client sshd[10772]: pam_unix(sshd:session): session closed for user root May 25 03:18:05 oleg113-client systemd-logind[1020]: Session 20 logged out. Waiting for processes to exit. May 25 03:18:05 oleg113-client systemd[1]: session-20.scope: Succeeded. May 25 03:18:06 oleg113-client systemd-logind[1020]: Removed session 20. May 25 03:18:24 oleg113-client kernel: Lustre: 10833:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693487/real 1779693487] req@ffff9b15d077b480 x1866143484627840/t0(0) o700->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:30/10 lens 264/248 e 0 to 1 dl 1779693503 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 May 25 03:18:24 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:18:24 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:18:43 oleg113-client kernel: Lustre: 10854:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693507/real 1779693507] req@ffff9b15d0779880 x1866143484630144/t0(0) o36->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 520/576 e 0 to 1 dl 1779693523 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 May 25 03:18:43 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:18:44 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:19:04 oleg113-client kernel: Lustre: 10880:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693528/real 1779693528] req@ffff9b15c36b5c00 x1866143484631936/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693544 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:0 May 25 03:19:04 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:19:05 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:19:25 oleg113-client kernel: Lustre: 10901:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693549/real 1779693549] req@ffff9b15d0779c00 x1866143484634752/t0(0) o36->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 488/512 e 0 to 1 dl 1779693565 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:4294967295 May 25 03:19:25 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:19:25 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:19:45 oleg113-client kernel: Lustre: 10927:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693569/real 1779693569] req@ffff9b15c8df2a00 x1866143484636544/t0(0) o34->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 472/728 e 0 to 1 dl 1779693585 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 May 25 03:19:45 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:19:45 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:20:06 oleg113-client kernel: Lustre: 10948:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693590/real 1779693590] req@ffff9b15c36b4a80 x1866143484638336/t0(0) o34->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 472/728 e 0 to 1 dl 1779693606 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 May 25 03:20:06 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:20:06 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:20:12 oleg113-client sshd[11047]: Accepted publickey for root from 192.168.201.13 port 47068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:20:12 oleg113-client systemd-logind[1020]: New session 21 of user root. May 25 03:20:12 oleg113-client systemd[1]: Started Session 21 of user root. May 25 03:20:12 oleg113-client sshd[11047]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:20:12 oleg113-client sshd[11060]: Received disconnect from 192.168.201.13 port 47068:11: disconnected by user May 25 03:20:12 oleg113-client sshd[11060]: Disconnected from user root 192.168.201.13 port 47068 May 25 03:20:12 oleg113-client sshd[11047]: pam_unix(sshd:session): session closed for user root May 25 03:20:13 oleg113-client systemd-logind[1020]: Session 21 logged out. Waiting for processes to exit. May 25 03:20:13 oleg113-client systemd[1]: session-21.scope: Succeeded. May 25 03:20:13 oleg113-client systemd-logind[1020]: Removed session 21. May 25 03:20:14 oleg113-client sshd[11186]: Accepted publickey for root from 192.168.201.13 port 47072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:20:14 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:20:14 oleg113-client systemd-logind[1020]: New session 22 of user root. May 25 03:20:14 oleg113-client systemd[1]: Started Session 22 of user root. May 25 03:20:14 oleg113-client sshd[11186]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:20:15 oleg113-client sshd[11200]: Received disconnect from 192.168.201.13 port 47072:11: disconnected by user May 25 03:20:15 oleg113-client sshd[11200]: Disconnected from user root 192.168.201.13 port 47072 May 25 03:20:15 oleg113-client sshd[11186]: pam_unix(sshd:session): session closed for user root May 25 03:20:15 oleg113-client systemd-logind[1020]: Session 22 logged out. Waiting for processes to exit. May 25 03:20:16 oleg113-client systemd[1]: session-22.scope: Succeeded. May 25 03:20:16 oleg113-client systemd-logind[1020]: Removed session 22. May 25 03:20:17 oleg113-client sshd[11334]: Accepted publickey for root from 192.168.201.13 port 47086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:20:17 oleg113-client systemd-logind[1020]: New session 23 of user root. May 25 03:20:17 oleg113-client systemd[1]: Started Session 23 of user root. May 25 03:20:17 oleg113-client sshd[11334]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:20:18 oleg113-client sshd[11347]: Received disconnect from 192.168.201.13 port 47086:11: disconnected by user May 25 03:20:18 oleg113-client sshd[11347]: Disconnected from user root 192.168.201.13 port 47086 May 25 03:20:18 oleg113-client sshd[11334]: pam_unix(sshd:session): session closed for user root May 25 03:20:18 oleg113-client systemd[1]: session-23.scope: Succeeded. May 25 03:20:18 oleg113-client systemd-logind[1020]: Session 23 logged out. Waiting for processes to exit. May 25 03:20:18 oleg113-client systemd-logind[1020]: Removed session 23. May 25 03:20:20 oleg113-client sshd[11490]: Accepted publickey for root from 192.168.201.13 port 39908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:20:21 oleg113-client systemd-logind[1020]: New session 24 of user root. May 25 03:20:21 oleg113-client systemd[1]: Started Session 24 of user root. May 25 03:20:21 oleg113-client sshd[11490]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:20:21 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 4: open: drop req, drop rep ======= 03:20:19 (1779693619) May 25 03:20:21 oleg113-client sshd[11503]: Received disconnect from 192.168.201.13 port 39908:11: disconnected by user May 25 03:20:21 oleg113-client sshd[11503]: Disconnected from user root 192.168.201.13 port 39908 May 25 03:20:21 oleg113-client sshd[11490]: pam_unix(sshd:session): session closed for user root May 25 03:20:21 oleg113-client systemd[1]: session-24.scope: Succeeded. May 25 03:20:21 oleg113-client systemd-logind[1020]: Session 24 logged out. Waiting for processes to exit. May 25 03:20:22 oleg113-client systemd-logind[1020]: Removed session 24. May 25 03:20:40 oleg113-client kernel: Lustre: 11560:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693624/real 1779693624] req@ffff9b15d077aa00 x1866143484642048/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693640 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 May 25 03:20:40 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:20:40 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:21:03 oleg113-client sshd[11680]: Accepted publickey for root from 192.168.201.13 port 48978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:03 oleg113-client systemd[1]: Started Session 25 of user root. May 25 03:21:03 oleg113-client systemd-logind[1020]: New session 25 of user root. May 25 03:21:03 oleg113-client sshd[11680]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:03 oleg113-client sshd[11693]: Received disconnect from 192.168.201.13 port 48978:11: disconnected by user May 25 03:21:03 oleg113-client sshd[11693]: Disconnected from user root 192.168.201.13 port 48978 May 25 03:21:03 oleg113-client sshd[11680]: pam_unix(sshd:session): session closed for user root May 25 03:21:03 oleg113-client systemd-logind[1020]: Session 25 logged out. Waiting for processes to exit. May 25 03:21:03 oleg113-client systemd[1]: session-25.scope: Succeeded. May 25 03:21:03 oleg113-client systemd-logind[1020]: Removed session 25. May 25 03:21:05 oleg113-client sshd[11820]: Accepted publickey for root from 192.168.201.13 port 48992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:05 oleg113-client systemd-logind[1020]: New session 26 of user root. May 25 03:21:05 oleg113-client systemd[1]: Started Session 26 of user root. May 25 03:21:05 oleg113-client sshd[11820]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:06 oleg113-client sshd[11833]: Received disconnect from 192.168.201.13 port 48992:11: disconnected by user May 25 03:21:06 oleg113-client sshd[11833]: Disconnected from user root 192.168.201.13 port 48992 May 25 03:21:06 oleg113-client sshd[11820]: pam_unix(sshd:session): session closed for user root May 25 03:21:06 oleg113-client systemd[1]: session-26.scope: Succeeded. May 25 03:21:06 oleg113-client systemd-logind[1020]: Session 26 logged out. Waiting for processes to exit. May 25 03:21:06 oleg113-client systemd-logind[1020]: Removed session 26. May 25 03:21:08 oleg113-client sshd[11967]: Accepted publickey for root from 192.168.201.13 port 49002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:08 oleg113-client systemd-logind[1020]: New session 27 of user root. May 25 03:21:08 oleg113-client systemd[1]: Started Session 27 of user root. May 25 03:21:08 oleg113-client sshd[11967]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:08 oleg113-client sshd[11980]: Received disconnect from 192.168.201.13 port 49002:11: disconnected by user May 25 03:21:08 oleg113-client sshd[11980]: Disconnected from user root 192.168.201.13 port 49002 May 25 03:21:08 oleg113-client sshd[11967]: pam_unix(sshd:session): session closed for user root May 25 03:21:08 oleg113-client systemd[1]: session-27.scope: Succeeded. May 25 03:21:08 oleg113-client systemd-logind[1020]: Session 27 logged out. Waiting for processes to exit. May 25 03:21:09 oleg113-client systemd-logind[1020]: Removed session 27. May 25 03:21:11 oleg113-client sshd[12122]: Accepted publickey for root from 192.168.201.13 port 59488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:11 oleg113-client systemd-logind[1020]: New session 28 of user root. May 25 03:21:11 oleg113-client systemd[1]: Started Session 28 of user root. May 25 03:21:11 oleg113-client sshd[12122]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:11 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 5: rename: drop req, drop rep ===== 03:21:09 (1779693669) May 25 03:21:11 oleg113-client sshd[12135]: Received disconnect from 192.168.201.13 port 59488:11: disconnected by user May 25 03:21:11 oleg113-client sshd[12135]: Disconnected from user root 192.168.201.13 port 59488 May 25 03:21:11 oleg113-client sshd[12122]: pam_unix(sshd:session): session closed for user root May 25 03:21:11 oleg113-client systemd[1]: session-28.scope: Succeeded. May 25 03:21:11 oleg113-client systemd-logind[1020]: Session 28 logged out. Waiting for processes to exit. May 25 03:21:11 oleg113-client systemd-logind[1020]: Removed session 28. May 25 03:21:30 oleg113-client kernel: Lustre: 12191:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693674/real 1779693674] req@ffff9b15d077aa00 x1866143484650368/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779693690 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:0 May 25 03:21:30 oleg113-client kernel: Lustre: 12191:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message May 25 03:21:30 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:21:30 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 03:21:30 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:21:30 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 03:21:55 oleg113-client sshd[12324]: Accepted publickey for root from 192.168.201.13 port 34108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:55 oleg113-client systemd-logind[1020]: New session 29 of user root. May 25 03:21:55 oleg113-client systemd[1]: Started Session 29 of user root. May 25 03:21:55 oleg113-client sshd[12324]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:56 oleg113-client sshd[12337]: Received disconnect from 192.168.201.13 port 34108:11: disconnected by user May 25 03:21:56 oleg113-client sshd[12337]: Disconnected from user root 192.168.201.13 port 34108 May 25 03:21:56 oleg113-client sshd[12324]: pam_unix(sshd:session): session closed for user root May 25 03:21:56 oleg113-client systemd-logind[1020]: Session 29 logged out. Waiting for processes to exit. May 25 03:21:56 oleg113-client systemd[1]: session-29.scope: Succeeded. May 25 03:21:56 oleg113-client systemd-logind[1020]: Removed session 29. May 25 03:21:57 oleg113-client sshd[12463]: Accepted publickey for root from 192.168.201.13 port 34116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:21:58 oleg113-client systemd-logind[1020]: New session 30 of user root. May 25 03:21:58 oleg113-client systemd[1]: Started Session 30 of user root. May 25 03:21:58 oleg113-client sshd[12463]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:21:58 oleg113-client sshd[12477]: Received disconnect from 192.168.201.13 port 34116:11: disconnected by user May 25 03:21:58 oleg113-client sshd[12477]: Disconnected from user root 192.168.201.13 port 34116 May 25 03:21:58 oleg113-client sshd[12463]: pam_unix(sshd:session): session closed for user root May 25 03:21:58 oleg113-client systemd-logind[1020]: Session 30 logged out. Waiting for processes to exit. May 25 03:21:58 oleg113-client systemd[1]: session-30.scope: Succeeded. May 25 03:21:58 oleg113-client systemd-logind[1020]: Removed session 30. May 25 03:22:00 oleg113-client sshd[12610]: Accepted publickey for root from 192.168.201.13 port 42948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:00 oleg113-client systemd-logind[1020]: New session 31 of user root. May 25 03:22:00 oleg113-client systemd[1]: Started Session 31 of user root. May 25 03:22:00 oleg113-client sshd[12610]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:01 oleg113-client sshd[12623]: Received disconnect from 192.168.201.13 port 42948:11: disconnected by user May 25 03:22:01 oleg113-client sshd[12623]: Disconnected from user root 192.168.201.13 port 42948 May 25 03:22:01 oleg113-client sshd[12610]: pam_unix(sshd:session): session closed for user root May 25 03:22:01 oleg113-client systemd[1]: session-31.scope: Succeeded. May 25 03:22:01 oleg113-client systemd-logind[1020]: Session 31 logged out. Waiting for processes to exit. May 25 03:22:01 oleg113-client systemd-logind[1020]: Removed session 31. May 25 03:22:03 oleg113-client sshd[12765]: Accepted publickey for root from 192.168.201.13 port 42962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:22:03 oleg113-client systemd-logind[1020]: New session 32 of user root. May 25 03:22:03 oleg113-client systemd[1]: Started Session 32 of user root. May 25 03:22:03 oleg113-client sshd[12765]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:22:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 6: link, unlink: drop req, drop rep ========================================================== 03:22:02 (1779693722) May 25 03:22:04 oleg113-client sshd[12778]: Received disconnect from 192.168.201.13 port 42962:11: disconnected by user May 25 03:22:04 oleg113-client sshd[12778]: Disconnected from user root 192.168.201.13 port 42962 May 25 03:22:04 oleg113-client sshd[12765]: pam_unix(sshd:session): session closed for user root May 25 03:22:04 oleg113-client systemd[1]: session-32.scope: Succeeded. May 25 03:22:04 oleg113-client systemd-logind[1020]: Session 32 logged out. Waiting for processes to exit. May 25 03:22:04 oleg113-client systemd-logind[1020]: Removed session 32. May 25 03:22:21 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c64c8000: disconnect after 22s idle May 25 03:22:21 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 03:22:43 oleg113-client kernel: Lustre: 12855:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779693746/real 1779693746] req@ffff9b15c36b5880 x1866143484664192/t0(0) o36->lustre-MDT0000-mdc-ffff9b15c64c8000@192.168.201.113@tcp:12/10 lens 512/440 e 0 to 1 dl 1779693762 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'link.0' uid:0 gid:0 projid:4294967295 May 25 03:22:43 oleg113-client kernel: Lustre: 12855:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 03:22:43 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:22:43 oleg113-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:22:43 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:22:43 oleg113-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:23:28 oleg113-client sshd[13007]: Accepted publickey for root from 192.168.201.13 port 35838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:28 oleg113-client systemd-logind[1020]: New session 33 of user root. May 25 03:23:28 oleg113-client systemd[1]: Started Session 33 of user root. May 25 03:23:28 oleg113-client sshd[13007]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:29 oleg113-client sshd[13020]: Received disconnect from 192.168.201.13 port 35838:11: disconnected by user May 25 03:23:29 oleg113-client sshd[13020]: Disconnected from user root 192.168.201.13 port 35838 May 25 03:23:29 oleg113-client sshd[13007]: pam_unix(sshd:session): session closed for user root May 25 03:23:29 oleg113-client systemd-logind[1020]: Session 33 logged out. Waiting for processes to exit. May 25 03:23:29 oleg113-client systemd[1]: session-33.scope: Succeeded. May 25 03:23:29 oleg113-client systemd-logind[1020]: Removed session 33. May 25 03:23:31 oleg113-client sshd[13148]: Accepted publickey for root from 192.168.201.13 port 40588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:31 oleg113-client systemd-logind[1020]: New session 34 of user root. May 25 03:23:31 oleg113-client systemd[1]: Started Session 34 of user root. May 25 03:23:31 oleg113-client sshd[13148]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:31 oleg113-client sshd[13161]: Received disconnect from 192.168.201.13 port 40588:11: disconnected by user May 25 03:23:31 oleg113-client sshd[13161]: Disconnected from user root 192.168.201.13 port 40588 May 25 03:23:31 oleg113-client sshd[13148]: pam_unix(sshd:session): session closed for user root May 25 03:23:32 oleg113-client systemd[1]: session-34.scope: Succeeded. May 25 03:23:32 oleg113-client systemd-logind[1020]: Session 34 logged out. Waiting for processes to exit. May 25 03:23:32 oleg113-client systemd-logind[1020]: Removed session 34. May 25 03:23:33 oleg113-client sshd[13295]: Accepted publickey for root from 192.168.201.13 port 40604 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:33 oleg113-client systemd-logind[1020]: New session 35 of user root. May 25 03:23:33 oleg113-client systemd[1]: Started Session 35 of user root. May 25 03:23:33 oleg113-client sshd[13295]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:33 oleg113-client sshd[13308]: Received disconnect from 192.168.201.13 port 40604:11: disconnected by user May 25 03:23:33 oleg113-client sshd[13308]: Disconnected from user root 192.168.201.13 port 40604 May 25 03:23:34 oleg113-client sshd[13295]: pam_unix(sshd:session): session closed for user root May 25 03:23:34 oleg113-client systemd[1]: session-35.scope: Succeeded. May 25 03:23:34 oleg113-client systemd-logind[1020]: Session 35 logged out. Waiting for processes to exit. May 25 03:23:34 oleg113-client systemd-logind[1020]: Removed session 35. May 25 03:23:36 oleg113-client sshd[13451]: Accepted publickey for root from 192.168.201.13 port 40618 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:36 oleg113-client systemd[1]: Started Session 36 of user root. May 25 03:23:36 oleg113-client systemd-logind[1020]: New session 36 of user root. May 25 03:23:36 oleg113-client sshd[13451]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:36 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 8: touch: drop rep (bug 1423) ===== 03:23:34 (1779693814) May 25 03:23:36 oleg113-client sshd[13465]: Received disconnect from 192.168.201.13 port 40618:11: disconnected by user May 25 03:23:36 oleg113-client sshd[13465]: Disconnected from user root 192.168.201.13 port 40618 May 25 03:23:36 oleg113-client sshd[13451]: pam_unix(sshd:session): session closed for user root May 25 03:23:36 oleg113-client systemd[1]: session-36.scope: Succeeded. May 25 03:23:36 oleg113-client systemd-logind[1020]: Session 36 logged out. Waiting for processes to exit. May 25 03:23:36 oleg113-client systemd-logind[1020]: Removed session 36. May 25 03:23:56 oleg113-client systemd[1]: Starting Cleanup of Temporary Directories... May 25 03:23:56 oleg113-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. May 25 03:23:56 oleg113-client systemd[1]: Started Cleanup of Temporary Directories. May 25 03:23:56 oleg113-client sshd[13607]: Accepted publickey for root from 192.168.201.13 port 55856 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:57 oleg113-client systemd-logind[1020]: New session 37 of user root. May 25 03:23:57 oleg113-client systemd[1]: Started Session 37 of user root. May 25 03:23:57 oleg113-client sshd[13607]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:57 oleg113-client sshd[13622]: Received disconnect from 192.168.201.13 port 55856:11: disconnected by user May 25 03:23:57 oleg113-client sshd[13622]: Disconnected from user root 192.168.201.13 port 55856 May 25 03:23:57 oleg113-client sshd[13607]: pam_unix(sshd:session): session closed for user root May 25 03:23:57 oleg113-client systemd-logind[1020]: Session 37 logged out. Waiting for processes to exit. May 25 03:23:57 oleg113-client systemd[1]: session-37.scope: Succeeded. May 25 03:23:57 oleg113-client systemd-logind[1020]: Removed session 37. May 25 03:23:59 oleg113-client sshd[13748]: Accepted publickey for root from 192.168.201.13 port 55866 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:23:59 oleg113-client systemd-logind[1020]: New session 38 of user root. May 25 03:23:59 oleg113-client systemd[1]: Started Session 38 of user root. May 25 03:23:59 oleg113-client sshd[13748]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:23:59 oleg113-client sshd[13761]: Received disconnect from 192.168.201.13 port 55866:11: disconnected by user May 25 03:23:59 oleg113-client sshd[13761]: Disconnected from user root 192.168.201.13 port 55866 May 25 03:23:59 oleg113-client sshd[13748]: pam_unix(sshd:session): session closed for user root May 25 03:23:59 oleg113-client systemd-logind[1020]: Session 38 logged out. Waiting for processes to exit. May 25 03:23:59 oleg113-client systemd[1]: session-38.scope: Succeeded. May 25 03:24:00 oleg113-client systemd-logind[1020]: Removed session 38. May 25 03:24:01 oleg113-client sshd[13895]: Accepted publickey for root from 192.168.201.13 port 51226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:01 oleg113-client systemd-logind[1020]: New session 39 of user root. May 25 03:24:01 oleg113-client systemd[1]: Started Session 39 of user root. May 25 03:24:01 oleg113-client sshd[13895]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:02 oleg113-client sshd[13908]: Received disconnect from 192.168.201.13 port 51226:11: disconnected by user May 25 03:24:02 oleg113-client sshd[13908]: Disconnected from user root 192.168.201.13 port 51226 May 25 03:24:02 oleg113-client sshd[13895]: pam_unix(sshd:session): session closed for user root May 25 03:24:02 oleg113-client systemd-logind[1020]: Session 39 logged out. Waiting for processes to exit. May 25 03:24:02 oleg113-client systemd[1]: session-39.scope: Succeeded. May 25 03:24:02 oleg113-client systemd-logind[1020]: Removed session 39. May 25 03:24:04 oleg113-client sshd[14051]: Accepted publickey for root from 192.168.201.13 port 51240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:04 oleg113-client systemd-logind[1020]: New session 40 of user root. May 25 03:24:04 oleg113-client systemd[1]: Started Session 40 of user root. May 25 03:24:04 oleg113-client sshd[14051]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 9: pause bulk on OST (bug 1420) === 03:24:02 (1779693842) May 25 03:24:04 oleg113-client sshd[14064]: Received disconnect from 192.168.201.13 port 51240:11: disconnected by user May 25 03:24:04 oleg113-client sshd[14064]: Disconnected from user root 192.168.201.13 port 51240 May 25 03:24:04 oleg113-client sshd[14051]: pam_unix(sshd:session): session closed for user root May 25 03:24:05 oleg113-client systemd[1]: session-40.scope: Succeeded. May 25 03:24:05 oleg113-client systemd-logind[1020]: Session 40 logged out. Waiting for processes to exit. May 25 03:24:05 oleg113-client systemd-logind[1020]: Removed session 40. May 25 03:24:17 oleg113-client sshd[14290]: Accepted publickey for root from 192.168.201.13 port 58602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:17 oleg113-client systemd[1]: Started Session 41 of user root. May 25 03:24:17 oleg113-client systemd-logind[1020]: New session 41 of user root. May 25 03:24:17 oleg113-client sshd[14290]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:17 oleg113-client sshd[14303]: Received disconnect from 192.168.201.13 port 58602:11: disconnected by user May 25 03:24:17 oleg113-client sshd[14303]: Disconnected from user root 192.168.201.13 port 58602 May 25 03:24:17 oleg113-client sshd[14290]: pam_unix(sshd:session): session closed for user root May 25 03:24:17 oleg113-client systemd[1]: session-41.scope: Succeeded. May 25 03:24:17 oleg113-client systemd-logind[1020]: Session 41 logged out. Waiting for processes to exit. May 25 03:24:17 oleg113-client systemd-logind[1020]: Removed session 41. May 25 03:24:19 oleg113-client sshd[14430]: Accepted publickey for root from 192.168.201.13 port 42790 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:20 oleg113-client systemd-logind[1020]: New session 42 of user root. May 25 03:24:20 oleg113-client systemd[1]: Started Session 42 of user root. May 25 03:24:20 oleg113-client sshd[14430]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:20 oleg113-client sshd[14443]: Received disconnect from 192.168.201.13 port 42790:11: disconnected by user May 25 03:24:20 oleg113-client sshd[14443]: Disconnected from user root 192.168.201.13 port 42790 May 25 03:24:20 oleg113-client sshd[14430]: pam_unix(sshd:session): session closed for user root May 25 03:24:20 oleg113-client systemd-logind[1020]: Session 42 logged out. Waiting for processes to exit. May 25 03:24:20 oleg113-client systemd[1]: session-42.scope: Succeeded. May 25 03:24:20 oleg113-client systemd-logind[1020]: Removed session 42. May 25 03:24:22 oleg113-client sshd[14576]: Accepted publickey for root from 192.168.201.13 port 42798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:22 oleg113-client systemd[1]: Started Session 43 of user root. May 25 03:24:22 oleg113-client systemd-logind[1020]: New session 43 of user root. May 25 03:24:22 oleg113-client sshd[14576]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:23 oleg113-client sshd[14589]: Received disconnect from 192.168.201.13 port 42798:11: disconnected by user May 25 03:24:23 oleg113-client sshd[14589]: Disconnected from user root 192.168.201.13 port 42798 May 25 03:24:23 oleg113-client sshd[14576]: pam_unix(sshd:session): session closed for user root May 25 03:24:23 oleg113-client systemd[1]: session-43.scope: Succeeded. May 25 03:24:23 oleg113-client systemd-logind[1020]: Session 43 logged out. Waiting for processes to exit. May 25 03:24:23 oleg113-client systemd-logind[1020]: Removed session 43. May 25 03:24:26 oleg113-client sshd[14731]: Accepted publickey for root from 192.168.201.13 port 42812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:24:26 oleg113-client systemd[1]: Started Session 44 of user root. May 25 03:24:26 oleg113-client systemd-logind[1020]: New session 44 of user root. May 25 03:24:26 oleg113-client sshd[14731]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:24:26 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 03:24:24 (1779693864) May 25 03:24:26 oleg113-client sshd[14744]: Received disconnect from 192.168.201.13 port 42812:11: disconnected by user May 25 03:24:27 oleg113-client sshd[14744]: Disconnected from user root 192.168.201.13 port 42812 May 25 03:24:27 oleg113-client sshd[14731]: pam_unix(sshd:session): session closed for user root May 25 03:24:27 oleg113-client systemd-logind[1020]: Session 44 logged out. Waiting for processes to exit. May 25 03:24:27 oleg113-client systemd[1]: session-44.scope: Succeeded. May 25 03:24:27 oleg113-client systemd-logind[1020]: Removed session 44. May 25 03:24:27 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:24:43 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:24:44 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c64c8000: disconnect after 24s idle May 25 03:25:00 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:25:16 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:25:32 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:25:48 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:26:04 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:26:21 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64c8000: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 03:26:21 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:26:21 oleg113-client kernel: Lustre: Skipped 3 previous similar messages May 25 03:26:21 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64c8000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:26:21 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64c8000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:26:21 oleg113-client kernel: Lustre: Skipped 3 previous similar messages May 25 03:26:28 oleg113-client sshd[14989]: Accepted publickey for root from 192.168.201.13 port 58456 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:28 oleg113-client systemd[1]: Started Session 45 of user root. May 25 03:26:28 oleg113-client systemd-logind[1020]: New session 45 of user root. May 25 03:26:28 oleg113-client sshd[14989]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:28 oleg113-client sshd[15002]: Received disconnect from 192.168.201.13 port 58456:11: disconnected by user May 25 03:26:28 oleg113-client sshd[15002]: Disconnected from user root 192.168.201.13 port 58456 May 25 03:26:29 oleg113-client sshd[14989]: pam_unix(sshd:session): session closed for user root May 25 03:26:29 oleg113-client systemd[1]: session-45.scope: Succeeded. May 25 03:26:29 oleg113-client systemd-logind[1020]: Session 45 logged out. Waiting for processes to exit. May 25 03:26:29 oleg113-client systemd-logind[1020]: Removed session 45. May 25 03:26:30 oleg113-client sshd[15128]: Accepted publickey for root from 192.168.201.13 port 60800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:30 oleg113-client systemd[1]: Started Session 46 of user root. May 25 03:26:30 oleg113-client systemd-logind[1020]: New session 46 of user root. May 25 03:26:30 oleg113-client sshd[15128]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:31 oleg113-client sshd[15141]: Received disconnect from 192.168.201.13 port 60800:11: disconnected by user May 25 03:26:31 oleg113-client sshd[15141]: Disconnected from user root 192.168.201.13 port 60800 May 25 03:26:31 oleg113-client sshd[15128]: pam_unix(sshd:session): session closed for user root May 25 03:26:31 oleg113-client systemd[1]: session-46.scope: Succeeded. May 25 03:26:31 oleg113-client systemd-logind[1020]: Session 46 logged out. Waiting for processes to exit. May 25 03:26:31 oleg113-client systemd-logind[1020]: Removed session 46. May 25 03:26:32 oleg113-client sshd[15275]: Accepted publickey for root from 192.168.201.13 port 60814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:32 oleg113-client systemd[1]: Started Session 47 of user root. May 25 03:26:32 oleg113-client systemd-logind[1020]: New session 47 of user root. May 25 03:26:32 oleg113-client sshd[15275]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:33 oleg113-client sshd[15289]: Received disconnect from 192.168.201.13 port 60814:11: disconnected by user May 25 03:26:33 oleg113-client sshd[15289]: Disconnected from user root 192.168.201.13 port 60814 May 25 03:26:33 oleg113-client sshd[15275]: pam_unix(sshd:session): session closed for user root May 25 03:26:33 oleg113-client systemd[1]: session-47.scope: Succeeded. May 25 03:26:33 oleg113-client systemd-logind[1020]: Session 47 logged out. Waiting for processes to exit. May 25 03:26:33 oleg113-client systemd-logind[1020]: Removed session 47. May 25 03:26:35 oleg113-client sshd[15432]: Accepted publickey for root from 192.168.201.13 port 60830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:35 oleg113-client systemd[1]: Started Session 48 of user root. May 25 03:26:35 oleg113-client systemd-logind[1020]: New session 48 of user root. May 25 03:26:35 oleg113-client sshd[15432]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:36 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10b: re-send BL AST =============== 03:26:34 (1779693994) May 25 03:26:36 oleg113-client sshd[15445]: Received disconnect from 192.168.201.13 port 60830:11: disconnected by user May 25 03:26:36 oleg113-client sshd[15445]: Disconnected from user root 192.168.201.13 port 60830 May 25 03:26:36 oleg113-client sshd[15432]: pam_unix(sshd:session): session closed for user root May 25 03:26:36 oleg113-client systemd[1]: session-48.scope: Succeeded. May 25 03:26:36 oleg113-client systemd-logind[1020]: Session 48 logged out. Waiting for processes to exit. May 25 03:26:36 oleg113-client systemd-logind[1020]: Removed session 48. May 25 03:26:36 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:26:52 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c64c8000: disconnect after 24s idle May 25 03:26:55 oleg113-client sshd[15643]: Accepted publickey for root from 192.168.201.13 port 53958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:55 oleg113-client systemd-logind[1020]: New session 49 of user root. May 25 03:26:55 oleg113-client systemd[1]: Started Session 49 of user root. May 25 03:26:55 oleg113-client sshd[15643]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:26:56 oleg113-client sshd[15656]: Received disconnect from 192.168.201.13 port 53958:11: disconnected by user May 25 03:26:56 oleg113-client sshd[15656]: Disconnected from user root 192.168.201.13 port 53958 May 25 03:26:56 oleg113-client sshd[15643]: pam_unix(sshd:session): session closed for user root May 25 03:26:56 oleg113-client systemd[1]: session-49.scope: Succeeded. May 25 03:26:56 oleg113-client systemd-logind[1020]: Session 49 logged out. Waiting for processes to exit. May 25 03:26:56 oleg113-client systemd-logind[1020]: Removed session 49. May 25 03:26:59 oleg113-client sshd[15782]: Accepted publickey for root from 192.168.201.13 port 34220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:26:59 oleg113-client systemd-logind[1020]: New session 50 of user root. May 25 03:26:59 oleg113-client systemd[1]: Started Session 50 of user root. May 25 03:26:59 oleg113-client sshd[15782]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:00 oleg113-client sshd[15795]: Received disconnect from 192.168.201.13 port 34220:11: disconnected by user May 25 03:27:00 oleg113-client sshd[15795]: Disconnected from user root 192.168.201.13 port 34220 May 25 03:27:00 oleg113-client sshd[15782]: pam_unix(sshd:session): session closed for user root May 25 03:27:00 oleg113-client systemd-logind[1020]: Session 50 logged out. Waiting for processes to exit. May 25 03:27:00 oleg113-client systemd[1]: session-50.scope: Succeeded. May 25 03:27:00 oleg113-client systemd-logind[1020]: Removed session 50. May 25 03:27:01 oleg113-client sshd[15928]: Accepted publickey for root from 192.168.201.13 port 34232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:01 oleg113-client systemd-logind[1020]: New session 51 of user root. May 25 03:27:01 oleg113-client systemd[1]: Started Session 51 of user root. May 25 03:27:01 oleg113-client sshd[15928]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:02 oleg113-client sshd[15942]: Received disconnect from 192.168.201.13 port 34232:11: disconnected by user May 25 03:27:02 oleg113-client sshd[15942]: Disconnected from user root 192.168.201.13 port 34232 May 25 03:27:02 oleg113-client sshd[15928]: pam_unix(sshd:session): session closed for user root May 25 03:27:02 oleg113-client systemd-logind[1020]: Session 51 logged out. Waiting for processes to exit. May 25 03:27:02 oleg113-client systemd[1]: session-51.scope: Succeeded. May 25 03:27:02 oleg113-client systemd-logind[1020]: Removed session 51. May 25 03:27:04 oleg113-client sshd[16084]: Accepted publickey for root from 192.168.201.13 port 34236 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:04 oleg113-client systemd-logind[1020]: New session 52 of user root. May 25 03:27:04 oleg113-client systemd[1]: Started Session 52 of user root. May 25 03:27:05 oleg113-client sshd[16084]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10c: re-send BL AST vs reconnect race (LU-5569) ========================================================== 03:27:03 (1779694023) May 25 03:27:05 oleg113-client sshd[16097]: Received disconnect from 192.168.201.13 port 34236:11: disconnected by user May 25 03:27:05 oleg113-client sshd[16097]: Disconnected from user root 192.168.201.13 port 34236 May 25 03:27:05 oleg113-client sshd[16084]: pam_unix(sshd:session): session closed for user root May 25 03:27:05 oleg113-client systemd-logind[1020]: Session 52 logged out. Waiting for processes to exit. May 25 03:27:05 oleg113-client systemd[1]: session-52.scope: Succeeded. May 25 03:27:05 oleg113-client systemd-logind[1020]: Removed session 52. May 25 03:27:09 oleg113-client sshd[16287]: Accepted publickey for root from 192.168.201.13 port 36092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:09 oleg113-client systemd-logind[1020]: New session 53 of user root. May 25 03:27:09 oleg113-client systemd[1]: Started Session 53 of user root. May 25 03:27:09 oleg113-client sshd[16287]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:10 oleg113-client sshd[16300]: Received disconnect from 192.168.201.13 port 36092:11: disconnected by user May 25 03:27:10 oleg113-client sshd[16300]: Disconnected from user root 192.168.201.13 port 36092 May 25 03:27:10 oleg113-client sshd[16287]: pam_unix(sshd:session): session closed for user root May 25 03:27:10 oleg113-client systemd-logind[1020]: Session 53 logged out. Waiting for processes to exit. May 25 03:27:10 oleg113-client systemd[1]: session-53.scope: Succeeded. May 25 03:27:10 oleg113-client systemd-logind[1020]: Removed session 53. May 25 03:27:11 oleg113-client sshd[16426]: Accepted publickey for root from 192.168.201.13 port 36094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:12 oleg113-client systemd[1]: Started Session 54 of user root. May 25 03:27:12 oleg113-client systemd-logind[1020]: New session 54 of user root. May 25 03:27:12 oleg113-client sshd[16426]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:12 oleg113-client sshd[16439]: Received disconnect from 192.168.201.13 port 36094:11: disconnected by user May 25 03:27:12 oleg113-client sshd[16439]: Disconnected from user root 192.168.201.13 port 36094 May 25 03:27:12 oleg113-client sshd[16426]: pam_unix(sshd:session): session closed for user root May 25 03:27:12 oleg113-client systemd-logind[1020]: Session 54 logged out. Waiting for processes to exit. May 25 03:27:12 oleg113-client systemd[1]: session-54.scope: Succeeded. May 25 03:27:12 oleg113-client systemd-logind[1020]: Removed session 54. May 25 03:27:14 oleg113-client sshd[16572]: Accepted publickey for root from 192.168.201.13 port 36096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:14 oleg113-client systemd-logind[1020]: New session 55 of user root. May 25 03:27:14 oleg113-client systemd[1]: Started Session 55 of user root. May 25 03:27:14 oleg113-client sshd[16572]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:14 oleg113-client sshd[16585]: Received disconnect from 192.168.201.13 port 36096:11: disconnected by user May 25 03:27:14 oleg113-client sshd[16585]: Disconnected from user root 192.168.201.13 port 36096 May 25 03:27:15 oleg113-client sshd[16572]: pam_unix(sshd:session): session closed for user root May 25 03:27:15 oleg113-client systemd[1]: session-55.scope: Succeeded. May 25 03:27:15 oleg113-client systemd-logind[1020]: Session 55 logged out. Waiting for processes to exit. May 25 03:27:15 oleg113-client systemd-logind[1020]: Removed session 55. May 25 03:27:17 oleg113-client sshd[16728]: Accepted publickey for root from 192.168.201.13 port 36102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:17 oleg113-client systemd-logind[1020]: New session 56 of user root. May 25 03:27:17 oleg113-client systemd[1]: Started Session 56 of user root. May 25 03:27:17 oleg113-client sshd[16728]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:18 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10d: test failed blocking ast ===== 03:27:16 (1779694036) May 25 03:27:18 oleg113-client sshd[16741]: Received disconnect from 192.168.201.13 port 36102:11: disconnected by user May 25 03:27:18 oleg113-client sshd[16741]: Disconnected from user root 192.168.201.13 port 36102 May 25 03:27:18 oleg113-client sshd[16728]: pam_unix(sshd:session): session closed for user root May 25 03:27:18 oleg113-client systemd[1]: session-56.scope: Succeeded. May 25 03:27:18 oleg113-client systemd-logind[1020]: Session 56 logged out. Waiting for processes to exit. May 25 03:27:18 oleg113-client systemd-logind[1020]: Removed session 56. May 25 03:27:23 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 03:27:23 oleg113-client kernel: LustreError: 16802:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c64c8000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:27:23 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 03:27:24 oleg113-client systemd-udevd[16840]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:27:24 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:27:25 oleg113-client systemd-udevd[16875]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:27:25 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:27:26 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 03:27:27 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:27:27 oleg113-client kernel: Lustre: 2421:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.113@tcp:/lustre/fid: [0x200000404:0x1:0x0]/ may get corrupted (rc -108) May 25 03:27:31 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:27:31 oleg113-client kernel: LustreError: 16991:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15cac48800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:27:31 oleg113-client kernel: LustreError: 16991:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:27:31 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 03:27:32 oleg113-client sshd[17079]: Accepted publickey for root from 192.168.201.13 port 44978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:32 oleg113-client systemd-logind[1020]: New session 57 of user root. May 25 03:27:32 oleg113-client systemd[1]: Started Session 57 of user root. May 25 03:27:32 oleg113-client sshd[17079]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:33 oleg113-client sshd[17092]: Received disconnect from 192.168.201.13 port 44978:11: disconnected by user May 25 03:27:33 oleg113-client sshd[17092]: Disconnected from user root 192.168.201.13 port 44978 May 25 03:27:33 oleg113-client sshd[17079]: pam_unix(sshd:session): session closed for user root May 25 03:27:33 oleg113-client systemd[1]: session-57.scope: Succeeded. May 25 03:27:33 oleg113-client systemd-logind[1020]: Session 57 logged out. Waiting for processes to exit. May 25 03:27:33 oleg113-client systemd-logind[1020]: Removed session 57. May 25 03:27:36 oleg113-client sshd[17219]: Accepted publickey for root from 192.168.201.13 port 44994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:36 oleg113-client systemd-logind[1020]: New session 58 of user root. May 25 03:27:36 oleg113-client systemd[1]: Started Session 58 of user root. May 25 03:27:36 oleg113-client sshd[17219]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:36 oleg113-client sshd[17232]: Received disconnect from 192.168.201.13 port 44994:11: disconnected by user May 25 03:27:36 oleg113-client sshd[17232]: Disconnected from user root 192.168.201.13 port 44994 May 25 03:27:36 oleg113-client sshd[17219]: pam_unix(sshd:session): session closed for user root May 25 03:27:37 oleg113-client systemd[1]: session-58.scope: Succeeded. May 25 03:27:37 oleg113-client systemd-logind[1020]: Session 58 logged out. Waiting for processes to exit. May 25 03:27:37 oleg113-client systemd-logind[1020]: Removed session 58. May 25 03:27:38 oleg113-client sshd[17365]: Accepted publickey for root from 192.168.201.13 port 45006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:38 oleg113-client systemd-logind[1020]: New session 59 of user root. May 25 03:27:38 oleg113-client systemd[1]: Started Session 59 of user root. May 25 03:27:38 oleg113-client sshd[17365]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:39 oleg113-client sshd[17378]: Received disconnect from 192.168.201.13 port 45006:11: disconnected by user May 25 03:27:39 oleg113-client sshd[17378]: Disconnected from user root 192.168.201.13 port 45006 May 25 03:27:39 oleg113-client sshd[17365]: pam_unix(sshd:session): session closed for user root May 25 03:27:39 oleg113-client systemd[1]: session-59.scope: Succeeded. May 25 03:27:39 oleg113-client systemd-logind[1020]: Session 59 logged out. Waiting for processes to exit. May 25 03:27:39 oleg113-client systemd-logind[1020]: Removed session 59. May 25 03:27:41 oleg113-client sshd[17520]: Accepted publickey for root from 192.168.201.13 port 57126 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:41 oleg113-client systemd-logind[1020]: New session 60 of user root. May 25 03:27:41 oleg113-client systemd[1]: Started Session 60 of user root. May 25 03:27:42 oleg113-client sshd[17520]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:42 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10e: re-send BL AST vs reconnect race 2 ========================================================== 03:27:40 (1779694060) May 25 03:27:42 oleg113-client sshd[17534]: Received disconnect from 192.168.201.13 port 57126:11: disconnected by user May 25 03:27:42 oleg113-client sshd[17534]: Disconnected from user root 192.168.201.13 port 57126 May 25 03:27:42 oleg113-client sshd[17520]: pam_unix(sshd:session): session closed for user root May 25 03:27:42 oleg113-client systemd[1]: session-60.scope: Succeeded. May 25 03:27:42 oleg113-client systemd-logind[1020]: Session 60 logged out. Waiting for processes to exit. May 25 03:27:42 oleg113-client systemd-logind[1020]: Removed session 60. May 25 03:27:44 oleg113-client sshd[17662]: Accepted publickey for root from 192.168.201.13 port 57128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:44 oleg113-client systemd-logind[1020]: New session 61 of user root. May 25 03:27:44 oleg113-client systemd[1]: Started Session 61 of user root. May 25 03:27:44 oleg113-client sshd[17662]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:45 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_10e need two clients May 25 03:27:45 oleg113-client sshd[17675]: Received disconnect from 192.168.201.13 port 57128:11: disconnected by user May 25 03:27:45 oleg113-client sshd[17675]: Disconnected from user root 192.168.201.13 port 57128 May 25 03:27:45 oleg113-client sshd[17662]: pam_unix(sshd:session): session closed for user root May 25 03:27:45 oleg113-client systemd[1]: session-61.scope: Succeeded. May 25 03:27:45 oleg113-client systemd-logind[1020]: Session 61 logged out. Waiting for processes to exit. May 25 03:27:45 oleg113-client systemd-logind[1020]: Removed session 61. May 25 03:27:46 oleg113-client sshd[17816]: Accepted publickey for root from 192.168.201.13 port 57144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:27:47 oleg113-client systemd[1]: Started Session 62 of user root. May 25 03:27:47 oleg113-client systemd-logind[1020]: New session 62 of user root. May 25 03:27:47 oleg113-client sshd[17816]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:27:47 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 11: wake up a thread waiting for completion after eviction (b=2460) ========================================================== 03:27:45 (1779694065) May 25 03:27:47 oleg113-client sshd[17829]: Received disconnect from 192.168.201.13 port 57144:11: disconnected by user May 25 03:27:47 oleg113-client sshd[17829]: Disconnected from user root 192.168.201.13 port 57144 May 25 03:27:47 oleg113-client sshd[17816]: pam_unix(sshd:session): session closed for user root May 25 03:27:47 oleg113-client systemd[1]: session-62.scope: Succeeded. May 25 03:27:47 oleg113-client systemd-logind[1020]: Session 62 logged out. Waiting for processes to exit. May 25 03:27:47 oleg113-client systemd-logind[1020]: Removed session 62. May 25 03:27:48 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:27:48 oleg113-client kernel: Lustre: Skipped 2 previous similar messages May 25 03:28:07 oleg113-client sshd[17939]: Accepted publickey for root from 192.168.201.13 port 54160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:07 oleg113-client systemd-logind[1020]: New session 63 of user root. May 25 03:28:07 oleg113-client systemd[1]: Started Session 63 of user root. May 25 03:28:07 oleg113-client sshd[17939]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:07 oleg113-client sshd[17952]: Received disconnect from 192.168.201.13 port 54160:11: disconnected by user May 25 03:28:07 oleg113-client sshd[17952]: Disconnected from user root 192.168.201.13 port 54160 May 25 03:28:07 oleg113-client sshd[17939]: pam_unix(sshd:session): session closed for user root May 25 03:28:08 oleg113-client systemd-logind[1020]: Session 63 logged out. Waiting for processes to exit. May 25 03:28:08 oleg113-client systemd[1]: session-63.scope: Succeeded. May 25 03:28:08 oleg113-client systemd-logind[1020]: Removed session 63. May 25 03:28:09 oleg113-client sshd[18071]: Accepted publickey for root from 192.168.201.13 port 33402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:09 oleg113-client systemd-logind[1020]: New session 64 of user root. May 25 03:28:09 oleg113-client systemd[1]: Started Session 64 of user root. May 25 03:28:09 oleg113-client sshd[18071]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:09 oleg113-client sshd[18084]: Received disconnect from 192.168.201.13 port 33402:11: disconnected by user May 25 03:28:09 oleg113-client sshd[18084]: Disconnected from user root 192.168.201.13 port 33402 May 25 03:28:09 oleg113-client sshd[18071]: pam_unix(sshd:session): session closed for user root May 25 03:28:10 oleg113-client systemd[1]: session-64.scope: Succeeded. May 25 03:28:10 oleg113-client systemd-logind[1020]: Session 64 logged out. Waiting for processes to exit. May 25 03:28:10 oleg113-client systemd-logind[1020]: Removed session 64. May 25 03:28:12 oleg113-client sshd[18210]: Accepted publickey for root from 192.168.201.13 port 33418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:13 oleg113-client systemd-logind[1020]: New session 65 of user root. May 25 03:28:13 oleg113-client systemd[1]: Started Session 65 of user root. May 25 03:28:13 oleg113-client sshd[18210]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:13 oleg113-client sshd[18223]: Received disconnect from 192.168.201.13 port 33418:11: disconnected by user May 25 03:28:13 oleg113-client sshd[18223]: Disconnected from user root 192.168.201.13 port 33418 May 25 03:28:13 oleg113-client sshd[18210]: pam_unix(sshd:session): session closed for user root May 25 03:28:13 oleg113-client systemd-logind[1020]: Session 65 logged out. Waiting for processes to exit. May 25 03:28:13 oleg113-client systemd[1]: session-65.scope: Succeeded. May 25 03:28:13 oleg113-client systemd-logind[1020]: Removed session 65. May 25 03:28:15 oleg113-client sshd[18357]: Accepted publickey for root from 192.168.201.13 port 33424 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:15 oleg113-client systemd-logind[1020]: New session 66 of user root. May 25 03:28:15 oleg113-client systemd[1]: Started Session 66 of user root. May 25 03:28:15 oleg113-client sshd[18357]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:16 oleg113-client sshd[18370]: Received disconnect from 192.168.201.13 port 33424:11: disconnected by user May 25 03:28:16 oleg113-client sshd[18370]: Disconnected from user root 192.168.201.13 port 33424 May 25 03:28:16 oleg113-client sshd[18357]: pam_unix(sshd:session): session closed for user root May 25 03:28:16 oleg113-client systemd-logind[1020]: Session 66 logged out. Waiting for processes to exit. May 25 03:28:16 oleg113-client systemd[1]: session-66.scope: Succeeded. May 25 03:28:16 oleg113-client systemd-logind[1020]: Removed session 66. May 25 03:28:19 oleg113-client sshd[18512]: Accepted publickey for root from 192.168.201.13 port 33434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:19 oleg113-client systemd-logind[1020]: New session 67 of user root. May 25 03:28:19 oleg113-client systemd[1]: Started Session 67 of user root. May 25 03:28:19 oleg113-client sshd[18512]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:20 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 12: recover from timed out resend in ptlrpcd (b=2494) ========================================================== 03:28:17 (1779694097) May 25 03:28:20 oleg113-client sshd[18525]: Received disconnect from 192.168.201.13 port 33434:11: disconnected by user May 25 03:28:20 oleg113-client sshd[18525]: Disconnected from user root 192.168.201.13 port 33434 May 25 03:28:20 oleg113-client sshd[18512]: pam_unix(sshd:session): session closed for user root May 25 03:28:20 oleg113-client systemd[1]: session-67.scope: Succeeded. May 25 03:28:20 oleg113-client systemd-logind[1020]: Session 67 logged out. Waiting for processes to exit. May 25 03:28:20 oleg113-client systemd-logind[1020]: Removed session 67. May 25 03:28:20 oleg113-client kernel: Lustre: DEBUG MARKER: multiop /mnt/lustre/f12.recovery-small OS_c May 25 03:28:38 oleg113-client kernel: Lustre: 18573:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694102/real 1779694102] req@ffff9b15d077aa00 x1866143484752384/t0(0) o35->lustre-MDT0000-mdc-ffff9b15c64bc800@192.168.201.113@tcp:23/10 lens 392/624 e 0 to 1 dl 1779694118 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 May 25 03:28:38 oleg113-client kernel: Lustre: 18573:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 3 previous similar messages May 25 03:28:40 oleg113-client sshd[18591]: Accepted publickey for root from 192.168.201.13 port 41052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:40 oleg113-client systemd-logind[1020]: New session 68 of user root. May 25 03:28:40 oleg113-client systemd[1]: Started Session 68 of user root. May 25 03:28:40 oleg113-client sshd[18591]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:41 oleg113-client sshd[18604]: Received disconnect from 192.168.201.13 port 41052:11: disconnected by user May 25 03:28:41 oleg113-client sshd[18604]: Disconnected from user root 192.168.201.13 port 41052 May 25 03:28:41 oleg113-client sshd[18591]: pam_unix(sshd:session): session closed for user root May 25 03:28:41 oleg113-client systemd[1]: session-68.scope: Succeeded. May 25 03:28:41 oleg113-client systemd-logind[1020]: Session 68 logged out. Waiting for processes to exit. May 25 03:28:41 oleg113-client systemd-logind[1020]: Removed session 68. May 25 03:28:42 oleg113-client sshd[18723]: Accepted publickey for root from 192.168.201.13 port 41064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:42 oleg113-client systemd-logind[1020]: New session 69 of user root. May 25 03:28:42 oleg113-client systemd[1]: Started Session 69 of user root. May 25 03:28:42 oleg113-client sshd[18723]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:43 oleg113-client sshd[18736]: Received disconnect from 192.168.201.13 port 41064:11: disconnected by user May 25 03:28:43 oleg113-client sshd[18736]: Disconnected from user root 192.168.201.13 port 41064 May 25 03:28:43 oleg113-client sshd[18723]: pam_unix(sshd:session): session closed for user root May 25 03:28:43 oleg113-client systemd-logind[1020]: Session 69 logged out. Waiting for processes to exit. May 25 03:28:43 oleg113-client systemd[1]: session-69.scope: Succeeded. May 25 03:28:43 oleg113-client systemd-logind[1020]: Removed session 69. May 25 03:28:46 oleg113-client sshd[18863]: Accepted publickey for root from 192.168.201.13 port 41072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:46 oleg113-client systemd[1]: Started Session 70 of user root. May 25 03:28:46 oleg113-client systemd-logind[1020]: New session 70 of user root. May 25 03:28:46 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:28:46 oleg113-client sshd[18863]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:46 oleg113-client sshd[18877]: Received disconnect from 192.168.201.13 port 41072:11: disconnected by user May 25 03:28:46 oleg113-client sshd[18877]: Disconnected from user root 192.168.201.13 port 41072 May 25 03:28:47 oleg113-client sshd[18863]: pam_unix(sshd:session): session closed for user root May 25 03:28:47 oleg113-client systemd[1]: session-70.scope: Succeeded. May 25 03:28:47 oleg113-client systemd-logind[1020]: Session 70 logged out. Waiting for processes to exit. May 25 03:28:47 oleg113-client systemd-logind[1020]: Removed session 70. May 25 03:28:49 oleg113-client sshd[19010]: Accepted publickey for root from 192.168.201.13 port 41084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:28:49 oleg113-client systemd-logind[1020]: New session 71 of user root. May 25 03:28:49 oleg113-client systemd[1]: Started Session 71 of user root. May 25 03:28:49 oleg113-client sshd[19010]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:28:50 oleg113-client sshd[19023]: Received disconnect from 192.168.201.13 port 41084:11: disconnected by user May 25 03:28:50 oleg113-client sshd[19023]: Disconnected from user root 192.168.201.13 port 41084 May 25 03:28:50 oleg113-client sshd[19010]: pam_unix(sshd:session): session closed for user root May 25 03:28:50 oleg113-client systemd[1]: session-71.scope: Succeeded. May 25 03:28:50 oleg113-client systemd-logind[1020]: Session 71 logged out. Waiting for processes to exit. May 25 03:28:50 oleg113-client systemd-logind[1020]: Removed session 71. May 25 03:29:06 oleg113-client sshd[19177]: Accepted publickey for root from 192.168.201.13 port 33518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:06 oleg113-client systemd-logind[1020]: New session 72 of user root. May 25 03:29:06 oleg113-client systemd[1]: Started Session 72 of user root. May 25 03:29:06 oleg113-client sshd[19177]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:07 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 13: mdc_readpage restart test (bug 1138) ========================================================== 03:29:04 (1779694144) May 25 03:29:07 oleg113-client sshd[19190]: Received disconnect from 192.168.201.13 port 33518:11: disconnected by user May 25 03:29:07 oleg113-client sshd[19190]: Disconnected from user root 192.168.201.13 port 33518 May 25 03:29:07 oleg113-client sshd[19177]: pam_unix(sshd:session): session closed for user root May 25 03:29:07 oleg113-client systemd-logind[1020]: Session 72 logged out. Waiting for processes to exit. May 25 03:29:07 oleg113-client systemd[1]: session-72.scope: Succeeded. May 25 03:29:07 oleg113-client systemd-logind[1020]: Removed session 72. May 25 03:29:30 oleg113-client sshd[19336]: Accepted publickey for root from 192.168.201.13 port 39142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:30 oleg113-client systemd[1]: Started Session 73 of user root. May 25 03:29:30 oleg113-client systemd-logind[1020]: New session 73 of user root. May 25 03:29:30 oleg113-client sshd[19336]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:30 oleg113-client sshd[19349]: Received disconnect from 192.168.201.13 port 39142:11: disconnected by user May 25 03:29:30 oleg113-client sshd[19349]: Disconnected from user root 192.168.201.13 port 39142 May 25 03:29:30 oleg113-client sshd[19336]: pam_unix(sshd:session): session closed for user root May 25 03:29:30 oleg113-client systemd[1]: session-73.scope: Succeeded. May 25 03:29:30 oleg113-client systemd-logind[1020]: Session 73 logged out. Waiting for processes to exit. May 25 03:29:30 oleg113-client systemd-logind[1020]: Removed session 73. May 25 03:29:32 oleg113-client sshd[19475]: Accepted publickey for root from 192.168.201.13 port 39158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:32 oleg113-client systemd-logind[1020]: New session 74 of user root. May 25 03:29:32 oleg113-client systemd[1]: Started Session 74 of user root. May 25 03:29:32 oleg113-client sshd[19475]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:33 oleg113-client sshd[19488]: Received disconnect from 192.168.201.13 port 39158:11: disconnected by user May 25 03:29:33 oleg113-client sshd[19488]: Disconnected from user root 192.168.201.13 port 39158 May 25 03:29:33 oleg113-client sshd[19475]: pam_unix(sshd:session): session closed for user root May 25 03:29:33 oleg113-client systemd-logind[1020]: Session 74 logged out. Waiting for processes to exit. May 25 03:29:33 oleg113-client systemd[1]: session-74.scope: Succeeded. May 25 03:29:33 oleg113-client systemd-logind[1020]: Removed session 74. May 25 03:29:34 oleg113-client sshd[19622]: Accepted publickey for root from 192.168.201.13 port 39168 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:35 oleg113-client systemd-logind[1020]: New session 75 of user root. May 25 03:29:35 oleg113-client systemd[1]: Started Session 75 of user root. May 25 03:29:35 oleg113-client sshd[19622]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:35 oleg113-client sshd[19635]: Received disconnect from 192.168.201.13 port 39168:11: disconnected by user May 25 03:29:35 oleg113-client sshd[19635]: Disconnected from user root 192.168.201.13 port 39168 May 25 03:29:35 oleg113-client sshd[19622]: pam_unix(sshd:session): session closed for user root May 25 03:29:35 oleg113-client systemd[1]: session-75.scope: Succeeded. May 25 03:29:35 oleg113-client systemd-logind[1020]: Session 75 logged out. Waiting for processes to exit. May 25 03:29:35 oleg113-client systemd-logind[1020]: Removed session 75. May 25 03:29:38 oleg113-client sshd[19777]: Accepted publickey for root from 192.168.201.13 port 39184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:38 oleg113-client systemd[1]: Started Session 76 of user root. May 25 03:29:38 oleg113-client systemd-logind[1020]: New session 76 of user root. May 25 03:29:38 oleg113-client sshd[19777]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:38 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 14: mdc_readpage resend test (bug 1138) ========================================================== 03:29:36 (1779694176) May 25 03:29:38 oleg113-client sshd[19790]: Received disconnect from 192.168.201.13 port 39184:11: disconnected by user May 25 03:29:38 oleg113-client sshd[19790]: Disconnected from user root 192.168.201.13 port 39184 May 25 03:29:38 oleg113-client sshd[19777]: pam_unix(sshd:session): session closed for user root May 25 03:29:38 oleg113-client systemd[1]: session-76.scope: Succeeded. May 25 03:29:38 oleg113-client systemd-logind[1020]: Session 76 logged out. Waiting for processes to exit. May 25 03:29:39 oleg113-client systemd-logind[1020]: Removed session 76. May 25 03:29:43 oleg113-client sshd[19931]: Accepted publickey for root from 192.168.201.13 port 34578 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:43 oleg113-client systemd-logind[1020]: New session 77 of user root. May 25 03:29:43 oleg113-client systemd[1]: Started Session 77 of user root. May 25 03:29:43 oleg113-client sshd[19931]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:44 oleg113-client sshd[19944]: Received disconnect from 192.168.201.13 port 34578:11: disconnected by user May 25 03:29:44 oleg113-client sshd[19944]: Disconnected from user root 192.168.201.13 port 34578 May 25 03:29:44 oleg113-client sshd[19931]: pam_unix(sshd:session): session closed for user root May 25 03:29:44 oleg113-client systemd-logind[1020]: Session 77 logged out. Waiting for processes to exit. May 25 03:29:44 oleg113-client systemd[1]: session-77.scope: Succeeded. May 25 03:29:44 oleg113-client systemd-logind[1020]: Removed session 77. May 25 03:29:46 oleg113-client sshd[20070]: Accepted publickey for root from 192.168.201.13 port 34586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:46 oleg113-client systemd[1]: Started Session 78 of user root. May 25 03:29:46 oleg113-client systemd-logind[1020]: New session 78 of user root. May 25 03:29:46 oleg113-client sshd[20070]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:46 oleg113-client sshd[20083]: Received disconnect from 192.168.201.13 port 34586:11: disconnected by user May 25 03:29:46 oleg113-client sshd[20083]: Disconnected from user root 192.168.201.13 port 34586 May 25 03:29:46 oleg113-client sshd[20070]: pam_unix(sshd:session): session closed for user root May 25 03:29:47 oleg113-client systemd[1]: session-78.scope: Succeeded. May 25 03:29:47 oleg113-client systemd-logind[1020]: Session 78 logged out. Waiting for processes to exit. May 25 03:29:47 oleg113-client systemd-logind[1020]: Removed session 78. May 25 03:29:48 oleg113-client sshd[20217]: Accepted publickey for root from 192.168.201.13 port 34600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:48 oleg113-client systemd-logind[1020]: New session 79 of user root. May 25 03:29:48 oleg113-client systemd[1]: Started Session 79 of user root. May 25 03:29:48 oleg113-client sshd[20217]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:49 oleg113-client sshd[20230]: Received disconnect from 192.168.201.13 port 34600:11: disconnected by user May 25 03:29:49 oleg113-client sshd[20230]: Disconnected from user root 192.168.201.13 port 34600 May 25 03:29:49 oleg113-client sshd[20217]: pam_unix(sshd:session): session closed for user root May 25 03:29:49 oleg113-client systemd[1]: session-79.scope: Succeeded. May 25 03:29:49 oleg113-client systemd-logind[1020]: Session 79 logged out. Waiting for processes to exit. May 25 03:29:49 oleg113-client systemd-logind[1020]: Removed session 79. May 25 03:29:51 oleg113-client sshd[20372]: Accepted publickey for root from 192.168.201.13 port 33728 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:51 oleg113-client systemd[1]: Started Session 80 of user root. May 25 03:29:51 oleg113-client systemd-logind[1020]: New session 80 of user root. May 25 03:29:51 oleg113-client sshd[20372]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:52 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 15: failed open (-ENOMEM) ========= 03:29:49 (1779694189) May 25 03:29:52 oleg113-client sshd[20385]: Received disconnect from 192.168.201.13 port 33728:11: disconnected by user May 25 03:29:52 oleg113-client sshd[20385]: Disconnected from user root 192.168.201.13 port 33728 May 25 03:29:52 oleg113-client sshd[20372]: pam_unix(sshd:session): session closed for user root May 25 03:29:52 oleg113-client systemd[1]: session-80.scope: Succeeded. May 25 03:29:52 oleg113-client systemd-logind[1020]: Session 80 logged out. Waiting for processes to exit. May 25 03:29:52 oleg113-client systemd-logind[1020]: Removed session 80. May 25 03:29:55 oleg113-client sshd[20516]: Accepted publickey for root from 192.168.201.13 port 33732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:55 oleg113-client systemd-logind[1020]: New session 81 of user root. May 25 03:29:55 oleg113-client systemd[1]: Started Session 81 of user root. May 25 03:29:55 oleg113-client sshd[20516]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:56 oleg113-client sshd[20529]: Received disconnect from 192.168.201.13 port 33732:11: disconnected by user May 25 03:29:56 oleg113-client sshd[20529]: Disconnected from user root 192.168.201.13 port 33732 May 25 03:29:56 oleg113-client sshd[20516]: pam_unix(sshd:session): session closed for user root May 25 03:29:56 oleg113-client systemd[1]: session-81.scope: Succeeded. May 25 03:29:56 oleg113-client systemd-logind[1020]: Session 81 logged out. Waiting for processes to exit. May 25 03:29:56 oleg113-client systemd-logind[1020]: Removed session 81. May 25 03:29:58 oleg113-client sshd[20655]: Accepted publickey for root from 192.168.201.13 port 33738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:29:58 oleg113-client systemd[1]: Started Session 82 of user root. May 25 03:29:58 oleg113-client systemd-logind[1020]: New session 82 of user root. May 25 03:29:58 oleg113-client sshd[20655]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:29:58 oleg113-client sshd[20668]: Received disconnect from 192.168.201.13 port 33738:11: disconnected by user May 25 03:29:58 oleg113-client sshd[20668]: Disconnected from user root 192.168.201.13 port 33738 May 25 03:29:58 oleg113-client sshd[20655]: pam_unix(sshd:session): session closed for user root May 25 03:29:59 oleg113-client systemd-logind[1020]: Session 82 logged out. Waiting for processes to exit. May 25 03:29:59 oleg113-client systemd[1]: session-82.scope: Succeeded. May 25 03:29:59 oleg113-client systemd-logind[1020]: Removed session 82. May 25 03:30:00 oleg113-client sshd[20801]: Accepted publickey for root from 192.168.201.13 port 38960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:00 oleg113-client systemd[1]: Started Session 83 of user root. May 25 03:30:00 oleg113-client systemd-logind[1020]: New session 83 of user root. May 25 03:30:00 oleg113-client sshd[20801]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:00 oleg113-client sshd[20814]: Received disconnect from 192.168.201.13 port 38960:11: disconnected by user May 25 03:30:00 oleg113-client sshd[20814]: Disconnected from user root 192.168.201.13 port 38960 May 25 03:30:01 oleg113-client sshd[20801]: pam_unix(sshd:session): session closed for user root May 25 03:30:01 oleg113-client systemd[1]: session-83.scope: Succeeded. May 25 03:30:01 oleg113-client systemd-logind[1020]: Session 83 logged out. Waiting for processes to exit. May 25 03:30:01 oleg113-client systemd-logind[1020]: Removed session 83. May 25 03:30:03 oleg113-client sshd[20960]: Accepted publickey for root from 192.168.201.13 port 38972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:03 oleg113-client systemd-logind[1020]: New session 84 of user root. May 25 03:30:03 oleg113-client systemd[1]: Started Session 84 of user root. May 25 03:30:03 oleg113-client sshd[20960]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:03 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 16: timeout bulk put, don't evict client (2732) ========================================================== 03:30:01 (1779694201) May 25 03:30:03 oleg113-client sshd[20973]: Received disconnect from 192.168.201.13 port 38972:11: disconnected by user May 25 03:30:03 oleg113-client sshd[20973]: Disconnected from user root 192.168.201.13 port 38972 May 25 03:30:03 oleg113-client sshd[20960]: pam_unix(sshd:session): session closed for user root May 25 03:30:04 oleg113-client systemd[1]: session-84.scope: Succeeded. May 25 03:30:04 oleg113-client systemd-logind[1020]: Session 84 logged out. Waiting for processes to exit. May 25 03:30:04 oleg113-client systemd-logind[1020]: Removed session 84. May 25 03:30:47 oleg113-client sshd[21182]: Accepted publickey for root from 192.168.201.13 port 36718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:47 oleg113-client systemd-logind[1020]: New session 85 of user root. May 25 03:30:47 oleg113-client systemd[1]: Started Session 85 of user root. May 25 03:30:47 oleg113-client sshd[21182]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:47 oleg113-client sshd[21195]: Received disconnect from 192.168.201.13 port 36718:11: disconnected by user May 25 03:30:47 oleg113-client sshd[21195]: Disconnected from user root 192.168.201.13 port 36718 May 25 03:30:47 oleg113-client sshd[21182]: pam_unix(sshd:session): session closed for user root May 25 03:30:48 oleg113-client systemd[1]: session-85.scope: Succeeded. May 25 03:30:48 oleg113-client systemd-logind[1020]: Session 85 logged out. Waiting for processes to exit. May 25 03:30:48 oleg113-client systemd-logind[1020]: Removed session 85. May 25 03:30:50 oleg113-client sshd[21321]: Accepted publickey for root from 192.168.201.13 port 46244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:50 oleg113-client systemd-logind[1020]: New session 86 of user root. May 25 03:30:50 oleg113-client systemd[1]: Started Session 86 of user root. May 25 03:30:50 oleg113-client sshd[21321]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:51 oleg113-client sshd[21334]: Received disconnect from 192.168.201.13 port 46244:11: disconnected by user May 25 03:30:51 oleg113-client sshd[21334]: Disconnected from user root 192.168.201.13 port 46244 May 25 03:30:51 oleg113-client sshd[21321]: pam_unix(sshd:session): session closed for user root May 25 03:30:51 oleg113-client systemd[1]: session-86.scope: Succeeded. May 25 03:30:51 oleg113-client systemd-logind[1020]: Session 86 logged out. Waiting for processes to exit. May 25 03:30:51 oleg113-client systemd-logind[1020]: Removed session 86. May 25 03:30:53 oleg113-client sshd[21469]: Accepted publickey for root from 192.168.201.13 port 46250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:53 oleg113-client systemd-logind[1020]: New session 87 of user root. May 25 03:30:53 oleg113-client systemd[1]: Started Session 87 of user root. May 25 03:30:53 oleg113-client sshd[21469]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:53 oleg113-client sshd[21482]: Received disconnect from 192.168.201.13 port 46250:11: disconnected by user May 25 03:30:54 oleg113-client sshd[21482]: Disconnected from user root 192.168.201.13 port 46250 May 25 03:30:54 oleg113-client sshd[21469]: pam_unix(sshd:session): session closed for user root May 25 03:30:54 oleg113-client systemd[1]: session-87.scope: Succeeded. May 25 03:30:54 oleg113-client systemd-logind[1020]: Session 87 logged out. Waiting for processes to exit. May 25 03:30:54 oleg113-client systemd-logind[1020]: Removed session 87. May 25 03:30:56 oleg113-client sshd[21624]: Accepted publickey for root from 192.168.201.13 port 46262 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:30:56 oleg113-client systemd[1]: Started Session 88 of user root. May 25 03:30:56 oleg113-client systemd-logind[1020]: New session 88 of user root. May 25 03:30:56 oleg113-client sshd[21624]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:30:56 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17a: timeout bulk get, don't evict client (2732) ========================================================== 03:30:54 (1779694254) May 25 03:30:56 oleg113-client sshd[21637]: Received disconnect from 192.168.201.13 port 46262:11: disconnected by user May 25 03:30:56 oleg113-client sshd[21637]: Disconnected from user root 192.168.201.13 port 46262 May 25 03:30:56 oleg113-client sshd[21624]: pam_unix(sshd:session): session closed for user root May 25 03:30:56 oleg113-client systemd[1]: session-88.scope: Succeeded. May 25 03:30:56 oleg113-client systemd-logind[1020]: Session 88 logged out. Waiting for processes to exit. May 25 03:30:56 oleg113-client systemd-logind[1020]: Removed session 88. May 25 03:31:51 oleg113-client sshd[21980]: Accepted publickey for root from 192.168.201.13 port 46912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:51 oleg113-client systemd-logind[1020]: New session 89 of user root. May 25 03:31:51 oleg113-client systemd[1]: Started Session 89 of user root. May 25 03:31:51 oleg113-client sshd[21980]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:52 oleg113-client sshd[21993]: Received disconnect from 192.168.201.13 port 46912:11: disconnected by user May 25 03:31:52 oleg113-client sshd[21993]: Disconnected from user root 192.168.201.13 port 46912 May 25 03:31:52 oleg113-client sshd[21980]: pam_unix(sshd:session): session closed for user root May 25 03:31:52 oleg113-client systemd-logind[1020]: Session 89 logged out. Waiting for processes to exit. May 25 03:31:52 oleg113-client systemd[1]: session-89.scope: Succeeded. May 25 03:31:52 oleg113-client systemd-logind[1020]: Removed session 89. May 25 03:31:54 oleg113-client sshd[22119]: Accepted publickey for root from 192.168.201.13 port 46926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:54 oleg113-client systemd-logind[1020]: New session 90 of user root. May 25 03:31:54 oleg113-client systemd[1]: Started Session 90 of user root. May 25 03:31:54 oleg113-client sshd[22119]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:54 oleg113-client sshd[22132]: Received disconnect from 192.168.201.13 port 46926:11: disconnected by user May 25 03:31:54 oleg113-client sshd[22132]: Disconnected from user root 192.168.201.13 port 46926 May 25 03:31:55 oleg113-client sshd[22119]: pam_unix(sshd:session): session closed for user root May 25 03:31:55 oleg113-client systemd-logind[1020]: Session 90 logged out. Waiting for processes to exit. May 25 03:31:55 oleg113-client systemd[1]: session-90.scope: Succeeded. May 25 03:31:55 oleg113-client systemd-logind[1020]: Removed session 90. May 25 03:31:56 oleg113-client sshd[22266]: Accepted publickey for root from 192.168.201.13 port 46928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:56 oleg113-client systemd-logind[1020]: New session 91 of user root. May 25 03:31:56 oleg113-client systemd[1]: Started Session 91 of user root. May 25 03:31:56 oleg113-client sshd[22266]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:57 oleg113-client sshd[22279]: Received disconnect from 192.168.201.13 port 46928:11: disconnected by user May 25 03:31:57 oleg113-client sshd[22279]: Disconnected from user root 192.168.201.13 port 46928 May 25 03:31:57 oleg113-client sshd[22266]: pam_unix(sshd:session): session closed for user root May 25 03:31:57 oleg113-client systemd-logind[1020]: Session 91 logged out. Waiting for processes to exit. May 25 03:31:57 oleg113-client systemd[1]: session-91.scope: Succeeded. May 25 03:31:57 oleg113-client systemd-logind[1020]: Removed session 91. May 25 03:31:59 oleg113-client sshd[22421]: Accepted publickey for root from 192.168.201.13 port 56852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:31:59 oleg113-client systemd[1]: Started Session 92 of user root. May 25 03:31:59 oleg113-client systemd-logind[1020]: New session 92 of user root. May 25 03:31:59 oleg113-client sshd[22421]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:31:59 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17b: timeout bulk get, dont evict client (3582) ========================================================== 03:31:57 (1779694317) May 25 03:31:59 oleg113-client sshd[22434]: Received disconnect from 192.168.201.13 port 56852:11: disconnected by user May 25 03:31:59 oleg113-client sshd[22434]: Disconnected from user root 192.168.201.13 port 56852 May 25 03:31:59 oleg113-client sshd[22421]: pam_unix(sshd:session): session closed for user root May 25 03:32:00 oleg113-client systemd-logind[1020]: Session 92 logged out. Waiting for processes to exit. May 25 03:32:00 oleg113-client systemd[1]: session-92.scope: Succeeded. May 25 03:32:00 oleg113-client systemd-logind[1020]: Removed session 92. May 25 03:32:01 oleg113-client sshd[22560]: Accepted publickey for root from 192.168.201.13 port 56858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:01 oleg113-client systemd-logind[1020]: New session 93 of user root. May 25 03:32:01 oleg113-client systemd[1]: Started Session 93 of user root. May 25 03:32:01 oleg113-client sshd[22560]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:02 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_17b Needs multiple clients May 25 03:32:02 oleg113-client sshd[22573]: Received disconnect from 192.168.201.13 port 56858:11: disconnected by user May 25 03:32:02 oleg113-client sshd[22573]: Disconnected from user root 192.168.201.13 port 56858 May 25 03:32:02 oleg113-client sshd[22560]: pam_unix(sshd:session): session closed for user root May 25 03:32:02 oleg113-client systemd-logind[1020]: Session 93 logged out. Waiting for processes to exit. May 25 03:32:02 oleg113-client systemd[1]: session-93.scope: Succeeded. May 25 03:32:02 oleg113-client systemd-logind[1020]: Removed session 93. May 25 03:32:03 oleg113-client sshd[22714]: Accepted publickey for root from 192.168.201.13 port 56868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:04 oleg113-client systemd[1]: Started Session 94 of user root. May 25 03:32:04 oleg113-client systemd-logind[1020]: New session 94 of user root. May 25 03:32:04 oleg113-client sshd[22714]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18a: manual ost invalidate clears page cache immediately ========================================================== 03:32:02 (1779694322) May 25 03:32:04 oleg113-client sshd[22727]: Received disconnect from 192.168.201.13 port 56868:11: disconnected by user May 25 03:32:04 oleg113-client sshd[22727]: Disconnected from user root 192.168.201.13 port 56868 May 25 03:32:04 oleg113-client sshd[22714]: pam_unix(sshd:session): session closed for user root May 25 03:32:04 oleg113-client systemd[1]: session-94.scope: Succeeded. May 25 03:32:04 oleg113-client systemd-logind[1020]: Session 94 logged out. Waiting for processes to exit. May 25 03:32:04 oleg113-client systemd-logind[1020]: Removed session 94. May 25 03:32:06 oleg113-client kernel: Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request May 25 03:32:06 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c64bc800: Connection to lustre-OST0001 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:32:06 oleg113-client kernel: Lustre: Skipped 5 previous similar messages May 25 03:32:06 oleg113-client kernel: LustreError: lustre-OST0001-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0001; in progress operations using this service will fail. May 25 03:32:06 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c64bc800: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:32:06 oleg113-client kernel: Lustre: Skipped 4 previous similar messages May 25 03:32:07 oleg113-client sshd[22893]: Accepted publickey for root from 192.168.201.13 port 56878 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:07 oleg113-client systemd-logind[1020]: New session 95 of user root. May 25 03:32:07 oleg113-client systemd[1]: Started Session 95 of user root. May 25 03:32:08 oleg113-client sshd[22893]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:08 oleg113-client sshd[22906]: Received disconnect from 192.168.201.13 port 56878:11: disconnected by user May 25 03:32:08 oleg113-client sshd[22906]: Disconnected from user root 192.168.201.13 port 56878 May 25 03:32:08 oleg113-client sshd[22893]: pam_unix(sshd:session): session closed for user root May 25 03:32:08 oleg113-client systemd[1]: session-95.scope: Succeeded. May 25 03:32:08 oleg113-client systemd-logind[1020]: Session 95 logged out. Waiting for processes to exit. May 25 03:32:08 oleg113-client systemd-logind[1020]: Removed session 95. May 25 03:32:10 oleg113-client sshd[23032]: Accepted publickey for root from 192.168.201.13 port 58358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:10 oleg113-client systemd[1]: Started Session 96 of user root. May 25 03:32:10 oleg113-client systemd-logind[1020]: New session 96 of user root. May 25 03:32:10 oleg113-client sshd[23032]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:11 oleg113-client sshd[23045]: Received disconnect from 192.168.201.13 port 58358:11: disconnected by user May 25 03:32:11 oleg113-client sshd[23045]: Disconnected from user root 192.168.201.13 port 58358 May 25 03:32:11 oleg113-client sshd[23032]: pam_unix(sshd:session): session closed for user root May 25 03:32:11 oleg113-client systemd[1]: session-96.scope: Succeeded. May 25 03:32:11 oleg113-client systemd-logind[1020]: Session 96 logged out. Waiting for processes to exit. May 25 03:32:11 oleg113-client systemd-logind[1020]: Removed session 96. May 25 03:32:12 oleg113-client sshd[23179]: Accepted publickey for root from 192.168.201.13 port 58372 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:12 oleg113-client systemd-logind[1020]: New session 97 of user root. May 25 03:32:12 oleg113-client systemd[1]: Started Session 97 of user root. May 25 03:32:12 oleg113-client sshd[23179]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:13 oleg113-client sshd[23192]: Received disconnect from 192.168.201.13 port 58372:11: disconnected by user May 25 03:32:13 oleg113-client sshd[23192]: Disconnected from user root 192.168.201.13 port 58372 May 25 03:32:13 oleg113-client sshd[23179]: pam_unix(sshd:session): session closed for user root May 25 03:32:13 oleg113-client systemd[1]: session-97.scope: Succeeded. May 25 03:32:13 oleg113-client systemd-logind[1020]: Session 97 logged out. Waiting for processes to exit. May 25 03:32:13 oleg113-client systemd-logind[1020]: Removed session 97. May 25 03:32:15 oleg113-client sshd[23334]: Accepted publickey for root from 192.168.201.13 port 58374 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:15 oleg113-client systemd[1]: Started Session 98 of user root. May 25 03:32:15 oleg113-client systemd-logind[1020]: New session 98 of user root. May 25 03:32:15 oleg113-client sshd[23334]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:15 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18b: eviction and reconnect clears page cache (2766) ========================================================== 03:32:14 (1779694334) May 25 03:32:15 oleg113-client sshd[23347]: Received disconnect from 192.168.201.13 port 58374:11: disconnected by user May 25 03:32:15 oleg113-client sshd[23347]: Disconnected from user root 192.168.201.13 port 58374 May 25 03:32:15 oleg113-client sshd[23334]: pam_unix(sshd:session): session closed for user root May 25 03:32:16 oleg113-client systemd[1]: session-98.scope: Succeeded. May 25 03:32:16 oleg113-client systemd-logind[1020]: Session 98 logged out. Waiting for processes to exit. May 25 03:32:16 oleg113-client systemd-logind[1020]: Removed session 98. May 25 03:32:20 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:32:43 oleg113-client sshd[23552]: Accepted publickey for root from 192.168.201.13 port 59594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:43 oleg113-client systemd-logind[1020]: New session 99 of user root. May 25 03:32:43 oleg113-client systemd[1]: Started Session 99 of user root. May 25 03:32:43 oleg113-client sshd[23552]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:43 oleg113-client sshd[23565]: Received disconnect from 192.168.201.13 port 59594:11: disconnected by user May 25 03:32:43 oleg113-client sshd[23565]: Disconnected from user root 192.168.201.13 port 59594 May 25 03:32:43 oleg113-client sshd[23552]: pam_unix(sshd:session): session closed for user root May 25 03:32:44 oleg113-client systemd[1]: session-99.scope: Succeeded. May 25 03:32:44 oleg113-client systemd-logind[1020]: Session 99 logged out. Waiting for processes to exit. May 25 03:32:44 oleg113-client systemd-logind[1020]: Removed session 99. May 25 03:32:46 oleg113-client sshd[23692]: Accepted publickey for root from 192.168.201.13 port 59606 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:46 oleg113-client systemd[1]: Started Session 100 of user root. May 25 03:32:46 oleg113-client systemd-logind[1020]: New session 100 of user root. May 25 03:32:46 oleg113-client sshd[23692]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:47 oleg113-client sshd[23705]: Received disconnect from 192.168.201.13 port 59606:11: disconnected by user May 25 03:32:47 oleg113-client sshd[23705]: Disconnected from user root 192.168.201.13 port 59606 May 25 03:32:47 oleg113-client sshd[23692]: pam_unix(sshd:session): session closed for user root May 25 03:32:47 oleg113-client systemd[1]: session-100.scope: Succeeded. May 25 03:32:47 oleg113-client systemd-logind[1020]: Session 100 logged out. Waiting for processes to exit. May 25 03:32:47 oleg113-client systemd-logind[1020]: Removed session 100. May 25 03:32:48 oleg113-client sshd[23839]: Accepted publickey for root from 192.168.201.13 port 59610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:48 oleg113-client systemd[1]: Started Session 101 of user root. May 25 03:32:48 oleg113-client systemd-logind[1020]: New session 101 of user root. May 25 03:32:48 oleg113-client sshd[23839]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:49 oleg113-client sshd[23852]: Received disconnect from 192.168.201.13 port 59610:11: disconnected by user May 25 03:32:49 oleg113-client sshd[23852]: Disconnected from user root 192.168.201.13 port 59610 May 25 03:32:49 oleg113-client sshd[23839]: pam_unix(sshd:session): session closed for user root May 25 03:32:49 oleg113-client systemd-logind[1020]: Session 101 logged out. Waiting for processes to exit. May 25 03:32:49 oleg113-client systemd[1]: session-101.scope: Succeeded. May 25 03:32:49 oleg113-client systemd-logind[1020]: Removed session 101. May 25 03:32:51 oleg113-client sshd[23994]: Accepted publickey for root from 192.168.201.13 port 50410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:32:51 oleg113-client systemd[1]: Started Session 102 of user root. May 25 03:32:51 oleg113-client systemd-logind[1020]: New session 102 of user root. May 25 03:32:51 oleg113-client sshd[23994]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:32:52 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18c: Dropped connect reply after eviction handing (14755) ========================================================== 03:32:49 (1779694369) May 25 03:32:52 oleg113-client sshd[24007]: Received disconnect from 192.168.201.13 port 50410:11: disconnected by user May 25 03:32:52 oleg113-client sshd[24007]: Disconnected from user root 192.168.201.13 port 50410 May 25 03:32:52 oleg113-client sshd[23994]: pam_unix(sshd:session): session closed for user root May 25 03:32:52 oleg113-client systemd-logind[1020]: Session 102 logged out. Waiting for processes to exit. May 25 03:32:52 oleg113-client systemd[1]: session-102.scope: Succeeded. May 25 03:32:52 oleg113-client systemd-logind[1020]: Removed session 102. May 25 03:33:06 oleg113-client kernel: Lustre: Evicted from lustre-OST0000_UUID (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f509f5 to 0x58062bb2b3f50b3e May 25 03:33:06 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:33:10 oleg113-client sshd[24221]: Accepted publickey for root from 192.168.201.13 port 56332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:33:11 oleg113-client systemd-logind[1020]: New session 103 of user root. May 25 03:33:11 oleg113-client sshd[24221]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:33:11 oleg113-client systemd[1]: Started Session 103 of user root. May 25 03:33:11 oleg113-client sshd[24234]: Received disconnect from 192.168.201.13 port 56332:11: disconnected by user May 25 03:33:11 oleg113-client sshd[24234]: Disconnected from user root 192.168.201.13 port 56332 May 25 03:33:11 oleg113-client sshd[24221]: pam_unix(sshd:session): session closed for user root May 25 03:33:11 oleg113-client systemd-logind[1020]: Session 103 logged out. Waiting for processes to exit. May 25 03:33:11 oleg113-client systemd[1]: session-103.scope: Succeeded. May 25 03:33:11 oleg113-client systemd-logind[1020]: Removed session 103. May 25 03:33:15 oleg113-client sshd[24361]: Accepted publickey for root from 192.168.201.13 port 56336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:33:15 oleg113-client systemd[1]: Started Session 104 of user root. May 25 03:33:15 oleg113-client systemd-logind[1020]: New session 104 of user root. May 25 03:33:15 oleg113-client sshd[24361]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:33:16 oleg113-client sshd[24374]: Received disconnect from 192.168.201.13 port 56336:11: disconnected by user May 25 03:33:16 oleg113-client sshd[24374]: Disconnected from user root 192.168.201.13 port 56336 May 25 03:33:16 oleg113-client sshd[24361]: pam_unix(sshd:session): session closed for user root May 25 03:33:16 oleg113-client systemd[1]: session-104.scope: Succeeded. May 25 03:33:16 oleg113-client systemd-logind[1020]: Session 104 logged out. Waiting for processes to exit. May 25 03:33:16 oleg113-client systemd-logind[1020]: Removed session 104. May 25 03:33:17 oleg113-client sshd[24507]: Accepted publickey for root from 192.168.201.13 port 56352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:33:18 oleg113-client systemd[1]: Started Session 105 of user root. May 25 03:33:18 oleg113-client systemd-logind[1020]: New session 105 of user root. May 25 03:33:18 oleg113-client sshd[24507]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:33:18 oleg113-client sshd[24520]: Received disconnect from 192.168.201.13 port 56352:11: disconnected by user May 25 03:33:18 oleg113-client sshd[24520]: Disconnected from user root 192.168.201.13 port 56352 May 25 03:33:18 oleg113-client sshd[24507]: pam_unix(sshd:session): session closed for user root May 25 03:33:18 oleg113-client systemd-logind[1020]: Session 105 logged out. Waiting for processes to exit. May 25 03:33:18 oleg113-client systemd[1]: session-105.scope: Succeeded. May 25 03:33:18 oleg113-client systemd-logind[1020]: Removed session 105. May 25 03:33:20 oleg113-client sshd[24662]: Accepted publickey for root from 192.168.201.13 port 52072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:33:20 oleg113-client systemd[1]: Started Session 106 of user root. May 25 03:33:20 oleg113-client systemd-logind[1020]: New session 106 of user root. May 25 03:33:20 oleg113-client sshd[24662]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:33:21 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19a: test expired_lock_main on mds (2867) ========================================================== 03:33:19 (1779694399) May 25 03:33:21 oleg113-client sshd[24675]: Received disconnect from 192.168.201.13 port 52072:11: disconnected by user May 25 03:33:21 oleg113-client sshd[24675]: Disconnected from user root 192.168.201.13 port 52072 May 25 03:33:21 oleg113-client sshd[24662]: pam_unix(sshd:session): session closed for user root May 25 03:33:21 oleg113-client systemd-logind[1020]: Session 106 logged out. Waiting for processes to exit. May 25 03:33:21 oleg113-client systemd[1]: session-106.scope: Succeeded. May 25 03:33:21 oleg113-client systemd-logind[1020]: Removed session 106. May 25 03:33:22 oleg113-client systemd-udevd[24733]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:33:22 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:33:41 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694405/real 1779694405] req@ffff9b15c36b5c00 x1866143484823424/t0(0) o103->lustre-MDT0000-mdc-ffff9b15c64bc800@192.168.201.113@tcp:17/18 lens 328/224 e 0 to 1 dl 1779694421 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 May 25 03:33:41 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 03:35:10 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 03:35:10 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:35:10 oleg113-client kernel: LustreError: 24907:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 May 25 03:35:10 oleg113-client kernel: LustreError: 24908:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffff9b15c64bc800: inode [0x200000404:0x1:0x0] mdc close failed: rc = -108 May 25 03:35:13 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:35:13 oleg113-client kernel: LustreError: 24917:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c793b000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:35:13 oleg113-client kernel: LustreError: 24917:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:35:13 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 03:35:16 oleg113-client sshd[25025]: Accepted publickey for root from 192.168.201.13 port 45594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:16 oleg113-client systemd-logind[1020]: New session 107 of user root. May 25 03:35:16 oleg113-client systemd[1]: Started Session 107 of user root. May 25 03:35:16 oleg113-client sshd[25025]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:17 oleg113-client sshd[25038]: Received disconnect from 192.168.201.13 port 45594:11: disconnected by user May 25 03:35:17 oleg113-client sshd[25038]: Disconnected from user root 192.168.201.13 port 45594 May 25 03:35:17 oleg113-client sshd[25025]: pam_unix(sshd:session): session closed for user root May 25 03:35:17 oleg113-client systemd[1]: session-107.scope: Succeeded. May 25 03:35:17 oleg113-client systemd-logind[1020]: Session 107 logged out. Waiting for processes to exit. May 25 03:35:17 oleg113-client systemd-logind[1020]: Removed session 107. May 25 03:35:18 oleg113-client sshd[25165]: Accepted publickey for root from 192.168.201.13 port 45602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:18 oleg113-client systemd-logind[1020]: New session 108 of user root. May 25 03:35:18 oleg113-client systemd[1]: Started Session 108 of user root. May 25 03:35:18 oleg113-client sshd[25165]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:19 oleg113-client sshd[25178]: Received disconnect from 192.168.201.13 port 45602:11: disconnected by user May 25 03:35:19 oleg113-client sshd[25178]: Disconnected from user root 192.168.201.13 port 45602 May 25 03:35:19 oleg113-client sshd[25165]: pam_unix(sshd:session): session closed for user root May 25 03:35:19 oleg113-client systemd-logind[1020]: Session 108 logged out. Waiting for processes to exit. May 25 03:35:19 oleg113-client systemd[1]: session-108.scope: Succeeded. May 25 03:35:19 oleg113-client systemd-logind[1020]: Removed session 108. May 25 03:35:21 oleg113-client sshd[25312]: Accepted publickey for root from 192.168.201.13 port 33224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:21 oleg113-client systemd-logind[1020]: New session 109 of user root. May 25 03:35:21 oleg113-client systemd[1]: Started Session 109 of user root. May 25 03:35:21 oleg113-client sshd[25312]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:21 oleg113-client sshd[25325]: Received disconnect from 192.168.201.13 port 33224:11: disconnected by user May 25 03:35:21 oleg113-client sshd[25325]: Disconnected from user root 192.168.201.13 port 33224 May 25 03:35:21 oleg113-client sshd[25312]: pam_unix(sshd:session): session closed for user root May 25 03:35:21 oleg113-client systemd-logind[1020]: Session 109 logged out. Waiting for processes to exit. May 25 03:35:21 oleg113-client systemd[1]: session-109.scope: Succeeded. May 25 03:35:21 oleg113-client systemd-logind[1020]: Removed session 109. May 25 03:35:24 oleg113-client sshd[25467]: Accepted publickey for root from 192.168.201.13 port 33238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:35:24 oleg113-client systemd-logind[1020]: New session 110 of user root. May 25 03:35:24 oleg113-client systemd[1]: Started Session 110 of user root. May 25 03:35:24 oleg113-client sshd[25467]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:35:25 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19b: test expired_lock_main on ost (2867) ========================================================== 03:35:22 (1779694522) May 25 03:35:25 oleg113-client sshd[25480]: Received disconnect from 192.168.201.13 port 33238:11: disconnected by user May 25 03:35:25 oleg113-client sshd[25480]: Disconnected from user root 192.168.201.13 port 33238 May 25 03:35:25 oleg113-client sshd[25467]: pam_unix(sshd:session): session closed for user root May 25 03:35:25 oleg113-client systemd[1]: session-110.scope: Succeeded. May 25 03:35:25 oleg113-client systemd-logind[1020]: Session 110 logged out. Waiting for processes to exit. May 25 03:35:25 oleg113-client systemd-logind[1020]: Removed session 110. May 25 03:35:25 oleg113-client systemd-udevd[25535]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:35:25 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:37:14 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:37:17 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:37:18 oleg113-client kernel: LustreError: 25713:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c7d33000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:37:18 oleg113-client kernel: LustreError: 25713:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:37:18 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 03:37:20 oleg113-client sshd[25828]: Accepted publickey for root from 192.168.201.13 port 42094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:20 oleg113-client systemd-logind[1020]: New session 111 of user root. May 25 03:37:20 oleg113-client systemd[1]: Started Session 111 of user root. May 25 03:37:20 oleg113-client sshd[25828]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:21 oleg113-client sshd[25841]: Received disconnect from 192.168.201.13 port 42094:11: disconnected by user May 25 03:37:21 oleg113-client sshd[25841]: Disconnected from user root 192.168.201.13 port 42094 May 25 03:37:21 oleg113-client sshd[25828]: pam_unix(sshd:session): session closed for user root May 25 03:37:21 oleg113-client systemd-logind[1020]: Session 111 logged out. Waiting for processes to exit. May 25 03:37:21 oleg113-client systemd[1]: session-111.scope: Succeeded. May 25 03:37:21 oleg113-client systemd-logind[1020]: Removed session 111. May 25 03:37:22 oleg113-client sshd[25968]: Accepted publickey for root from 192.168.201.13 port 42110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:22 oleg113-client systemd-logind[1020]: New session 112 of user root. May 25 03:37:22 oleg113-client systemd[1]: Started Session 112 of user root. May 25 03:37:22 oleg113-client sshd[25968]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:23 oleg113-client sshd[25981]: Received disconnect from 192.168.201.13 port 42110:11: disconnected by user May 25 03:37:23 oleg113-client sshd[25981]: Disconnected from user root 192.168.201.13 port 42110 May 25 03:37:23 oleg113-client sshd[25968]: pam_unix(sshd:session): session closed for user root May 25 03:37:23 oleg113-client systemd[1]: session-112.scope: Succeeded. May 25 03:37:23 oleg113-client systemd-logind[1020]: Session 112 logged out. Waiting for processes to exit. May 25 03:37:23 oleg113-client systemd-logind[1020]: Removed session 112. May 25 03:37:25 oleg113-client sshd[26115]: Accepted publickey for root from 192.168.201.13 port 42112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:25 oleg113-client systemd-logind[1020]: New session 113 of user root. May 25 03:37:25 oleg113-client systemd[1]: Started Session 113 of user root. May 25 03:37:25 oleg113-client sshd[26115]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:26 oleg113-client sshd[26128]: Received disconnect from 192.168.201.13 port 42112:11: disconnected by user May 25 03:37:26 oleg113-client sshd[26128]: Disconnected from user root 192.168.201.13 port 42112 May 25 03:37:26 oleg113-client sshd[26115]: pam_unix(sshd:session): session closed for user root May 25 03:37:26 oleg113-client systemd[1]: session-113.scope: Succeeded. May 25 03:37:26 oleg113-client systemd-logind[1020]: Session 113 logged out. Waiting for processes to exit. May 25 03:37:26 oleg113-client systemd-logind[1020]: Removed session 113. May 25 03:37:28 oleg113-client sshd[26270]: Accepted publickey for root from 192.168.201.13 port 42124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:28 oleg113-client systemd[1]: Started Session 114 of user root. May 25 03:37:28 oleg113-client systemd-logind[1020]: New session 114 of user root. May 25 03:37:28 oleg113-client sshd[26270]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:29 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19c: check reconnect and lock resend do not trigger expired_lock_main ========================================================== 03:37:27 (1779694647) May 25 03:37:29 oleg113-client sshd[26283]: Received disconnect from 192.168.201.13 port 42124:11: disconnected by user May 25 03:37:29 oleg113-client sshd[26283]: Disconnected from user root 192.168.201.13 port 42124 May 25 03:37:29 oleg113-client sshd[26270]: pam_unix(sshd:session): session closed for user root May 25 03:37:29 oleg113-client systemd-logind[1020]: Session 114 logged out. Waiting for processes to exit. May 25 03:37:29 oleg113-client systemd[1]: session-114.scope: Succeeded. May 25 03:37:29 oleg113-client systemd-logind[1020]: Removed session 114. May 25 03:37:30 oleg113-client systemd-udevd[26336]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 03:37:30 oleg113-client kernel: Lustre: Mounted lustre-client May 25 03:37:37 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 03:37:37 oleg113-client kernel: LustreError: 26386:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c793a000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 03:37:37 oleg113-client kernel: LustreError: 26386:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 03:37:37 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 03:37:44 oleg113-client sshd[26485]: Accepted publickey for root from 192.168.201.13 port 43304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:44 oleg113-client systemd-logind[1020]: New session 115 of user root. May 25 03:37:44 oleg113-client systemd[1]: Started Session 115 of user root. May 25 03:37:44 oleg113-client sshd[26485]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:45 oleg113-client sshd[26498]: Received disconnect from 192.168.201.13 port 43304:11: disconnected by user May 25 03:37:45 oleg113-client sshd[26498]: Disconnected from user root 192.168.201.13 port 43304 May 25 03:37:45 oleg113-client sshd[26485]: pam_unix(sshd:session): session closed for user root May 25 03:37:45 oleg113-client systemd-logind[1020]: Session 115 logged out. Waiting for processes to exit. May 25 03:37:45 oleg113-client systemd[1]: session-115.scope: Succeeded. May 25 03:37:45 oleg113-client systemd-logind[1020]: Removed session 115. May 25 03:37:47 oleg113-client sshd[26624]: Accepted publickey for root from 192.168.201.13 port 43310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:47 oleg113-client systemd-logind[1020]: New session 116 of user root. May 25 03:37:47 oleg113-client systemd[1]: Started Session 116 of user root. May 25 03:37:47 oleg113-client sshd[26624]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:48 oleg113-client sshd[26637]: Received disconnect from 192.168.201.13 port 43310:11: disconnected by user May 25 03:37:48 oleg113-client sshd[26637]: Disconnected from user root 192.168.201.13 port 43310 May 25 03:37:48 oleg113-client sshd[26624]: pam_unix(sshd:session): session closed for user root May 25 03:37:48 oleg113-client systemd[1]: session-116.scope: Succeeded. May 25 03:37:48 oleg113-client systemd-logind[1020]: Session 116 logged out. Waiting for processes to exit. May 25 03:37:48 oleg113-client systemd-logind[1020]: Removed session 116. May 25 03:37:50 oleg113-client sshd[26771]: Accepted publickey for root from 192.168.201.13 port 34822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:50 oleg113-client systemd-logind[1020]: New session 117 of user root. May 25 03:37:50 oleg113-client systemd[1]: Started Session 117 of user root. May 25 03:37:50 oleg113-client sshd[26771]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:50 oleg113-client sshd[26784]: Received disconnect from 192.168.201.13 port 34822:11: disconnected by user May 25 03:37:50 oleg113-client sshd[26784]: Disconnected from user root 192.168.201.13 port 34822 May 25 03:37:50 oleg113-client sshd[26771]: pam_unix(sshd:session): session closed for user root May 25 03:37:50 oleg113-client systemd-logind[1020]: Session 117 logged out. Waiting for processes to exit. May 25 03:37:50 oleg113-client systemd[1]: session-117.scope: Succeeded. May 25 03:37:50 oleg113-client systemd-logind[1020]: Removed session 117. May 25 03:37:52 oleg113-client sshd[26927]: Accepted publickey for root from 192.168.201.13 port 34826 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:53 oleg113-client systemd-logind[1020]: New session 118 of user root. May 25 03:37:53 oleg113-client systemd[1]: Started Session 118 of user root. May 25 03:37:53 oleg113-client sshd[26927]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:53 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20a: ldlm_handle_enqueue error (should return error) ========================================================== 03:37:51 (1779694671) May 25 03:37:53 oleg113-client sshd[26940]: Received disconnect from 192.168.201.13 port 34826:11: disconnected by user May 25 03:37:53 oleg113-client sshd[26940]: Disconnected from user root 192.168.201.13 port 34826 May 25 03:37:53 oleg113-client sshd[26927]: pam_unix(sshd:session): session closed for user root May 25 03:37:53 oleg113-client systemd[1]: session-118.scope: Succeeded. May 25 03:37:53 oleg113-client systemd-logind[1020]: Session 118 logged out. Waiting for processes to exit. May 25 03:37:53 oleg113-client systemd-logind[1020]: Removed session 118. May 25 03:37:56 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -12 May 25 03:37:57 oleg113-client sshd[27110]: Accepted publickey for root from 192.168.201.13 port 34830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:57 oleg113-client systemd-logind[1020]: New session 119 of user root. May 25 03:37:57 oleg113-client systemd[1]: Started Session 119 of user root. May 25 03:37:57 oleg113-client sshd[27110]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:37:57 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:37:58 oleg113-client sshd[27125]: Received disconnect from 192.168.201.13 port 34830:11: disconnected by user May 25 03:37:58 oleg113-client sshd[27125]: Disconnected from user root 192.168.201.13 port 34830 May 25 03:37:58 oleg113-client sshd[27110]: pam_unix(sshd:session): session closed for user root May 25 03:37:58 oleg113-client systemd[1]: session-119.scope: Succeeded. May 25 03:37:58 oleg113-client systemd-logind[1020]: Session 119 logged out. Waiting for processes to exit. May 25 03:37:58 oleg113-client systemd-logind[1020]: Removed session 119. May 25 03:37:59 oleg113-client sshd[27253]: Accepted publickey for root from 192.168.201.13 port 52696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:37:59 oleg113-client systemd-logind[1020]: New session 120 of user root. May 25 03:38:00 oleg113-client systemd[1]: Started Session 120 of user root. May 25 03:38:00 oleg113-client sshd[27253]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:00 oleg113-client sshd[27266]: Received disconnect from 192.168.201.13 port 52696:11: disconnected by user May 25 03:38:00 oleg113-client sshd[27266]: Disconnected from user root 192.168.201.13 port 52696 May 25 03:38:00 oleg113-client sshd[27253]: pam_unix(sshd:session): session closed for user root May 25 03:38:00 oleg113-client systemd[1]: session-120.scope: Succeeded. May 25 03:38:00 oleg113-client systemd-logind[1020]: Session 120 logged out. Waiting for processes to exit. May 25 03:38:00 oleg113-client systemd-logind[1020]: Removed session 120. May 25 03:38:02 oleg113-client sshd[27399]: Accepted publickey for root from 192.168.201.13 port 52712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:02 oleg113-client systemd-logind[1020]: New session 121 of user root. May 25 03:38:02 oleg113-client systemd[1]: Started Session 121 of user root. May 25 03:38:02 oleg113-client sshd[27399]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:02 oleg113-client sshd[27412]: Received disconnect from 192.168.201.13 port 52712:11: disconnected by user May 25 03:38:02 oleg113-client sshd[27412]: Disconnected from user root 192.168.201.13 port 52712 May 25 03:38:02 oleg113-client sshd[27399]: pam_unix(sshd:session): session closed for user root May 25 03:38:02 oleg113-client systemd[1]: session-121.scope: Succeeded. May 25 03:38:02 oleg113-client systemd-logind[1020]: Session 121 logged out. Waiting for processes to exit. May 25 03:38:02 oleg113-client systemd-logind[1020]: Removed session 121. May 25 03:38:04 oleg113-client sshd[27555]: Accepted publickey for root from 192.168.201.13 port 52716 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:04 oleg113-client systemd[1]: Started Session 122 of user root. May 25 03:38:04 oleg113-client systemd-logind[1020]: New session 122 of user root. May 25 03:38:04 oleg113-client sshd[27555]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20b: ldlm_handle_enqueue error (should return error) ========================================================== 03:38:03 (1779694683) May 25 03:38:05 oleg113-client sshd[27568]: Received disconnect from 192.168.201.13 port 52716:11: disconnected by user May 25 03:38:05 oleg113-client sshd[27568]: Disconnected from user root 192.168.201.13 port 52716 May 25 03:38:05 oleg113-client sshd[27555]: pam_unix(sshd:session): session closed for user root May 25 03:38:05 oleg113-client systemd[1]: session-122.scope: Succeeded. May 25 03:38:05 oleg113-client systemd-logind[1020]: Session 122 logged out. Waiting for processes to exit. May 25 03:38:05 oleg113-client systemd-logind[1020]: Removed session 122. May 25 03:38:07 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -12 May 25 03:38:09 oleg113-client sshd[27737]: Accepted publickey for root from 192.168.201.13 port 52722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:09 oleg113-client systemd-logind[1020]: New session 123 of user root. May 25 03:38:09 oleg113-client systemd[1]: Started Session 123 of user root. May 25 03:38:09 oleg113-client sshd[27737]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:09 oleg113-client sshd[27750]: Received disconnect from 192.168.201.13 port 52722:11: disconnected by user May 25 03:38:09 oleg113-client sshd[27750]: Disconnected from user root 192.168.201.13 port 52722 May 25 03:38:09 oleg113-client sshd[27737]: pam_unix(sshd:session): session closed for user root May 25 03:38:10 oleg113-client systemd[1]: session-123.scope: Succeeded. May 25 03:38:10 oleg113-client systemd-logind[1020]: Session 123 logged out. Waiting for processes to exit. May 25 03:38:10 oleg113-client systemd-logind[1020]: Removed session 123. May 25 03:38:11 oleg113-client sshd[27876]: Accepted publickey for root from 192.168.201.13 port 47234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:11 oleg113-client systemd[1]: Started Session 124 of user root. May 25 03:38:11 oleg113-client systemd-logind[1020]: New session 124 of user root. May 25 03:38:11 oleg113-client sshd[27876]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:12 oleg113-client sshd[27889]: Received disconnect from 192.168.201.13 port 47234:11: disconnected by user May 25 03:38:12 oleg113-client sshd[27889]: Disconnected from user root 192.168.201.13 port 47234 May 25 03:38:12 oleg113-client sshd[27876]: pam_unix(sshd:session): session closed for user root May 25 03:38:12 oleg113-client systemd[1]: session-124.scope: Succeeded. May 25 03:38:12 oleg113-client systemd-logind[1020]: Session 124 logged out. Waiting for processes to exit. May 25 03:38:12 oleg113-client systemd-logind[1020]: Removed session 124. May 25 03:38:13 oleg113-client sshd[28022]: Accepted publickey for root from 192.168.201.13 port 47246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:13 oleg113-client systemd-logind[1020]: New session 125 of user root. May 25 03:38:13 oleg113-client systemd[1]: Started Session 125 of user root. May 25 03:38:13 oleg113-client sshd[28022]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:14 oleg113-client sshd[28035]: Received disconnect from 192.168.201.13 port 47246:11: disconnected by user May 25 03:38:14 oleg113-client sshd[28035]: Disconnected from user root 192.168.201.13 port 47246 May 25 03:38:14 oleg113-client sshd[28022]: pam_unix(sshd:session): session closed for user root May 25 03:38:14 oleg113-client systemd[1]: session-125.scope: Succeeded. May 25 03:38:14 oleg113-client systemd-logind[1020]: Session 125 logged out. Waiting for processes to exit. May 25 03:38:14 oleg113-client systemd-logind[1020]: Removed session 125. May 25 03:38:16 oleg113-client sshd[28179]: Accepted publickey for root from 192.168.201.13 port 47250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:16 oleg113-client systemd[1]: Started Session 126 of user root. May 25 03:38:16 oleg113-client systemd-logind[1020]: New session 126 of user root. May 25 03:38:16 oleg113-client sshd[28179]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:17 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21a: drop close request while close and open are both in flight ========================================================== 03:38:15 (1779694695) May 25 03:38:17 oleg113-client sshd[28192]: Received disconnect from 192.168.201.13 port 47250:11: disconnected by user May 25 03:38:17 oleg113-client sshd[28192]: Disconnected from user root 192.168.201.13 port 47250 May 25 03:38:17 oleg113-client sshd[28179]: pam_unix(sshd:session): session closed for user root May 25 03:38:17 oleg113-client systemd-logind[1020]: Session 126 logged out. Waiting for processes to exit. May 25 03:38:17 oleg113-client systemd[1]: session-126.scope: Succeeded. May 25 03:38:17 oleg113-client systemd-logind[1020]: Removed session 126. May 25 03:38:44 oleg113-client sshd[28365]: Accepted publickey for root from 192.168.201.13 port 40238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:44 oleg113-client systemd-logind[1020]: New session 127 of user root. May 25 03:38:44 oleg113-client systemd[1]: Started Session 127 of user root. May 25 03:38:44 oleg113-client sshd[28365]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:44 oleg113-client sshd[28378]: Received disconnect from 192.168.201.13 port 40238:11: disconnected by user May 25 03:38:44 oleg113-client sshd[28378]: Disconnected from user root 192.168.201.13 port 40238 May 25 03:38:44 oleg113-client sshd[28365]: pam_unix(sshd:session): session closed for user root May 25 03:38:44 oleg113-client systemd[1]: session-127.scope: Succeeded. May 25 03:38:44 oleg113-client systemd-logind[1020]: Session 127 logged out. Waiting for processes to exit. May 25 03:38:44 oleg113-client systemd-logind[1020]: Removed session 127. May 25 03:38:46 oleg113-client sshd[28504]: Accepted publickey for root from 192.168.201.13 port 40254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:46 oleg113-client systemd-logind[1020]: New session 128 of user root. May 25 03:38:46 oleg113-client systemd[1]: Started Session 128 of user root. May 25 03:38:46 oleg113-client sshd[28504]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:47 oleg113-client sshd[28517]: Received disconnect from 192.168.201.13 port 40254:11: disconnected by user May 25 03:38:47 oleg113-client sshd[28517]: Disconnected from user root 192.168.201.13 port 40254 May 25 03:38:47 oleg113-client sshd[28504]: pam_unix(sshd:session): session closed for user root May 25 03:38:47 oleg113-client systemd[1]: session-128.scope: Succeeded. May 25 03:38:47 oleg113-client systemd-logind[1020]: Session 128 logged out. Waiting for processes to exit. May 25 03:38:47 oleg113-client systemd-logind[1020]: Removed session 128. May 25 03:38:49 oleg113-client sshd[28650]: Accepted publickey for root from 192.168.201.13 port 40264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:49 oleg113-client systemd-logind[1020]: New session 129 of user root. May 25 03:38:49 oleg113-client sshd[28650]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:49 oleg113-client systemd[1]: Started Session 129 of user root. May 25 03:38:49 oleg113-client sshd[28663]: Received disconnect from 192.168.201.13 port 40264:11: disconnected by user May 25 03:38:49 oleg113-client sshd[28663]: Disconnected from user root 192.168.201.13 port 40264 May 25 03:38:49 oleg113-client sshd[28650]: pam_unix(sshd:session): session closed for user root May 25 03:38:49 oleg113-client systemd[1]: session-129.scope: Succeeded. May 25 03:38:49 oleg113-client systemd-logind[1020]: Session 129 logged out. Waiting for processes to exit. May 25 03:38:49 oleg113-client systemd-logind[1020]: Removed session 129. May 25 03:38:51 oleg113-client sshd[28806]: Accepted publickey for root from 192.168.201.13 port 58202 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:38:51 oleg113-client systemd-logind[1020]: New session 130 of user root. May 25 03:38:51 oleg113-client systemd[1]: Started Session 130 of user root. May 25 03:38:51 oleg113-client sshd[28806]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:38:52 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21b: drop open request while close and open are both in flight ========================================================== 03:38:50 (1779694730) May 25 03:38:52 oleg113-client sshd[28819]: Received disconnect from 192.168.201.13 port 58202:11: disconnected by user May 25 03:38:52 oleg113-client sshd[28819]: Disconnected from user root 192.168.201.13 port 58202 May 25 03:38:52 oleg113-client sshd[28806]: pam_unix(sshd:session): session closed for user root May 25 03:38:52 oleg113-client systemd[1]: session-130.scope: Succeeded. May 25 03:38:52 oleg113-client systemd-logind[1020]: Session 130 logged out. Waiting for processes to exit. May 25 03:38:52 oleg113-client systemd-logind[1020]: Removed session 130. May 25 03:41:47 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:41:47 oleg113-client kernel: Lustre: Skipped 17 previous similar messages May 25 03:41:47 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:41:47 oleg113-client kernel: Lustre: Skipped 14 previous similar messages May 25 03:41:49 oleg113-client sshd[28997]: Accepted publickey for root from 192.168.201.13 port 44922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:49 oleg113-client systemd-logind[1020]: New session 131 of user root. May 25 03:41:49 oleg113-client systemd[1]: Started Session 131 of user root. May 25 03:41:49 oleg113-client sshd[28997]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:49 oleg113-client sshd[29010]: Received disconnect from 192.168.201.13 port 44922:11: disconnected by user May 25 03:41:49 oleg113-client sshd[29010]: Disconnected from user root 192.168.201.13 port 44922 May 25 03:41:49 oleg113-client sshd[28997]: pam_unix(sshd:session): session closed for user root May 25 03:41:49 oleg113-client systemd[1]: session-131.scope: Succeeded. May 25 03:41:49 oleg113-client systemd-logind[1020]: Session 131 logged out. Waiting for processes to exit. May 25 03:41:49 oleg113-client systemd-logind[1020]: Removed session 131. May 25 03:41:52 oleg113-client sshd[29136]: Accepted publickey for root from 192.168.201.13 port 39932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:52 oleg113-client systemd-logind[1020]: New session 132 of user root. May 25 03:41:52 oleg113-client systemd[1]: Started Session 132 of user root. May 25 03:41:52 oleg113-client sshd[29136]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:52 oleg113-client sshd[29149]: Received disconnect from 192.168.201.13 port 39932:11: disconnected by user May 25 03:41:53 oleg113-client sshd[29149]: Disconnected from user root 192.168.201.13 port 39932 May 25 03:41:53 oleg113-client sshd[29136]: pam_unix(sshd:session): session closed for user root May 25 03:41:53 oleg113-client systemd-logind[1020]: Session 132 logged out. Waiting for processes to exit. May 25 03:41:53 oleg113-client systemd[1]: session-132.scope: Succeeded. May 25 03:41:53 oleg113-client systemd-logind[1020]: Removed session 132. May 25 03:41:54 oleg113-client sshd[29283]: Accepted publickey for root from 192.168.201.13 port 39938 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:55 oleg113-client systemd-logind[1020]: New session 133 of user root. May 25 03:41:55 oleg113-client systemd[1]: Started Session 133 of user root. May 25 03:41:55 oleg113-client sshd[29283]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:55 oleg113-client sshd[29296]: Received disconnect from 192.168.201.13 port 39938:11: disconnected by user May 25 03:41:55 oleg113-client sshd[29296]: Disconnected from user root 192.168.201.13 port 39938 May 25 03:41:55 oleg113-client sshd[29283]: pam_unix(sshd:session): session closed for user root May 25 03:41:55 oleg113-client systemd[1]: session-133.scope: Succeeded. May 25 03:41:55 oleg113-client systemd-logind[1020]: Session 133 logged out. Waiting for processes to exit. May 25 03:41:56 oleg113-client systemd-logind[1020]: Removed session 133. May 25 03:41:57 oleg113-client sshd[29438]: Accepted publickey for root from 192.168.201.13 port 39948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:41:57 oleg113-client systemd[1]: Started Session 134 of user root. May 25 03:41:57 oleg113-client systemd-logind[1020]: New session 134 of user root. May 25 03:41:57 oleg113-client sshd[29438]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:41:58 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21c: drop both request while close and open are both in flight ========================================================== 03:41:56 (1779694916) May 25 03:41:58 oleg113-client sshd[29451]: Received disconnect from 192.168.201.13 port 39948:11: disconnected by user May 25 03:41:58 oleg113-client sshd[29451]: Disconnected from user root 192.168.201.13 port 39948 May 25 03:41:58 oleg113-client sshd[29438]: pam_unix(sshd:session): session closed for user root May 25 03:41:58 oleg113-client systemd-logind[1020]: Session 134 logged out. Waiting for processes to exit. May 25 03:41:58 oleg113-client systemd[1]: session-134.scope: Succeeded. May 25 03:41:58 oleg113-client systemd-logind[1020]: Removed session 134. May 25 03:42:21 oleg113-client kernel: Lustre: 29489:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779694925/real 1779694925] req@ffff9b15c8df1c00 x1866143484942208/t0(0) o35->lustre-MDT0000-mdc-ffff9b15c64bc800@192.168.201.113@tcp:23/10 lens 392/624 e 0 to 1 dl 1779694941 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 May 25 03:42:21 oleg113-client kernel: Lustre: 29489:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 13 previous similar messages May 25 03:42:26 oleg113-client sshd[29624]: Accepted publickey for root from 192.168.201.13 port 39304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:42:26 oleg113-client systemd[1]: Started Session 135 of user root. May 25 03:42:26 oleg113-client systemd-logind[1020]: New session 135 of user root. May 25 03:42:26 oleg113-client sshd[29624]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:42:27 oleg113-client sshd[29638]: Received disconnect from 192.168.201.13 port 39304:11: disconnected by user May 25 03:42:27 oleg113-client sshd[29638]: Disconnected from user root 192.168.201.13 port 39304 May 25 03:42:27 oleg113-client sshd[29624]: pam_unix(sshd:session): session closed for user root May 25 03:42:27 oleg113-client systemd-logind[1020]: Session 135 logged out. Waiting for processes to exit. May 25 03:42:27 oleg113-client systemd[1]: session-135.scope: Succeeded. May 25 03:42:27 oleg113-client systemd-logind[1020]: Removed session 135. May 25 03:42:29 oleg113-client sshd[29764]: Accepted publickey for root from 192.168.201.13 port 39314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:42:29 oleg113-client systemd[1]: Started Session 136 of user root. May 25 03:42:29 oleg113-client systemd-logind[1020]: New session 136 of user root. May 25 03:42:29 oleg113-client sshd[29764]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:42:29 oleg113-client sshd[29777]: Received disconnect from 192.168.201.13 port 39314:11: disconnected by user May 25 03:42:29 oleg113-client sshd[29777]: Disconnected from user root 192.168.201.13 port 39314 May 25 03:42:29 oleg113-client sshd[29764]: pam_unix(sshd:session): session closed for user root May 25 03:42:30 oleg113-client systemd[1]: session-136.scope: Succeeded. May 25 03:42:30 oleg113-client systemd-logind[1020]: Session 136 logged out. Waiting for processes to exit. May 25 03:42:30 oleg113-client systemd-logind[1020]: Removed session 136. May 25 03:42:31 oleg113-client sshd[29910]: Accepted publickey for root from 192.168.201.13 port 57094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:42:31 oleg113-client systemd-logind[1020]: New session 137 of user root. May 25 03:42:31 oleg113-client systemd[1]: Started Session 137 of user root. May 25 03:42:31 oleg113-client sshd[29910]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:42:32 oleg113-client sshd[29923]: Received disconnect from 192.168.201.13 port 57094:11: disconnected by user May 25 03:42:32 oleg113-client sshd[29923]: Disconnected from user root 192.168.201.13 port 57094 May 25 03:42:32 oleg113-client sshd[29910]: pam_unix(sshd:session): session closed for user root May 25 03:42:32 oleg113-client systemd-logind[1020]: Session 137 logged out. Waiting for processes to exit. May 25 03:42:32 oleg113-client systemd[1]: session-137.scope: Succeeded. May 25 03:42:32 oleg113-client systemd-logind[1020]: Removed session 137. May 25 03:42:33 oleg113-client sshd[30065]: Accepted publickey for root from 192.168.201.13 port 57102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:42:34 oleg113-client systemd-logind[1020]: New session 138 of user root. May 25 03:42:34 oleg113-client systemd[1]: Started Session 138 of user root. May 25 03:42:34 oleg113-client sshd[30065]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:42:34 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21d: drop close reply while close and open are both in flight ========================================================== 03:42:32 (1779694952) May 25 03:42:34 oleg113-client sshd[30079]: Received disconnect from 192.168.201.13 port 57102:11: disconnected by user May 25 03:42:34 oleg113-client sshd[30079]: Disconnected from user root 192.168.201.13 port 57102 May 25 03:42:34 oleg113-client sshd[30065]: pam_unix(sshd:session): session closed for user root May 25 03:42:34 oleg113-client systemd-logind[1020]: Session 138 logged out. Waiting for processes to exit. May 25 03:42:34 oleg113-client systemd[1]: session-138.scope: Succeeded. May 25 03:42:34 oleg113-client systemd-logind[1020]: Removed session 138. May 25 03:43:01 oleg113-client sshd[30251]: Accepted publickey for root from 192.168.201.13 port 59870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:01 oleg113-client systemd-logind[1020]: New session 139 of user root. May 25 03:43:01 oleg113-client systemd[1]: Started Session 139 of user root. May 25 03:43:01 oleg113-client sshd[30251]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:01 oleg113-client sshd[30265]: Received disconnect from 192.168.201.13 port 59870:11: disconnected by user May 25 03:43:01 oleg113-client sshd[30265]: Disconnected from user root 192.168.201.13 port 59870 May 25 03:43:01 oleg113-client sshd[30251]: pam_unix(sshd:session): session closed for user root May 25 03:43:02 oleg113-client systemd-logind[1020]: Session 139 logged out. Waiting for processes to exit. May 25 03:43:02 oleg113-client systemd[1]: session-139.scope: Succeeded. May 25 03:43:02 oleg113-client systemd-logind[1020]: Removed session 139. May 25 03:43:03 oleg113-client sshd[30392]: Accepted publickey for root from 192.168.201.13 port 59880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:03 oleg113-client systemd[1]: Started Session 140 of user root. May 25 03:43:03 oleg113-client systemd-logind[1020]: New session 140 of user root. May 25 03:43:03 oleg113-client sshd[30392]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:04 oleg113-client sshd[30405]: Received disconnect from 192.168.201.13 port 59880:11: disconnected by user May 25 03:43:04 oleg113-client sshd[30405]: Disconnected from user root 192.168.201.13 port 59880 May 25 03:43:04 oleg113-client sshd[30392]: pam_unix(sshd:session): session closed for user root May 25 03:43:04 oleg113-client systemd[1]: session-140.scope: Succeeded. May 25 03:43:04 oleg113-client systemd-logind[1020]: Session 140 logged out. Waiting for processes to exit. May 25 03:43:04 oleg113-client systemd-logind[1020]: Removed session 140. May 25 03:43:05 oleg113-client sshd[30539]: Accepted publickey for root from 192.168.201.13 port 59892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:05 oleg113-client systemd[1]: Started Session 141 of user root. May 25 03:43:05 oleg113-client systemd-logind[1020]: New session 141 of user root. May 25 03:43:05 oleg113-client sshd[30539]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:06 oleg113-client sshd[30552]: Received disconnect from 192.168.201.13 port 59892:11: disconnected by user May 25 03:43:06 oleg113-client sshd[30552]: Disconnected from user root 192.168.201.13 port 59892 May 25 03:43:06 oleg113-client sshd[30539]: pam_unix(sshd:session): session closed for user root May 25 03:43:06 oleg113-client systemd-logind[1020]: Session 141 logged out. Waiting for processes to exit. May 25 03:43:06 oleg113-client systemd[1]: session-141.scope: Succeeded. May 25 03:43:06 oleg113-client systemd-logind[1020]: Removed session 141. May 25 03:43:08 oleg113-client sshd[30694]: Accepted publickey for root from 192.168.201.13 port 59904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:08 oleg113-client systemd-logind[1020]: New session 142 of user root. May 25 03:43:08 oleg113-client systemd[1]: Started Session 142 of user root. May 25 03:43:08 oleg113-client sshd[30694]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:09 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21e: drop open reply while close and open are both in flight ========================================================== 03:43:06 (1779694986) May 25 03:43:09 oleg113-client sshd[30708]: Received disconnect from 192.168.201.13 port 59904:11: disconnected by user May 25 03:43:09 oleg113-client sshd[30708]: Disconnected from user root 192.168.201.13 port 59904 May 25 03:43:09 oleg113-client sshd[30694]: pam_unix(sshd:session): session closed for user root May 25 03:43:09 oleg113-client systemd-logind[1020]: Session 142 logged out. Waiting for processes to exit. May 25 03:43:09 oleg113-client systemd[1]: session-142.scope: Succeeded. May 25 03:43:09 oleg113-client systemd-logind[1020]: Removed session 142. May 25 03:43:34 oleg113-client sshd[30865]: Accepted publickey for root from 192.168.201.13 port 40194 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:35 oleg113-client systemd-logind[1020]: New session 143 of user root. May 25 03:43:35 oleg113-client systemd[1]: Started Session 143 of user root. May 25 03:43:35 oleg113-client sshd[30865]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:35 oleg113-client sshd[30878]: Received disconnect from 192.168.201.13 port 40194:11: disconnected by user May 25 03:43:35 oleg113-client sshd[30878]: Disconnected from user root 192.168.201.13 port 40194 May 25 03:43:35 oleg113-client sshd[30865]: pam_unix(sshd:session): session closed for user root May 25 03:43:35 oleg113-client systemd[1]: session-143.scope: Succeeded. May 25 03:43:35 oleg113-client systemd-logind[1020]: Session 143 logged out. Waiting for processes to exit. May 25 03:43:35 oleg113-client systemd-logind[1020]: Removed session 143. May 25 03:43:37 oleg113-client sshd[31005]: Accepted publickey for root from 192.168.201.13 port 40198 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:37 oleg113-client systemd-logind[1020]: New session 144 of user root. May 25 03:43:37 oleg113-client systemd[1]: Started Session 144 of user root. May 25 03:43:37 oleg113-client sshd[31005]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:38 oleg113-client sshd[31018]: Received disconnect from 192.168.201.13 port 40198:11: disconnected by user May 25 03:43:38 oleg113-client sshd[31018]: Disconnected from user root 192.168.201.13 port 40198 May 25 03:43:38 oleg113-client sshd[31005]: pam_unix(sshd:session): session closed for user root May 25 03:43:38 oleg113-client systemd-logind[1020]: Session 144 logged out. Waiting for processes to exit. May 25 03:43:38 oleg113-client systemd[1]: session-144.scope: Succeeded. May 25 03:43:38 oleg113-client systemd-logind[1020]: Removed session 144. May 25 03:43:40 oleg113-client sshd[31151]: Accepted publickey for root from 192.168.201.13 port 54714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:43:40 oleg113-client systemd-logind[1020]: New session 145 of user root. May 25 03:43:40 oleg113-client systemd[1]: Started Session 145 of user root. May 25 03:43:40 oleg113-client sshd[31151]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:43:41 oleg113-client sshd[31164]: Received disconnect from 192.168.201.13 port 54714:11: disconnected by user May 25 03:43:41 oleg113-client sshd[31164]: Disconnected from user root 192.168.201.13 port 54714 May 25 03:43:41 oleg113-client sshd[31151]: pam_unix(sshd:session): session closed for user root May 25 03:43:41 oleg113-client systemd[1]: session-145.scope: Succeeded. May 25 03:43:41 oleg113-client systemd-logind[1020]: Session 145 logged out. Waiting for processes to exit. May 25 03:43:41 oleg113-client systemd-logind[1020]: Removed session 145. May 25 03:46:04 oleg113-client sshd[31328]: Accepted publickey for root from 192.168.201.13 port 50084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:04 oleg113-client systemd[1]: Started Session 146 of user root. May 25 03:46:04 oleg113-client systemd-logind[1020]: New session 146 of user root. May 25 03:46:04 oleg113-client sshd[31328]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21f: drop both reply while close and open are both in flight ========================================================== 03:46:03 (1779695163) May 25 03:46:05 oleg113-client sshd[31341]: Received disconnect from 192.168.201.13 port 50084:11: disconnected by user May 25 03:46:05 oleg113-client sshd[31341]: Disconnected from user root 192.168.201.13 port 50084 May 25 03:46:05 oleg113-client sshd[31328]: pam_unix(sshd:session): session closed for user root May 25 03:46:05 oleg113-client systemd[1]: session-146.scope: Succeeded. May 25 03:46:05 oleg113-client systemd-logind[1020]: Session 146 logged out. Waiting for processes to exit. May 25 03:46:05 oleg113-client systemd-logind[1020]: Removed session 146. May 25 03:46:28 oleg113-client sshd[31514]: Accepted publickey for root from 192.168.201.13 port 35610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:28 oleg113-client systemd-logind[1020]: New session 147 of user root. May 25 03:46:28 oleg113-client systemd[1]: Started Session 147 of user root. May 25 03:46:28 oleg113-client sshd[31514]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:29 oleg113-client sshd[31527]: Received disconnect from 192.168.201.13 port 35610:11: disconnected by user May 25 03:46:29 oleg113-client sshd[31527]: Disconnected from user root 192.168.201.13 port 35610 May 25 03:46:29 oleg113-client sshd[31514]: pam_unix(sshd:session): session closed for user root May 25 03:46:29 oleg113-client systemd[1]: session-147.scope: Succeeded. May 25 03:46:29 oleg113-client systemd-logind[1020]: Session 147 logged out. Waiting for processes to exit. May 25 03:46:29 oleg113-client systemd-logind[1020]: Removed session 147. May 25 03:46:30 oleg113-client sshd[31654]: Accepted publickey for root from 192.168.201.13 port 37364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:31 oleg113-client systemd-logind[1020]: New session 148 of user root. May 25 03:46:31 oleg113-client systemd[1]: Started Session 148 of user root. May 25 03:46:31 oleg113-client sshd[31654]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:31 oleg113-client sshd[31667]: Received disconnect from 192.168.201.13 port 37364:11: disconnected by user May 25 03:46:31 oleg113-client sshd[31667]: Disconnected from user root 192.168.201.13 port 37364 May 25 03:46:31 oleg113-client sshd[31654]: pam_unix(sshd:session): session closed for user root May 25 03:46:31 oleg113-client systemd[1]: session-148.scope: Succeeded. May 25 03:46:31 oleg113-client systemd-logind[1020]: Session 148 logged out. Waiting for processes to exit. May 25 03:46:31 oleg113-client systemd-logind[1020]: Removed session 148. May 25 03:46:32 oleg113-client sshd[31801]: Accepted publickey for root from 192.168.201.13 port 37380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:32 oleg113-client systemd-logind[1020]: New session 149 of user root. May 25 03:46:32 oleg113-client systemd[1]: Started Session 149 of user root. May 25 03:46:32 oleg113-client sshd[31801]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:33 oleg113-client sshd[31814]: Received disconnect from 192.168.201.13 port 37380:11: disconnected by user May 25 03:46:33 oleg113-client sshd[31814]: Disconnected from user root 192.168.201.13 port 37380 May 25 03:46:33 oleg113-client sshd[31801]: pam_unix(sshd:session): session closed for user root May 25 03:46:33 oleg113-client systemd[1]: session-149.scope: Succeeded. May 25 03:46:33 oleg113-client systemd-logind[1020]: Session 149 logged out. Waiting for processes to exit. May 25 03:46:33 oleg113-client systemd-logind[1020]: Removed session 149. May 25 03:46:35 oleg113-client sshd[31956]: Accepted publickey for root from 192.168.201.13 port 37382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:35 oleg113-client systemd-logind[1020]: New session 150 of user root. May 25 03:46:35 oleg113-client systemd[1]: Started Session 150 of user root. May 25 03:46:35 oleg113-client sshd[31956]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:46:35 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21g: drop open reply and close request while close and open are both in flight ========================================================== 03:46:33 (1779695193) May 25 03:46:35 oleg113-client sshd[31969]: Received disconnect from 192.168.201.13 port 37382:11: disconnected by user May 25 03:46:35 oleg113-client sshd[31969]: Disconnected from user root 192.168.201.13 port 37382 May 25 03:46:35 oleg113-client sshd[31956]: pam_unix(sshd:session): session closed for user root May 25 03:46:36 oleg113-client systemd[1]: session-150.scope: Succeeded. May 25 03:46:36 oleg113-client systemd-logind[1020]: Session 150 logged out. Waiting for processes to exit. May 25 03:46:36 oleg113-client systemd-logind[1020]: Removed session 150. May 25 03:46:59 oleg113-client sshd[32141]: Accepted publickey for root from 192.168.201.13 port 43852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:46:59 oleg113-client systemd-logind[1020]: New session 151 of user root. May 25 03:46:59 oleg113-client systemd[1]: Started Session 151 of user root. May 25 03:46:59 oleg113-client sshd[32141]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:00 oleg113-client sshd[32154]: Received disconnect from 192.168.201.13 port 43852:11: disconnected by user May 25 03:47:00 oleg113-client sshd[32154]: Disconnected from user root 192.168.201.13 port 43852 May 25 03:47:00 oleg113-client sshd[32141]: pam_unix(sshd:session): session closed for user root May 25 03:47:00 oleg113-client systemd[1]: session-151.scope: Succeeded. May 25 03:47:00 oleg113-client systemd-logind[1020]: Session 151 logged out. Waiting for processes to exit. May 25 03:47:00 oleg113-client systemd-logind[1020]: Removed session 151. May 25 03:47:01 oleg113-client sshd[32281]: Accepted publickey for root from 192.168.201.13 port 43854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:01 oleg113-client systemd-logind[1020]: New session 152 of user root. May 25 03:47:01 oleg113-client systemd[1]: Started Session 152 of user root. May 25 03:47:01 oleg113-client sshd[32281]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:02 oleg113-client sshd[32294]: Received disconnect from 192.168.201.13 port 43854:11: disconnected by user May 25 03:47:02 oleg113-client sshd[32294]: Disconnected from user root 192.168.201.13 port 43854 May 25 03:47:02 oleg113-client sshd[32281]: pam_unix(sshd:session): session closed for user root May 25 03:47:02 oleg113-client systemd-logind[1020]: Session 152 logged out. Waiting for processes to exit. May 25 03:47:02 oleg113-client systemd[1]: session-152.scope: Succeeded. May 25 03:47:02 oleg113-client systemd-logind[1020]: Removed session 152. May 25 03:47:04 oleg113-client sshd[32428]: Accepted publickey for root from 192.168.201.13 port 43870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:04 oleg113-client systemd-logind[1020]: New session 153 of user root. May 25 03:47:04 oleg113-client systemd[1]: Started Session 153 of user root. May 25 03:47:04 oleg113-client sshd[32428]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:05 oleg113-client sshd[32441]: Received disconnect from 192.168.201.13 port 43870:11: disconnected by user May 25 03:47:05 oleg113-client sshd[32441]: Disconnected from user root 192.168.201.13 port 43870 May 25 03:47:05 oleg113-client sshd[32428]: pam_unix(sshd:session): session closed for user root May 25 03:47:05 oleg113-client systemd[1]: session-153.scope: Succeeded. May 25 03:47:05 oleg113-client systemd-logind[1020]: Session 153 logged out. Waiting for processes to exit. May 25 03:47:05 oleg113-client systemd-logind[1020]: Removed session 153. May 25 03:47:06 oleg113-client sshd[32583]: Accepted publickey for root from 192.168.201.13 port 43874 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:06 oleg113-client systemd-logind[1020]: New session 154 of user root. May 25 03:47:06 oleg113-client systemd[1]: Started Session 154 of user root. May 25 03:47:06 oleg113-client sshd[32583]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:06 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21h: drop open request and close reply while close and open are both in flight ========================================================== 03:47:05 (1779695225) May 25 03:47:06 oleg113-client sshd[32596]: Received disconnect from 192.168.201.13 port 43874:11: disconnected by user May 25 03:47:06 oleg113-client sshd[32596]: Disconnected from user root 192.168.201.13 port 43874 May 25 03:47:06 oleg113-client sshd[32583]: pam_unix(sshd:session): session closed for user root May 25 03:47:07 oleg113-client systemd-logind[1020]: Session 154 logged out. Waiting for processes to exit. May 25 03:47:07 oleg113-client systemd[1]: session-154.scope: Succeeded. May 25 03:47:07 oleg113-client systemd-logind[1020]: Removed session 154. May 25 03:47:28 oleg113-client sshd[32769]: Accepted publickey for root from 192.168.201.13 port 57400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:28 oleg113-client systemd-logind[1020]: New session 155 of user root. May 25 03:47:28 oleg113-client systemd[1]: Started Session 155 of user root. May 25 03:47:28 oleg113-client sshd[32769]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:29 oleg113-client sshd[32782]: Received disconnect from 192.168.201.13 port 57400:11: disconnected by user May 25 03:47:29 oleg113-client sshd[32782]: Disconnected from user root 192.168.201.13 port 57400 May 25 03:47:29 oleg113-client sshd[32769]: pam_unix(sshd:session): session closed for user root May 25 03:47:29 oleg113-client systemd[1]: session-155.scope: Succeeded. May 25 03:47:29 oleg113-client systemd-logind[1020]: Session 155 logged out. Waiting for processes to exit. May 25 03:47:29 oleg113-client systemd-logind[1020]: Removed session 155. May 25 03:47:31 oleg113-client sshd[32908]: Accepted publickey for root from 192.168.201.13 port 56508 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:31 oleg113-client systemd[1]: Started Session 156 of user root. May 25 03:47:31 oleg113-client systemd-logind[1020]: New session 156 of user root. May 25 03:47:31 oleg113-client sshd[32908]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:32 oleg113-client sshd[32921]: Received disconnect from 192.168.201.13 port 56508:11: disconnected by user May 25 03:47:32 oleg113-client sshd[32921]: Disconnected from user root 192.168.201.13 port 56508 May 25 03:47:32 oleg113-client sshd[32908]: pam_unix(sshd:session): session closed for user root May 25 03:47:32 oleg113-client systemd-logind[1020]: Session 156 logged out. Waiting for processes to exit. May 25 03:47:32 oleg113-client systemd[1]: session-156.scope: Succeeded. May 25 03:47:32 oleg113-client systemd-logind[1020]: Removed session 156. May 25 03:47:34 oleg113-client sshd[33055]: Accepted publickey for root from 192.168.201.13 port 56518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:34 oleg113-client systemd-logind[1020]: New session 157 of user root. May 25 03:47:34 oleg113-client systemd[1]: Started Session 157 of user root. May 25 03:47:34 oleg113-client sshd[33055]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:34 oleg113-client sshd[33068]: Received disconnect from 192.168.201.13 port 56518:11: disconnected by user May 25 03:47:34 oleg113-client sshd[33068]: Disconnected from user root 192.168.201.13 port 56518 May 25 03:47:34 oleg113-client sshd[33055]: pam_unix(sshd:session): session closed for user root May 25 03:47:34 oleg113-client systemd[1]: session-157.scope: Succeeded. May 25 03:47:34 oleg113-client systemd-logind[1020]: Session 157 logged out. Waiting for processes to exit. May 25 03:47:35 oleg113-client systemd-logind[1020]: Removed session 157. May 25 03:47:36 oleg113-client sshd[33211]: Accepted publickey for root from 192.168.201.13 port 56530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:37 oleg113-client systemd[1]: Started Session 158 of user root. May 25 03:47:37 oleg113-client systemd-logind[1020]: New session 158 of user root. May 25 03:47:37 oleg113-client sshd[33211]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:37 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 22: drop close request and do mknod ========================================================== 03:47:35 (1779695255) May 25 03:47:37 oleg113-client sshd[33224]: Received disconnect from 192.168.201.13 port 56530:11: disconnected by user May 25 03:47:37 oleg113-client sshd[33224]: Disconnected from user root 192.168.201.13 port 56530 May 25 03:47:37 oleg113-client sshd[33211]: pam_unix(sshd:session): session closed for user root May 25 03:47:38 oleg113-client systemd[1]: session-158.scope: Succeeded. May 25 03:47:38 oleg113-client systemd-logind[1020]: Session 158 logged out. Waiting for processes to exit. May 25 03:47:38 oleg113-client systemd-logind[1020]: Removed session 158. May 25 03:47:57 oleg113-client sshd[33376]: Accepted publickey for root from 192.168.201.13 port 48494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:47:57 oleg113-client systemd-logind[1020]: New session 159 of user root. May 25 03:47:57 oleg113-client systemd[1]: Started Session 159 of user root. May 25 03:47:57 oleg113-client sshd[33376]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:47:57 oleg113-client sshd[33389]: Received disconnect from 192.168.201.13 port 48494:11: disconnected by user May 25 03:47:58 oleg113-client sshd[33389]: Disconnected from user root 192.168.201.13 port 48494 May 25 03:47:58 oleg113-client sshd[33376]: pam_unix(sshd:session): session closed for user root May 25 03:47:58 oleg113-client systemd[1]: session-159.scope: Succeeded. May 25 03:47:58 oleg113-client systemd-logind[1020]: Session 159 logged out. Waiting for processes to exit. May 25 03:47:58 oleg113-client systemd-logind[1020]: Removed session 159. May 25 03:48:01 oleg113-client sshd[33515]: Accepted publickey for root from 192.168.201.13 port 54864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:01 oleg113-client systemd-logind[1020]: New session 160 of user root. May 25 03:48:01 oleg113-client systemd[1]: Started Session 160 of user root. May 25 03:48:01 oleg113-client sshd[33515]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:01 oleg113-client sshd[33528]: Received disconnect from 192.168.201.13 port 54864:11: disconnected by user May 25 03:48:02 oleg113-client sshd[33528]: Disconnected from user root 192.168.201.13 port 54864 May 25 03:48:02 oleg113-client sshd[33515]: pam_unix(sshd:session): session closed for user root May 25 03:48:02 oleg113-client systemd-logind[1020]: Session 160 logged out. Waiting for processes to exit. May 25 03:48:02 oleg113-client systemd[1]: session-160.scope: Succeeded. May 25 03:48:02 oleg113-client systemd-logind[1020]: Removed session 160. May 25 03:48:03 oleg113-client sshd[33662]: Accepted publickey for root from 192.168.201.13 port 54868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:04 oleg113-client systemd-logind[1020]: New session 161 of user root. May 25 03:48:04 oleg113-client systemd[1]: Started Session 161 of user root. May 25 03:48:04 oleg113-client sshd[33662]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:05 oleg113-client sshd[33675]: Received disconnect from 192.168.201.13 port 54868:11: disconnected by user May 25 03:48:05 oleg113-client sshd[33675]: Disconnected from user root 192.168.201.13 port 54868 May 25 03:48:05 oleg113-client sshd[33662]: pam_unix(sshd:session): session closed for user root May 25 03:48:05 oleg113-client systemd-logind[1020]: Session 161 logged out. Waiting for processes to exit. May 25 03:48:05 oleg113-client systemd[1]: session-161.scope: Succeeded. May 25 03:48:05 oleg113-client systemd-logind[1020]: Removed session 161. May 25 03:48:08 oleg113-client sshd[33817]: Accepted publickey for root from 192.168.201.13 port 54870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:08 oleg113-client systemd-logind[1020]: New session 162 of user root. May 25 03:48:08 oleg113-client systemd[1]: Started Session 162 of user root. May 25 03:48:08 oleg113-client sshd[33817]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:08 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 23: client hang when close a file after mds crash ========================================================== 03:48:05 (1779695285) May 25 03:48:08 oleg113-client sshd[33830]: Received disconnect from 192.168.201.13 port 54870:11: disconnected by user May 25 03:48:08 oleg113-client sshd[33830]: Disconnected from user root 192.168.201.13 port 54870 May 25 03:48:09 oleg113-client sshd[33817]: pam_unix(sshd:session): session closed for user root May 25 03:48:09 oleg113-client systemd[1]: session-162.scope: Succeeded. May 25 03:48:09 oleg113-client systemd-logind[1020]: Session 162 logged out. Waiting for processes to exit. May 25 03:48:09 oleg113-client systemd-logind[1020]: Removed session 162. May 25 03:48:37 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:48:47 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f5001d to 0x58062bb2b3f526b2 May 25 03:48:59 oleg113-client sshd[34163]: Accepted publickey for root from 192.168.201.13 port 51162 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:48:59 oleg113-client systemd[1]: Started Session 163 of user root. May 25 03:48:59 oleg113-client systemd-logind[1020]: New session 163 of user root. May 25 03:48:59 oleg113-client sshd[34163]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:48:59 oleg113-client sshd[34177]: Received disconnect from 192.168.201.13 port 51162:11: disconnected by user May 25 03:48:59 oleg113-client sshd[34177]: Disconnected from user root 192.168.201.13 port 51162 May 25 03:48:59 oleg113-client sshd[34163]: pam_unix(sshd:session): session closed for user root May 25 03:49:00 oleg113-client systemd[1]: session-163.scope: Succeeded. May 25 03:49:00 oleg113-client systemd-logind[1020]: Session 163 logged out. Waiting for processes to exit. May 25 03:49:00 oleg113-client systemd-logind[1020]: Removed session 163. May 25 03:49:03 oleg113-client sshd[34399]: Accepted publickey for root from 192.168.201.13 port 35898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:03 oleg113-client systemd-logind[1020]: New session 164 of user root. May 25 03:49:04 oleg113-client systemd[1]: Started Session 164 of user root. May 25 03:49:04 oleg113-client sshd[34399]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:04 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:49:04 oleg113-client sshd[34412]: Received disconnect from 192.168.201.13 port 35898:11: disconnected by user May 25 03:49:04 oleg113-client sshd[34412]: Disconnected from user root 192.168.201.13 port 35898 May 25 03:49:04 oleg113-client sshd[34399]: pam_unix(sshd:session): session closed for user root May 25 03:49:04 oleg113-client systemd[1]: session-164.scope: Succeeded. May 25 03:49:04 oleg113-client systemd-logind[1020]: Session 164 logged out. Waiting for processes to exit. May 25 03:49:04 oleg113-client systemd-logind[1020]: Removed session 164. May 25 03:49:06 oleg113-client sshd[34555]: Accepted publickey for root from 192.168.201.13 port 35914 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:06 oleg113-client systemd-logind[1020]: New session 165 of user root. May 25 03:49:06 oleg113-client systemd[1]: Started Session 165 of user root. May 25 03:49:06 oleg113-client sshd[34555]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:06 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:49:06 oleg113-client sshd[34569]: Received disconnect from 192.168.201.13 port 35914:11: disconnected by user May 25 03:49:06 oleg113-client sshd[34569]: Disconnected from user root 192.168.201.13 port 35914 May 25 03:49:06 oleg113-client sshd[34555]: pam_unix(sshd:session): session closed for user root May 25 03:49:06 oleg113-client systemd-logind[1020]: Session 165 logged out. Waiting for processes to exit. May 25 03:49:06 oleg113-client systemd[1]: session-165.scope: Succeeded. May 25 03:49:06 oleg113-client systemd-logind[1020]: Removed session 165. May 25 03:49:08 oleg113-client sshd[34611]: Accepted publickey for root from 192.168.201.13 port 35920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:08 oleg113-client systemd-logind[1020]: New session 166 of user root. May 25 03:49:08 oleg113-client systemd[1]: Started Session 166 of user root. May 25 03:49:08 oleg113-client sshd[34611]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:08 oleg113-client sshd[34625]: Received disconnect from 192.168.201.13 port 35920:11: disconnected by user May 25 03:49:08 oleg113-client sshd[34625]: Disconnected from user root 192.168.201.13 port 35920 May 25 03:49:08 oleg113-client sshd[34611]: pam_unix(sshd:session): session closed for user root May 25 03:49:09 oleg113-client systemd[1]: session-166.scope: Succeeded. May 25 03:49:09 oleg113-client systemd-logind[1020]: Session 166 logged out. Waiting for processes to exit. May 25 03:49:09 oleg113-client systemd-logind[1020]: Removed session 166. May 25 03:49:10 oleg113-client sshd[34745]: Accepted publickey for root from 192.168.201.13 port 53050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:10 oleg113-client systemd-logind[1020]: New session 167 of user root. May 25 03:49:10 oleg113-client systemd[1]: Started Session 167 of user root. May 25 03:49:10 oleg113-client sshd[34745]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:10 oleg113-client sshd[34758]: Received disconnect from 192.168.201.13 port 53050:11: disconnected by user May 25 03:49:10 oleg113-client sshd[34758]: Disconnected from user root 192.168.201.13 port 53050 May 25 03:49:10 oleg113-client sshd[34745]: pam_unix(sshd:session): session closed for user root May 25 03:49:10 oleg113-client systemd[1]: session-167.scope: Succeeded. May 25 03:49:10 oleg113-client systemd-logind[1020]: Session 167 logged out. Waiting for processes to exit. May 25 03:49:10 oleg113-client systemd-logind[1020]: Removed session 167. May 25 03:49:12 oleg113-client sshd[34884]: Accepted publickey for root from 192.168.201.13 port 53058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:12 oleg113-client systemd-logind[1020]: New session 168 of user root. May 25 03:49:12 oleg113-client systemd[1]: Started Session 168 of user root. May 25 03:49:12 oleg113-client sshd[34884]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:13 oleg113-client sshd[34897]: Received disconnect from 192.168.201.13 port 53058:11: disconnected by user May 25 03:49:13 oleg113-client sshd[34897]: Disconnected from user root 192.168.201.13 port 53058 May 25 03:49:13 oleg113-client sshd[34884]: pam_unix(sshd:session): session closed for user root May 25 03:49:13 oleg113-client systemd[1]: session-168.scope: Succeeded. May 25 03:49:13 oleg113-client systemd-logind[1020]: Session 168 logged out. Waiting for processes to exit. May 25 03:49:13 oleg113-client systemd-logind[1020]: Removed session 168. May 25 03:49:14 oleg113-client sshd[35031]: Accepted publickey for root from 192.168.201.13 port 53072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:14 oleg113-client systemd-logind[1020]: New session 169 of user root. May 25 03:49:14 oleg113-client systemd[1]: Started Session 169 of user root. May 25 03:49:14 oleg113-client sshd[35031]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:15 oleg113-client sshd[35044]: Received disconnect from 192.168.201.13 port 53072:11: disconnected by user May 25 03:49:15 oleg113-client sshd[35044]: Disconnected from user root 192.168.201.13 port 53072 May 25 03:49:15 oleg113-client sshd[35031]: pam_unix(sshd:session): session closed for user root May 25 03:49:15 oleg113-client systemd[1]: session-169.scope: Succeeded. May 25 03:49:15 oleg113-client systemd-logind[1020]: Session 169 logged out. Waiting for processes to exit. May 25 03:49:15 oleg113-client systemd-logind[1020]: Removed session 169. May 25 03:49:17 oleg113-client sshd[35186]: Accepted publickey for root from 192.168.201.13 port 53078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:17 oleg113-client systemd-logind[1020]: New session 170 of user root. May 25 03:49:17 oleg113-client systemd[1]: Started Session 170 of user root. May 25 03:49:17 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 03:49:17 oleg113-client sshd[35186]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:17 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24a: fsync error (should return error) ========================================================== 03:49:15 (1779695355) May 25 03:49:17 oleg113-client sshd[35200]: Received disconnect from 192.168.201.13 port 53078:11: disconnected by user May 25 03:49:17 oleg113-client sshd[35200]: Disconnected from user root 192.168.201.13 port 53078 May 25 03:49:17 oleg113-client sshd[35186]: pam_unix(sshd:session): session closed for user root May 25 03:49:18 oleg113-client systemd[1]: session-170.scope: Succeeded. May 25 03:49:18 oleg113-client systemd-logind[1020]: Session 170 logged out. Waiting for processes to exit. May 25 03:49:18 oleg113-client systemd-logind[1020]: Removed session 170. May 25 03:49:19 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ost_write to node 192.168.201.113@tcp failed: rc = -107 May 25 03:49:19 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:49:19 oleg113-client kernel: Lustre: 2421:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.113@tcp:/lustre/fid: [0x240000402:0x8:0x0]// may get corrupted (rc -5) May 25 03:49:21 oleg113-client sshd[35386]: Accepted publickey for root from 192.168.201.13 port 40004 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:21 oleg113-client systemd-logind[1020]: New session 171 of user root. May 25 03:49:21 oleg113-client systemd[1]: Started Session 171 of user root. May 25 03:49:21 oleg113-client sshd[35386]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:21 oleg113-client sshd[35399]: Received disconnect from 192.168.201.13 port 40004:11: disconnected by user May 25 03:49:21 oleg113-client sshd[35399]: Disconnected from user root 192.168.201.13 port 40004 May 25 03:49:21 oleg113-client sshd[35386]: pam_unix(sshd:session): session closed for user root May 25 03:49:22 oleg113-client systemd[1]: session-171.scope: Succeeded. May 25 03:49:22 oleg113-client systemd-logind[1020]: Session 171 logged out. Waiting for processes to exit. May 25 03:49:22 oleg113-client systemd-logind[1020]: Removed session 171. May 25 03:49:23 oleg113-client sshd[35525]: Accepted publickey for root from 192.168.201.13 port 40016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:23 oleg113-client systemd-logind[1020]: New session 172 of user root. May 25 03:49:23 oleg113-client systemd[1]: Started Session 172 of user root. May 25 03:49:23 oleg113-client sshd[35525]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:23 oleg113-client sshd[35538]: Received disconnect from 192.168.201.13 port 40016:11: disconnected by user May 25 03:49:23 oleg113-client sshd[35538]: Disconnected from user root 192.168.201.13 port 40016 May 25 03:49:23 oleg113-client sshd[35525]: pam_unix(sshd:session): session closed for user root May 25 03:49:24 oleg113-client systemd[1]: session-172.scope: Succeeded. May 25 03:49:24 oleg113-client systemd-logind[1020]: Session 172 logged out. Waiting for processes to exit. May 25 03:49:24 oleg113-client systemd-logind[1020]: Removed session 172. May 25 03:49:25 oleg113-client sshd[35671]: Accepted publickey for root from 192.168.201.13 port 40030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:25 oleg113-client systemd-logind[1020]: New session 173 of user root. May 25 03:49:25 oleg113-client systemd[1]: Started Session 173 of user root. May 25 03:49:25 oleg113-client sshd[35671]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:25 oleg113-client sshd[35684]: Received disconnect from 192.168.201.13 port 40030:11: disconnected by user May 25 03:49:25 oleg113-client sshd[35684]: Disconnected from user root 192.168.201.13 port 40030 May 25 03:49:25 oleg113-client sshd[35671]: pam_unix(sshd:session): session closed for user root May 25 03:49:26 oleg113-client systemd[1]: session-173.scope: Succeeded. May 25 03:49:26 oleg113-client systemd-logind[1020]: Session 173 logged out. Waiting for processes to exit. May 25 03:49:26 oleg113-client systemd-logind[1020]: Removed session 173. May 25 03:49:27 oleg113-client sshd[35826]: Accepted publickey for root from 192.168.201.13 port 40036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:27 oleg113-client systemd-logind[1020]: New session 174 of user root. May 25 03:49:28 oleg113-client systemd[1]: Started Session 174 of user root. May 25 03:49:28 oleg113-client sshd[35826]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:28 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 03:49:26 (1779695366) May 25 03:49:28 oleg113-client sshd[35840]: Received disconnect from 192.168.201.13 port 40036:11: disconnected by user May 25 03:49:28 oleg113-client sshd[35840]: Disconnected from user root 192.168.201.13 port 40036 May 25 03:49:28 oleg113-client sshd[35826]: pam_unix(sshd:session): session closed for user root May 25 03:49:28 oleg113-client systemd[1]: session-174.scope: Succeeded. May 25 03:49:28 oleg113-client systemd-logind[1020]: Session 174 logged out. Waiting for processes to exit. May 25 03:49:28 oleg113-client systemd-logind[1020]: Removed session 174. May 25 03:49:31 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ost_sync to node 192.168.201.113@tcp failed: rc = -107 May 25 03:49:31 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 03:49:31 oleg113-client kernel: Lustre: 2422:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.113@tcp:/lustre/fid: [0x200000405:0x2f:0x0]// may get corrupted (rc -108) May 25 03:49:33 oleg113-client sshd[36031]: Accepted publickey for root from 192.168.201.13 port 53052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:33 oleg113-client systemd-logind[1020]: New session 175 of user root. May 25 03:49:33 oleg113-client systemd[1]: Started Session 175 of user root. May 25 03:49:33 oleg113-client sshd[36031]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:34 oleg113-client sshd[36045]: Received disconnect from 192.168.201.13 port 53052:11: disconnected by user May 25 03:49:34 oleg113-client sshd[36045]: Disconnected from user root 192.168.201.13 port 53052 May 25 03:49:34 oleg113-client sshd[36031]: pam_unix(sshd:session): session closed for user root May 25 03:49:34 oleg113-client systemd[1]: session-175.scope: Succeeded. May 25 03:49:34 oleg113-client systemd-logind[1020]: Session 175 logged out. Waiting for processes to exit. May 25 03:49:34 oleg113-client systemd-logind[1020]: Removed session 175. May 25 03:49:35 oleg113-client sshd[36171]: Accepted publickey for root from 192.168.201.13 port 53056 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:35 oleg113-client systemd-logind[1020]: New session 176 of user root. May 25 03:49:35 oleg113-client systemd[1]: Started Session 176 of user root. May 25 03:49:35 oleg113-client sshd[36171]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:35 oleg113-client sshd[36184]: Received disconnect from 192.168.201.13 port 53056:11: disconnected by user May 25 03:49:35 oleg113-client sshd[36184]: Disconnected from user root 192.168.201.13 port 53056 May 25 03:49:35 oleg113-client sshd[36171]: pam_unix(sshd:session): session closed for user root May 25 03:49:35 oleg113-client systemd-logind[1020]: Session 176 logged out. Waiting for processes to exit. May 25 03:49:35 oleg113-client systemd[1]: session-176.scope: Succeeded. May 25 03:49:36 oleg113-client systemd-logind[1020]: Removed session 176. May 25 03:49:37 oleg113-client sshd[36317]: Accepted publickey for root from 192.168.201.13 port 53060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:37 oleg113-client systemd-logind[1020]: New session 177 of user root. May 25 03:49:37 oleg113-client systemd[1]: Started Session 177 of user root. May 25 03:49:37 oleg113-client sshd[36317]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:38 oleg113-client sshd[36330]: Received disconnect from 192.168.201.13 port 53060:11: disconnected by user May 25 03:49:38 oleg113-client sshd[36330]: Disconnected from user root 192.168.201.13 port 53060 May 25 03:49:38 oleg113-client sshd[36317]: pam_unix(sshd:session): session closed for user root May 25 03:49:38 oleg113-client systemd-logind[1020]: Session 177 logged out. Waiting for processes to exit. May 25 03:49:38 oleg113-client systemd[1]: session-177.scope: Succeeded. May 25 03:49:38 oleg113-client systemd-logind[1020]: Removed session 177. May 25 03:49:39 oleg113-client sshd[36472]: Accepted publickey for root from 192.168.201.13 port 46248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:39 oleg113-client systemd-logind[1020]: New session 178 of user root. May 25 03:49:39 oleg113-client systemd[1]: Started Session 178 of user root. May 25 03:49:39 oleg113-client sshd[36472]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:40 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 03:49:38 (1779695378) May 25 03:49:40 oleg113-client sshd[36485]: Received disconnect from 192.168.201.13 port 46248:11: disconnected by user May 25 03:49:40 oleg113-client sshd[36485]: Disconnected from user root 192.168.201.13 port 46248 May 25 03:49:40 oleg113-client sshd[36472]: pam_unix(sshd:session): session closed for user root May 25 03:49:40 oleg113-client systemd[1]: session-178.scope: Succeeded. May 25 03:49:40 oleg113-client systemd-logind[1020]: Session 178 logged out. Waiting for processes to exit. May 25 03:49:40 oleg113-client systemd-logind[1020]: Removed session 178. May 25 03:49:43 oleg113-client sshd[36706]: Accepted publickey for root from 192.168.201.13 port 46256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:43 oleg113-client systemd[1]: Started Session 179 of user root. May 25 03:49:43 oleg113-client systemd-logind[1020]: New session 179 of user root. May 25 03:49:43 oleg113-client sshd[36706]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:43 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node May 25 03:49:43 oleg113-client sshd[36719]: Received disconnect from 192.168.201.13 port 46256:11: disconnected by user May 25 03:49:43 oleg113-client sshd[36719]: Disconnected from user root 192.168.201.13 port 46256 May 25 03:49:43 oleg113-client sshd[36706]: pam_unix(sshd:session): session closed for user root May 25 03:49:43 oleg113-client systemd[1]: session-179.scope: Succeeded. May 25 03:49:43 oleg113-client systemd-logind[1020]: Session 179 logged out. Waiting for processes to exit. May 25 03:49:43 oleg113-client systemd-logind[1020]: Removed session 179. May 25 03:49:45 oleg113-client sshd[36860]: Accepted publickey for root from 192.168.201.13 port 46266 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:45 oleg113-client systemd-logind[1020]: New session 180 of user root. May 25 03:49:45 oleg113-client systemd[1]: Started Session 180 of user root. May 25 03:49:45 oleg113-client sshd[36860]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:46 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 03:49:44 (1779695384) May 25 03:49:46 oleg113-client sshd[36873]: Received disconnect from 192.168.201.13 port 46266:11: disconnected by user May 25 03:49:46 oleg113-client sshd[36873]: Disconnected from user root 192.168.201.13 port 46266 May 25 03:49:46 oleg113-client sshd[36860]: pam_unix(sshd:session): session closed for user root May 25 03:49:46 oleg113-client systemd[1]: session-180.scope: Succeeded. May 25 03:49:46 oleg113-client systemd-logind[1020]: Session 180 logged out. Waiting for processes to exit. May 25 03:49:46 oleg113-client systemd-logind[1020]: Removed session 180. May 25 03:49:48 oleg113-client sshd[37032]: Accepted publickey for root from 192.168.201.13 port 46280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:48 oleg113-client systemd-logind[1020]: New session 181 of user root. May 25 03:49:48 oleg113-client systemd[1]: Started Session 181 of user root. May 25 03:49:48 oleg113-client sshd[37032]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:48 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node May 25 03:49:48 oleg113-client sshd[37045]: Received disconnect from 192.168.201.13 port 46280:11: disconnected by user May 25 03:49:48 oleg113-client sshd[37045]: Disconnected from user root 192.168.201.13 port 46280 May 25 03:49:48 oleg113-client sshd[37032]: pam_unix(sshd:session): session closed for user root May 25 03:49:48 oleg113-client systemd[1]: session-181.scope: Succeeded. May 25 03:49:48 oleg113-client systemd-logind[1020]: Session 181 logged out. Waiting for processes to exit. May 25 03:49:48 oleg113-client systemd-logind[1020]: Removed session 181. May 25 03:49:51 oleg113-client sshd[37186]: Accepted publickey for root from 192.168.201.13 port 37094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:49:51 oleg113-client systemd-logind[1020]: New session 182 of user root. May 25 03:49:51 oleg113-client systemd[1]: Started Session 182 of user root. May 25 03:49:51 oleg113-client sshd[37186]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:49:51 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 03:49:49 (1779695389) May 25 03:49:51 oleg113-client sshd[37200]: Received disconnect from 192.168.201.13 port 37094:11: disconnected by user May 25 03:49:51 oleg113-client sshd[37200]: Disconnected from user root 192.168.201.13 port 37094 May 25 03:49:51 oleg113-client sshd[37186]: pam_unix(sshd:session): session closed for user root May 25 03:49:51 oleg113-client systemd[1]: session-182.scope: Succeeded. May 25 03:49:51 oleg113-client systemd-logind[1020]: Session 182 logged out. Waiting for processes to exit. May 25 03:49:51 oleg113-client systemd-logind[1020]: Removed session 182. May 25 03:49:56 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation mds_close to node 192.168.201.113@tcp failed: rc = -19 May 25 03:49:56 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 03:50:15 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:50:25 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f526b2 to 0x58062bb2b3f53de2 May 25 03:52:11 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation mds_reint to node 192.168.201.113@tcp failed: rc = -19 May 25 03:52:11 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 03:52:11 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 03:52:11 oleg113-client kernel: Lustre: Skipped 11 previous similar messages May 25 03:52:29 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779695533/real 1779695533] req@ffff9b15c64ec700 x1866143486482048/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779695549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 03:52:29 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 9 previous similar messages May 25 03:52:29 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:52:39 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f53de2 to 0x58062bb2b3f6e879 May 25 03:52:39 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 03:52:39 oleg113-client kernel: Lustre: Skipped 12 previous similar messages May 25 03:52:40 oleg113-client kernel: Lustre: 16829:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 03:52:52 oleg113-client sshd[38172]: Accepted publickey for root from 192.168.201.13 port 56032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:52 oleg113-client systemd-logind[1020]: New session 183 of user root. May 25 03:52:52 oleg113-client systemd[1]: Started Session 183 of user root. May 25 03:52:52 oleg113-client sshd[38172]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:53 oleg113-client sshd[38185]: Received disconnect from 192.168.201.13 port 56032:11: disconnected by user May 25 03:52:53 oleg113-client sshd[38185]: Disconnected from user root 192.168.201.13 port 56032 May 25 03:52:53 oleg113-client sshd[38172]: pam_unix(sshd:session): session closed for user root May 25 03:52:53 oleg113-client systemd[1]: session-183.scope: Succeeded. May 25 03:52:53 oleg113-client systemd-logind[1020]: Session 183 logged out. Waiting for processes to exit. May 25 03:52:53 oleg113-client systemd-logind[1020]: Removed session 183. May 25 03:52:54 oleg113-client sshd[38311]: Accepted publickey for root from 192.168.201.13 port 56048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:54 oleg113-client systemd-logind[1020]: New session 184 of user root. May 25 03:52:54 oleg113-client systemd[1]: Started Session 184 of user root. May 25 03:52:54 oleg113-client sshd[38311]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:55 oleg113-client sshd[38324]: Received disconnect from 192.168.201.13 port 56048:11: disconnected by user May 25 03:52:55 oleg113-client sshd[38324]: Disconnected from user root 192.168.201.13 port 56048 May 25 03:52:55 oleg113-client sshd[38311]: pam_unix(sshd:session): session closed for user root May 25 03:52:55 oleg113-client systemd[1]: session-184.scope: Succeeded. May 25 03:52:55 oleg113-client systemd-logind[1020]: Session 184 logged out. Waiting for processes to exit. May 25 03:52:55 oleg113-client systemd-logind[1020]: Removed session 184. May 25 03:52:56 oleg113-client sshd[38457]: Accepted publickey for root from 192.168.201.13 port 56052 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:56 oleg113-client systemd-logind[1020]: New session 185 of user root. May 25 03:52:56 oleg113-client systemd[1]: Started Session 185 of user root. May 25 03:52:56 oleg113-client sshd[38457]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:57 oleg113-client sshd[38470]: Received disconnect from 192.168.201.13 port 56052:11: disconnected by user May 25 03:52:57 oleg113-client sshd[38470]: Disconnected from user root 192.168.201.13 port 56052 May 25 03:52:57 oleg113-client sshd[38457]: pam_unix(sshd:session): session closed for user root May 25 03:52:57 oleg113-client systemd[1]: session-185.scope: Succeeded. May 25 03:52:57 oleg113-client systemd-logind[1020]: Session 185 logged out. Waiting for processes to exit. May 25 03:52:57 oleg113-client systemd-logind[1020]: Removed session 185. May 25 03:52:59 oleg113-client sshd[38614]: Accepted publickey for root from 192.168.201.13 port 51594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:52:59 oleg113-client systemd-logind[1020]: New session 186 of user root. May 25 03:52:59 oleg113-client systemd[1]: Started Session 186 of user root. May 25 03:52:59 oleg113-client sshd[38614]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:52:59 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 03:52:57 (1779695577) May 25 03:52:59 oleg113-client sshd[38627]: Received disconnect from 192.168.201.13 port 51594:11: disconnected by user May 25 03:52:59 oleg113-client sshd[38627]: Disconnected from user root 192.168.201.13 port 51594 May 25 03:52:59 oleg113-client sshd[38614]: pam_unix(sshd:session): session closed for user root May 25 03:53:00 oleg113-client systemd-logind[1020]: Session 186 logged out. Waiting for processes to exit. May 25 03:53:00 oleg113-client systemd[1]: session-186.scope: Succeeded. May 25 03:53:00 oleg113-client systemd-logind[1020]: Removed session 186. May 25 03:53:00 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 03:53:21 oleg113-client sshd[38721]: Accepted publickey for root from 192.168.201.13 port 51808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:53:21 oleg113-client systemd-logind[1020]: New session 187 of user root. May 25 03:53:21 oleg113-client systemd[1]: Started Session 187 of user root. May 25 03:53:21 oleg113-client sshd[38721]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:53:22 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ost_connect to node 192.168.201.113@tcp failed: rc = -75 May 25 03:53:23 oleg113-client sshd[38734]: Received disconnect from 192.168.201.13 port 51808:11: disconnected by user May 25 03:53:23 oleg113-client sshd[38734]: Disconnected from user root 192.168.201.13 port 51808 May 25 03:53:23 oleg113-client sshd[38721]: pam_unix(sshd:session): session closed for user root May 25 03:53:24 oleg113-client systemd[1]: session-187.scope: Succeeded. May 25 03:53:24 oleg113-client systemd-logind[1020]: Session 187 logged out. Waiting for processes to exit. May 25 03:53:24 oleg113-client systemd-logind[1020]: Removed session 187. May 25 03:53:44 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:53:54 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f6e879 to 0x58062bb2b3f70146 May 25 03:54:04 oleg113-client sshd[39038]: Accepted publickey for root from 192.168.201.13 port 48378 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:04 oleg113-client systemd-logind[1020]: New session 188 of user root. May 25 03:54:04 oleg113-client systemd[1]: Started Session 188 of user root. May 25 03:54:04 oleg113-client sshd[39038]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:05 oleg113-client sshd[39051]: Received disconnect from 192.168.201.13 port 48378:11: disconnected by user May 25 03:54:05 oleg113-client sshd[39051]: Disconnected from user root 192.168.201.13 port 48378 May 25 03:54:05 oleg113-client sshd[39038]: pam_unix(sshd:session): session closed for user root May 25 03:54:05 oleg113-client systemd[1]: session-188.scope: Succeeded. May 25 03:54:05 oleg113-client systemd-logind[1020]: Session 188 logged out. Waiting for processes to exit. May 25 03:54:05 oleg113-client systemd-logind[1020]: Removed session 188. May 25 03:54:09 oleg113-client sshd[39274]: Accepted publickey for root from 192.168.201.13 port 48380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:09 oleg113-client systemd-logind[1020]: New session 189 of user root. May 25 03:54:09 oleg113-client systemd[1]: Started Session 189 of user root. May 25 03:54:09 oleg113-client sshd[39274]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:09 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:54:09 oleg113-client sshd[39287]: Received disconnect from 192.168.201.13 port 48380:11: disconnected by user May 25 03:54:09 oleg113-client sshd[39287]: Disconnected from user root 192.168.201.13 port 48380 May 25 03:54:09 oleg113-client sshd[39274]: pam_unix(sshd:session): session closed for user root May 25 03:54:09 oleg113-client systemd[1]: session-189.scope: Succeeded. May 25 03:54:09 oleg113-client systemd-logind[1020]: Session 189 logged out. Waiting for processes to exit. May 25 03:54:09 oleg113-client systemd-logind[1020]: Removed session 189. May 25 03:54:10 oleg113-client sshd[39430]: Accepted publickey for root from 192.168.201.13 port 34278 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:11 oleg113-client systemd-logind[1020]: New session 190 of user root. May 25 03:54:11 oleg113-client systemd[1]: Started Session 190 of user root. May 25 03:54:11 oleg113-client sshd[39430]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:11 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:54:11 oleg113-client sshd[39443]: Received disconnect from 192.168.201.13 port 34278:11: disconnected by user May 25 03:54:11 oleg113-client sshd[39443]: Disconnected from user root 192.168.201.13 port 34278 May 25 03:54:11 oleg113-client sshd[39430]: pam_unix(sshd:session): session closed for user root May 25 03:54:11 oleg113-client systemd-logind[1020]: Session 190 logged out. Waiting for processes to exit. May 25 03:54:11 oleg113-client systemd[1]: session-190.scope: Succeeded. May 25 03:54:11 oleg113-client systemd-logind[1020]: Removed session 190. May 25 03:54:13 oleg113-client sshd[39484]: Accepted publickey for root from 192.168.201.13 port 34288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:13 oleg113-client systemd-logind[1020]: New session 191 of user root. May 25 03:54:13 oleg113-client systemd[1]: Started Session 191 of user root. May 25 03:54:13 oleg113-client sshd[39484]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:13 oleg113-client sshd[39497]: Received disconnect from 192.168.201.13 port 34288:11: disconnected by user May 25 03:54:13 oleg113-client sshd[39497]: Disconnected from user root 192.168.201.13 port 34288 May 25 03:54:13 oleg113-client sshd[39484]: pam_unix(sshd:session): session closed for user root May 25 03:54:13 oleg113-client systemd[1]: session-191.scope: Succeeded. May 25 03:54:13 oleg113-client systemd-logind[1020]: Session 191 logged out. Waiting for processes to exit. May 25 03:54:14 oleg113-client systemd-logind[1020]: Removed session 191. May 25 03:54:15 oleg113-client sshd[39617]: Accepted publickey for root from 192.168.201.13 port 34304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:15 oleg113-client systemd-logind[1020]: New session 192 of user root. May 25 03:54:15 oleg113-client systemd[1]: Started Session 192 of user root. May 25 03:54:15 oleg113-client sshd[39617]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:15 oleg113-client sshd[39631]: Received disconnect from 192.168.201.13 port 34304:11: disconnected by user May 25 03:54:15 oleg113-client sshd[39631]: Disconnected from user root 192.168.201.13 port 34304 May 25 03:54:15 oleg113-client sshd[39617]: pam_unix(sshd:session): session closed for user root May 25 03:54:15 oleg113-client systemd[1]: session-192.scope: Succeeded. May 25 03:54:15 oleg113-client systemd-logind[1020]: Session 192 logged out. Waiting for processes to exit. May 25 03:54:15 oleg113-client systemd-logind[1020]: Removed session 192. May 25 03:54:17 oleg113-client sshd[39757]: Accepted publickey for root from 192.168.201.13 port 34314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:17 oleg113-client systemd[1]: Started Session 193 of user root. May 25 03:54:17 oleg113-client systemd-logind[1020]: New session 193 of user root. May 25 03:54:17 oleg113-client sshd[39757]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:17 oleg113-client sshd[39770]: Received disconnect from 192.168.201.13 port 34314:11: disconnected by user May 25 03:54:17 oleg113-client sshd[39770]: Disconnected from user root 192.168.201.13 port 34314 May 25 03:54:17 oleg113-client sshd[39757]: pam_unix(sshd:session): session closed for user root May 25 03:54:17 oleg113-client systemd[1]: session-193.scope: Succeeded. May 25 03:54:17 oleg113-client systemd-logind[1020]: Session 193 logged out. Waiting for processes to exit. May 25 03:54:17 oleg113-client systemd-logind[1020]: Removed session 193. May 25 03:54:18 oleg113-client sshd[39904]: Accepted publickey for root from 192.168.201.13 port 34320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:18 oleg113-client systemd-logind[1020]: New session 194 of user root. May 25 03:54:18 oleg113-client systemd[1]: Started Session 194 of user root. May 25 03:54:18 oleg113-client sshd[39904]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:19 oleg113-client sshd[39917]: Received disconnect from 192.168.201.13 port 34320:11: disconnected by user May 25 03:54:19 oleg113-client sshd[39917]: Disconnected from user root 192.168.201.13 port 34320 May 25 03:54:19 oleg113-client sshd[39904]: pam_unix(sshd:session): session closed for user root May 25 03:54:19 oleg113-client systemd-logind[1020]: Session 194 logged out. Waiting for processes to exit. May 25 03:54:19 oleg113-client systemd[1]: session-194.scope: Succeeded. May 25 03:54:19 oleg113-client systemd-logind[1020]: Removed session 194. May 25 03:54:20 oleg113-client sshd[40059]: Accepted publickey for root from 192.168.201.13 port 56358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:20 oleg113-client systemd-logind[1020]: New session 195 of user root. May 25 03:54:20 oleg113-client systemd[1]: Started Session 195 of user root. May 25 03:54:20 oleg113-client sshd[40059]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:21 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 03:54:19 (1779695659) May 25 03:54:21 oleg113-client sshd[40072]: Received disconnect from 192.168.201.13 port 56358:11: disconnected by user May 25 03:54:21 oleg113-client sshd[40072]: Disconnected from user root 192.168.201.13 port 56358 May 25 03:54:21 oleg113-client sshd[40059]: pam_unix(sshd:session): session closed for user root May 25 03:54:21 oleg113-client systemd[1]: session-195.scope: Succeeded. May 25 03:54:21 oleg113-client systemd-logind[1020]: Session 195 logged out. Waiting for processes to exit. May 25 03:54:21 oleg113-client systemd-logind[1020]: Removed session 195. May 25 03:54:40 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:54:40 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f70146 to 0x58062bb2b3f70655 May 25 03:54:44 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 03:54:45 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 03:54:53 oleg113-client sshd[40379]: Accepted publickey for root from 192.168.201.13 port 40000 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:53 oleg113-client systemd-logind[1020]: New session 196 of user root. May 25 03:54:53 oleg113-client systemd[1]: Started Session 196 of user root. May 25 03:54:53 oleg113-client sshd[40379]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:54 oleg113-client sshd[40393]: Received disconnect from 192.168.201.13 port 40000:11: disconnected by user May 25 03:54:54 oleg113-client sshd[40393]: Disconnected from user root 192.168.201.13 port 40000 May 25 03:54:54 oleg113-client sshd[40379]: pam_unix(sshd:session): session closed for user root May 25 03:54:54 oleg113-client systemd[1]: session-196.scope: Succeeded. May 25 03:54:54 oleg113-client systemd-logind[1020]: Session 196 logged out. Waiting for processes to exit. May 25 03:54:54 oleg113-client systemd-logind[1020]: Removed session 196. May 25 03:54:56 oleg113-client sshd[40433]: Accepted publickey for root from 192.168.201.13 port 40014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:54:56 oleg113-client systemd-logind[1020]: New session 197 of user root. May 25 03:54:56 oleg113-client systemd[1]: Started Session 197 of user root. May 25 03:54:56 oleg113-client sshd[40433]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:54:56 oleg113-client sshd[40446]: Received disconnect from 192.168.201.13 port 40014:11: disconnected by user May 25 03:54:56 oleg113-client sshd[40446]: Disconnected from user root 192.168.201.13 port 40014 May 25 03:54:56 oleg113-client sshd[40433]: pam_unix(sshd:session): session closed for user root May 25 03:54:56 oleg113-client systemd[1]: session-197.scope: Succeeded. May 25 03:54:56 oleg113-client systemd-logind[1020]: Session 197 logged out. Waiting for processes to exit. May 25 03:54:56 oleg113-client systemd-logind[1020]: Removed session 197. May 25 03:55:07 oleg113-client sshd[40597]: Accepted publickey for root from 192.168.201.13 port 54698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:07 oleg113-client systemd[1]: Started Session 198 of user root. May 25 03:55:07 oleg113-client systemd-logind[1020]: New session 198 of user root. May 25 03:55:07 oleg113-client sshd[40597]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:07 oleg113-client sshd[40611]: Received disconnect from 192.168.201.13 port 54698:11: disconnected by user May 25 03:55:07 oleg113-client sshd[40611]: Disconnected from user root 192.168.201.13 port 54698 May 25 03:55:08 oleg113-client sshd[40597]: pam_unix(sshd:session): session closed for user root May 25 03:55:08 oleg113-client systemd[1]: session-198.scope: Succeeded. May 25 03:55:08 oleg113-client systemd-logind[1020]: Session 198 logged out. Waiting for processes to exit. May 25 03:55:08 oleg113-client systemd-logind[1020]: Removed session 198. May 25 03:55:15 oleg113-client sshd[40789]: Accepted publickey for root from 192.168.201.13 port 48414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:15 oleg113-client systemd-logind[1020]: New session 199 of user root. May 25 03:55:15 oleg113-client systemd[1]: Started Session 199 of user root. May 25 03:55:15 oleg113-client sshd[40789]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:16 oleg113-client sshd[40802]: Received disconnect from 192.168.201.13 port 48414:11: disconnected by user May 25 03:55:16 oleg113-client sshd[40802]: Disconnected from user root 192.168.201.13 port 48414 May 25 03:55:16 oleg113-client sshd[40789]: pam_unix(sshd:session): session closed for user root May 25 03:55:16 oleg113-client systemd-logind[1020]: Session 199 logged out. Waiting for processes to exit. May 25 03:55:16 oleg113-client systemd[1]: session-199.scope: Succeeded. May 25 03:55:16 oleg113-client systemd-logind[1020]: Removed session 199. May 25 03:55:17 oleg113-client sshd[40928]: Accepted publickey for root from 192.168.201.13 port 48416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:17 oleg113-client systemd-logind[1020]: New session 200 of user root. May 25 03:55:17 oleg113-client systemd[1]: Started Session 200 of user root. May 25 03:55:17 oleg113-client sshd[40928]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:18 oleg113-client sshd[40941]: Received disconnect from 192.168.201.13 port 48416:11: disconnected by user May 25 03:55:18 oleg113-client sshd[40941]: Disconnected from user root 192.168.201.13 port 48416 May 25 03:55:18 oleg113-client sshd[40928]: pam_unix(sshd:session): session closed for user root May 25 03:55:18 oleg113-client systemd-logind[1020]: Session 200 logged out. Waiting for processes to exit. May 25 03:55:18 oleg113-client systemd[1]: session-200.scope: Succeeded. May 25 03:55:18 oleg113-client systemd-logind[1020]: Removed session 200. May 25 03:55:20 oleg113-client sshd[41074]: Accepted publickey for root from 192.168.201.13 port 39942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:20 oleg113-client systemd-logind[1020]: New session 201 of user root. May 25 03:55:20 oleg113-client systemd[1]: Started Session 201 of user root. May 25 03:55:20 oleg113-client sshd[41074]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:20 oleg113-client sshd[41087]: Received disconnect from 192.168.201.13 port 39942:11: disconnected by user May 25 03:55:20 oleg113-client sshd[41087]: Disconnected from user root 192.168.201.13 port 39942 May 25 03:55:20 oleg113-client sshd[41074]: pam_unix(sshd:session): session closed for user root May 25 03:55:21 oleg113-client systemd-logind[1020]: Session 201 logged out. Waiting for processes to exit. May 25 03:55:21 oleg113-client systemd[1]: session-201.scope: Succeeded. May 25 03:55:21 oleg113-client systemd-logind[1020]: Removed session 201. May 25 03:55:22 oleg113-client sshd[41230]: Accepted publickey for root from 192.168.201.13 port 39944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:22 oleg113-client systemd-logind[1020]: New session 202 of user root. May 25 03:55:22 oleg113-client systemd[1]: Started Session 202 of user root. May 25 03:55:22 oleg113-client sshd[41230]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:22 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 03:55:21 (1779695721) May 25 03:55:23 oleg113-client sshd[41243]: Received disconnect from 192.168.201.13 port 39944:11: disconnected by user May 25 03:55:23 oleg113-client sshd[41243]: Disconnected from user root 192.168.201.13 port 39944 May 25 03:55:23 oleg113-client sshd[41230]: pam_unix(sshd:session): session closed for user root May 25 03:55:23 oleg113-client systemd[1]: session-202.scope: Succeeded. May 25 03:55:23 oleg113-client systemd-logind[1020]: Session 202 logged out. Waiting for processes to exit. May 25 03:55:23 oleg113-client systemd-logind[1020]: Removed session 202. May 25 03:55:50 oleg113-client sshd[41546]: Accepted publickey for root from 192.168.201.13 port 46514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:50 oleg113-client systemd-logind[1020]: New session 203 of user root. May 25 03:55:50 oleg113-client systemd[1]: Started Session 203 of user root. May 25 03:55:50 oleg113-client sshd[41546]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:50 oleg113-client sshd[41559]: Received disconnect from 192.168.201.13 port 46514:11: disconnected by user May 25 03:55:50 oleg113-client sshd[41559]: Disconnected from user root 192.168.201.13 port 46514 May 25 03:55:50 oleg113-client sshd[41546]: pam_unix(sshd:session): session closed for user root May 25 03:55:51 oleg113-client systemd-logind[1020]: Session 203 logged out. Waiting for processes to exit. May 25 03:55:51 oleg113-client systemd[1]: session-203.scope: Succeeded. May 25 03:55:51 oleg113-client systemd-logind[1020]: Removed session 203. May 25 03:55:52 oleg113-client sshd[41598]: Accepted publickey for root from 192.168.201.13 port 46520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:55:52 oleg113-client systemd-logind[1020]: New session 204 of user root. May 25 03:55:52 oleg113-client systemd[1]: Started Session 204 of user root. May 25 03:55:52 oleg113-client sshd[41598]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:55:52 oleg113-client sshd[41612]: Received disconnect from 192.168.201.13 port 46520:11: disconnected by user May 25 03:55:52 oleg113-client sshd[41612]: Disconnected from user root 192.168.201.13 port 46520 May 25 03:55:52 oleg113-client sshd[41598]: pam_unix(sshd:session): session closed for user root May 25 03:55:53 oleg113-client systemd-logind[1020]: Session 204 logged out. Waiting for processes to exit. May 25 03:55:53 oleg113-client systemd[1]: session-204.scope: Succeeded. May 25 03:55:53 oleg113-client systemd-logind[1020]: Removed session 204. May 25 03:56:05 oleg113-client sshd[41763]: Accepted publickey for root from 192.168.201.13 port 32938 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:56:05 oleg113-client systemd[1]: Started Session 205 of user root. May 25 03:56:05 oleg113-client systemd-logind[1020]: New session 205 of user root. May 25 03:56:05 oleg113-client sshd[41763]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:56:05 oleg113-client sshd[41776]: Received disconnect from 192.168.201.13 port 32938:11: disconnected by user May 25 03:56:05 oleg113-client sshd[41776]: Disconnected from user root 192.168.201.13 port 32938 May 25 03:56:05 oleg113-client sshd[41763]: pam_unix(sshd:session): session closed for user root May 25 03:56:06 oleg113-client systemd[1]: session-205.scope: Succeeded. May 25 03:56:06 oleg113-client systemd-logind[1020]: Session 205 logged out. Waiting for processes to exit. May 25 03:56:06 oleg113-client systemd-logind[1020]: Removed session 205. May 25 03:56:07 oleg113-client sshd[41895]: Accepted publickey for root from 192.168.201.13 port 32948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:56:07 oleg113-client systemd-logind[1020]: New session 206 of user root. May 25 03:56:07 oleg113-client systemd[1]: Started Session 206 of user root. May 25 03:56:07 oleg113-client sshd[41895]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:56:07 oleg113-client sshd[41908]: Received disconnect from 192.168.201.13 port 32948:11: disconnected by user May 25 03:56:07 oleg113-client sshd[41908]: Disconnected from user root 192.168.201.13 port 32948 May 25 03:56:08 oleg113-client sshd[41895]: pam_unix(sshd:session): session closed for user root May 25 03:56:08 oleg113-client systemd[1]: session-206.scope: Succeeded. May 25 03:56:08 oleg113-client systemd-logind[1020]: Session 206 logged out. Waiting for processes to exit. May 25 03:56:08 oleg113-client systemd-logind[1020]: Removed session 206. May 25 03:56:09 oleg113-client sshd[42034]: Accepted publickey for root from 192.168.201.13 port 42122 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:56:09 oleg113-client systemd[1]: Started Session 207 of user root. May 25 03:56:09 oleg113-client systemd-logind[1020]: New session 207 of user root. May 25 03:56:09 oleg113-client sshd[42034]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:56:10 oleg113-client sshd[42047]: Received disconnect from 192.168.201.13 port 42122:11: disconnected by user May 25 03:56:10 oleg113-client sshd[42047]: Disconnected from user root 192.168.201.13 port 42122 May 25 03:56:10 oleg113-client sshd[42034]: pam_unix(sshd:session): session closed for user root May 25 03:56:10 oleg113-client systemd[1]: session-207.scope: Succeeded. May 25 03:56:10 oleg113-client systemd-logind[1020]: Session 207 logged out. Waiting for processes to exit. May 25 03:56:10 oleg113-client systemd-logind[1020]: Removed session 207. May 25 03:56:11 oleg113-client sshd[42180]: Accepted publickey for root from 192.168.201.13 port 42128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:56:12 oleg113-client systemd[1]: Started Session 208 of user root. May 25 03:56:12 oleg113-client systemd-logind[1020]: New session 208 of user root. May 25 03:56:12 oleg113-client sshd[42180]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:56:12 oleg113-client sshd[42194]: Received disconnect from 192.168.201.13 port 42128:11: disconnected by user May 25 03:56:12 oleg113-client sshd[42194]: Disconnected from user root 192.168.201.13 port 42128 May 25 03:56:12 oleg113-client sshd[42180]: pam_unix(sshd:session): session closed for user root May 25 03:56:12 oleg113-client systemd[1]: session-208.scope: Succeeded. May 25 03:56:12 oleg113-client systemd-logind[1020]: Session 208 logged out. Waiting for processes to exit. May 25 03:56:12 oleg113-client systemd-logind[1020]: Removed session 208. May 25 03:56:15 oleg113-client sshd[42336]: Accepted publickey for root from 192.168.201.13 port 42134 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:56:15 oleg113-client systemd-logind[1020]: New session 209 of user root. May 25 03:56:15 oleg113-client systemd[1]: Started Session 209 of user root. May 25 03:56:15 oleg113-client sshd[42336]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:56:16 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 03:56:13 (1779695773) May 25 03:56:16 oleg113-client sshd[42349]: Received disconnect from 192.168.201.13 port 42134:11: disconnected by user May 25 03:56:16 oleg113-client sshd[42349]: Disconnected from user root 192.168.201.13 port 42134 May 25 03:56:16 oleg113-client sshd[42336]: pam_unix(sshd:session): session closed for user root May 25 03:56:16 oleg113-client systemd[1]: session-209.scope: Succeeded. May 25 03:56:16 oleg113-client systemd-logind[1020]: Session 209 logged out. Waiting for processes to exit. May 25 03:56:16 oleg113-client systemd-logind[1020]: Removed session 209. May 25 03:56:49 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:56:59 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f70655 to 0x58062bb2b3f7cca8 May 25 03:57:13 oleg113-client sshd[42667]: Accepted publickey for root from 192.168.201.13 port 57784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:57:13 oleg113-client systemd[1]: Started Session 210 of user root. May 25 03:57:13 oleg113-client systemd-logind[1020]: New session 210 of user root. May 25 03:57:13 oleg113-client sshd[42667]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:57:14 oleg113-client sshd[42680]: Received disconnect from 192.168.201.13 port 57784:11: disconnected by user May 25 03:57:14 oleg113-client sshd[42680]: Disconnected from user root 192.168.201.13 port 57784 May 25 03:57:14 oleg113-client sshd[42667]: pam_unix(sshd:session): session closed for user root May 25 03:57:14 oleg113-client systemd[1]: session-210.scope: Succeeded. May 25 03:57:14 oleg113-client systemd-logind[1020]: Session 210 logged out. Waiting for processes to exit. May 25 03:57:14 oleg113-client systemd-logind[1020]: Removed session 210. May 25 03:57:19 oleg113-client sshd[42903]: Accepted publickey for root from 192.168.201.13 port 58088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:57:19 oleg113-client systemd-logind[1020]: New session 211 of user root. May 25 03:57:19 oleg113-client systemd[1]: Started Session 211 of user root. May 25 03:57:19 oleg113-client sshd[42903]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:57:20 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:57:20 oleg113-client sshd[42916]: Received disconnect from 192.168.201.13 port 58088:11: disconnected by user May 25 03:57:20 oleg113-client sshd[42916]: Disconnected from user root 192.168.201.13 port 58088 May 25 03:57:20 oleg113-client sshd[42903]: pam_unix(sshd:session): session closed for user root May 25 03:57:20 oleg113-client systemd[1]: session-211.scope: Succeeded. May 25 03:57:20 oleg113-client systemd-logind[1020]: Session 211 logged out. Waiting for processes to exit. May 25 03:57:20 oleg113-client systemd-logind[1020]: Removed session 211. May 25 03:57:22 oleg113-client sshd[43059]: Accepted publickey for root from 192.168.201.13 port 58096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:57:22 oleg113-client systemd-logind[1020]: New session 212 of user root. May 25 03:57:22 oleg113-client systemd[1]: Started Session 212 of user root. May 25 03:57:22 oleg113-client sshd[43059]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:57:22 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:57:22 oleg113-client sshd[43072]: Received disconnect from 192.168.201.13 port 58096:11: disconnected by user May 25 03:57:22 oleg113-client sshd[43072]: Disconnected from user root 192.168.201.13 port 58096 May 25 03:57:22 oleg113-client sshd[43059]: pam_unix(sshd:session): session closed for user root May 25 03:57:22 oleg113-client systemd[1]: session-212.scope: Succeeded. May 25 03:57:22 oleg113-client systemd-logind[1020]: Session 212 logged out. Waiting for processes to exit. May 25 03:57:22 oleg113-client systemd-logind[1020]: Removed session 212. May 25 03:57:24 oleg113-client sshd[43113]: Accepted publickey for root from 192.168.201.13 port 58106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:57:24 oleg113-client systemd-logind[1020]: New session 213 of user root. May 25 03:57:24 oleg113-client systemd[1]: Started Session 213 of user root. May 25 03:57:24 oleg113-client sshd[43113]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:57:25 oleg113-client sshd[43126]: Received disconnect from 192.168.201.13 port 58106:11: disconnected by user May 25 03:57:25 oleg113-client sshd[43126]: Disconnected from user root 192.168.201.13 port 58106 May 25 03:57:25 oleg113-client sshd[43113]: pam_unix(sshd:session): session closed for user root May 25 03:57:25 oleg113-client systemd[1]: session-213.scope: Succeeded. May 25 03:57:25 oleg113-client systemd-logind[1020]: Session 213 logged out. Waiting for processes to exit. May 25 03:57:25 oleg113-client systemd-logind[1020]: Removed session 213. May 25 03:58:50 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 03:59:01 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f7cca8 to 0x58062bb2b3f9d262 May 25 03:59:15 oleg113-client sshd[43441]: Accepted publickey for root from 192.168.201.13 port 59468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:15 oleg113-client systemd-logind[1020]: New session 214 of user root. May 25 03:59:15 oleg113-client systemd[1]: Started Session 214 of user root. May 25 03:59:15 oleg113-client sshd[43441]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:15 oleg113-client sshd[43454]: Received disconnect from 192.168.201.13 port 59468:11: disconnected by user May 25 03:59:15 oleg113-client sshd[43454]: Disconnected from user root 192.168.201.13 port 59468 May 25 03:59:15 oleg113-client sshd[43441]: pam_unix(sshd:session): session closed for user root May 25 03:59:16 oleg113-client systemd[1]: session-214.scope: Succeeded. May 25 03:59:16 oleg113-client systemd-logind[1020]: Session 214 logged out. Waiting for processes to exit. May 25 03:59:16 oleg113-client systemd-logind[1020]: Removed session 214. May 25 03:59:21 oleg113-client sshd[43677]: Accepted publickey for root from 192.168.201.13 port 46196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:22 oleg113-client systemd-logind[1020]: New session 215 of user root. May 25 03:59:22 oleg113-client systemd[1]: Started Session 215 of user root. May 25 03:59:22 oleg113-client sshd[43677]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:22 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 03:59:22 oleg113-client sshd[43690]: Received disconnect from 192.168.201.13 port 46196:11: disconnected by user May 25 03:59:22 oleg113-client sshd[43690]: Disconnected from user root 192.168.201.13 port 46196 May 25 03:59:22 oleg113-client sshd[43677]: pam_unix(sshd:session): session closed for user root May 25 03:59:23 oleg113-client systemd[1]: session-215.scope: Succeeded. May 25 03:59:23 oleg113-client systemd-logind[1020]: Session 215 logged out. Waiting for processes to exit. May 25 03:59:23 oleg113-client systemd-logind[1020]: Removed session 215. May 25 03:59:25 oleg113-client sshd[43834]: Accepted publickey for root from 192.168.201.13 port 46200 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:25 oleg113-client systemd-logind[1020]: New session 216 of user root. May 25 03:59:25 oleg113-client systemd[1]: Started Session 216 of user root. May 25 03:59:25 oleg113-client sshd[43834]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:26 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 03:59:26 oleg113-client sshd[43847]: Received disconnect from 192.168.201.13 port 46200:11: disconnected by user May 25 03:59:26 oleg113-client sshd[43847]: Disconnected from user root 192.168.201.13 port 46200 May 25 03:59:26 oleg113-client sshd[43834]: pam_unix(sshd:session): session closed for user root May 25 03:59:26 oleg113-client systemd-logind[1020]: Session 216 logged out. Waiting for processes to exit. May 25 03:59:26 oleg113-client systemd[1]: session-216.scope: Succeeded. May 25 03:59:26 oleg113-client systemd-logind[1020]: Removed session 216. May 25 03:59:28 oleg113-client sshd[43888]: Accepted publickey for root from 192.168.201.13 port 46206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 03:59:28 oleg113-client systemd-logind[1020]: New session 217 of user root. May 25 03:59:28 oleg113-client systemd[1]: Started Session 217 of user root. May 25 03:59:28 oleg113-client sshd[43888]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 03:59:28 oleg113-client sshd[43901]: Received disconnect from 192.168.201.13 port 46206:11: disconnected by user May 25 03:59:28 oleg113-client sshd[43901]: Disconnected from user root 192.168.201.13 port 46206 May 25 03:59:29 oleg113-client sshd[43888]: pam_unix(sshd:session): session closed for user root May 25 03:59:29 oleg113-client systemd[1]: session-217.scope: Succeeded. May 25 03:59:29 oleg113-client systemd-logind[1020]: Session 217 logged out. Waiting for processes to exit. May 25 03:59:29 oleg113-client systemd-logind[1020]: Removed session 217. May 25 04:00:54 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:01:01 oleg113-client CROND[44136]: (root) CMD (run-parts /etc/cron.hourly) May 25 04:01:01 oleg113-client run-parts[44136]: (/etc/cron.hourly) starting 0anacron May 25 04:01:01 oleg113-client anacron[44145]: Anacron started on 2026-05-25 May 25 04:01:01 oleg113-client anacron[44145]: Will run job `cron.daily' in 11 min. May 25 04:01:01 oleg113-client anacron[44145]: Will run job `cron.weekly' in 31 min. May 25 04:01:01 oleg113-client anacron[44145]: Will run job `cron.monthly' in 51 min. May 25 04:01:01 oleg113-client anacron[44145]: Jobs will be executed sequentially May 25 04:01:02 oleg113-client run-parts[44136]: (/etc/cron.hourly) finished 0anacron May 25 04:01:04 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3f9d262 to 0x58062bb2b3fbcf0f May 25 04:01:07 oleg113-client kernel: Lustre: 16829:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 04:01:22 oleg113-client sshd[44232]: Accepted publickey for root from 192.168.201.13 port 45984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:01:22 oleg113-client systemd[1]: Started Session 218 of user root. May 25 04:01:22 oleg113-client systemd-logind[1020]: New session 218 of user root. May 25 04:01:22 oleg113-client sshd[44232]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:01:23 oleg113-client sshd[44245]: Received disconnect from 192.168.201.13 port 45984:11: disconnected by user May 25 04:01:23 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:01:23 oleg113-client sshd[44245]: Disconnected from user root 192.168.201.13 port 45984 May 25 04:01:23 oleg113-client sshd[44232]: pam_unix(sshd:session): session closed for user root May 25 04:01:23 oleg113-client systemd[1]: session-218.scope: Succeeded. May 25 04:01:23 oleg113-client systemd-logind[1020]: Session 218 logged out. Waiting for processes to exit. May 25 04:01:23 oleg113-client systemd-logind[1020]: Removed session 218. May 25 04:01:30 oleg113-client sshd[44470]: Accepted publickey for root from 192.168.201.13 port 49986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:01:30 oleg113-client systemd-logind[1020]: New session 219 of user root. May 25 04:01:30 oleg113-client systemd[1]: Started Session 219 of user root. May 25 04:01:30 oleg113-client sshd[44470]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:01:31 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:01:31 oleg113-client sshd[44483]: Received disconnect from 192.168.201.13 port 49986:11: disconnected by user May 25 04:01:31 oleg113-client sshd[44483]: Disconnected from user root 192.168.201.13 port 49986 May 25 04:01:31 oleg113-client sshd[44470]: pam_unix(sshd:session): session closed for user root May 25 04:01:31 oleg113-client systemd-logind[1020]: Session 219 logged out. Waiting for processes to exit. May 25 04:01:31 oleg113-client systemd[1]: session-219.scope: Succeeded. May 25 04:01:31 oleg113-client systemd-logind[1020]: Removed session 219. May 25 04:01:34 oleg113-client sshd[44627]: Accepted publickey for root from 192.168.201.13 port 49994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:01:34 oleg113-client systemd[1]: Started Session 220 of user root. May 25 04:01:34 oleg113-client systemd-logind[1020]: New session 220 of user root. May 25 04:01:34 oleg113-client sshd[44627]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:01:35 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:01:35 oleg113-client sshd[44641]: Received disconnect from 192.168.201.13 port 49994:11: disconnected by user May 25 04:01:35 oleg113-client sshd[44641]: Disconnected from user root 192.168.201.13 port 49994 May 25 04:01:35 oleg113-client sshd[44627]: pam_unix(sshd:session): session closed for user root May 25 04:01:35 oleg113-client systemd[1]: session-220.scope: Succeeded. May 25 04:01:35 oleg113-client systemd-logind[1020]: Session 220 logged out. Waiting for processes to exit. May 25 04:01:35 oleg113-client systemd-logind[1020]: Removed session 220. May 25 04:01:37 oleg113-client sshd[44682]: Accepted publickey for root from 192.168.201.13 port 50010 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:01:37 oleg113-client systemd[1]: Started Session 221 of user root. May 25 04:01:37 oleg113-client systemd-logind[1020]: New session 221 of user root. May 25 04:01:37 oleg113-client sshd[44682]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:01:38 oleg113-client sshd[44695]: Received disconnect from 192.168.201.13 port 50010:11: disconnected by user May 25 04:01:38 oleg113-client sshd[44695]: Disconnected from user root 192.168.201.13 port 50010 May 25 04:01:38 oleg113-client sshd[44682]: pam_unix(sshd:session): session closed for user root May 25 04:01:38 oleg113-client systemd-logind[1020]: Session 221 logged out. Waiting for processes to exit. May 25 04:01:38 oleg113-client systemd[1]: session-221.scope: Succeeded. May 25 04:01:39 oleg113-client systemd-logind[1020]: Removed session 221. May 25 04:02:00 oleg113-client sshd[44819]: Accepted publickey for root from 192.168.201.13 port 40692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:02:01 oleg113-client systemd-logind[1020]: New session 222 of user root. May 25 04:02:01 oleg113-client systemd[1]: Started Session 222 of user root. May 25 04:02:01 oleg113-client sshd[44819]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:02:01 oleg113-client sshd[44832]: Received disconnect from 192.168.201.13 port 40692:11: disconnected by user May 25 04:02:01 oleg113-client sshd[44832]: Disconnected from user root 192.168.201.13 port 40692 May 25 04:02:01 oleg113-client sshd[44819]: pam_unix(sshd:session): session closed for user root May 25 04:02:02 oleg113-client systemd[1]: session-222.scope: Succeeded. May 25 04:02:02 oleg113-client systemd-logind[1020]: Session 222 logged out. Waiting for processes to exit. May 25 04:02:02 oleg113-client systemd-logind[1020]: Removed session 222. May 25 04:02:04 oleg113-client sshd[44958]: Accepted publickey for root from 192.168.201.13 port 40704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:02:04 oleg113-client systemd[1]: Started Session 223 of user root. May 25 04:02:04 oleg113-client systemd-logind[1020]: New session 223 of user root. May 25 04:02:04 oleg113-client sshd[44958]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:02:05 oleg113-client sshd[44971]: Received disconnect from 192.168.201.13 port 40704:11: disconnected by user May 25 04:02:05 oleg113-client sshd[44971]: Disconnected from user root 192.168.201.13 port 40704 May 25 04:02:05 oleg113-client sshd[44958]: pam_unix(sshd:session): session closed for user root May 25 04:02:05 oleg113-client systemd[1]: session-223.scope: Succeeded. May 25 04:02:05 oleg113-client systemd-logind[1020]: Session 223 logged out. Waiting for processes to exit. May 25 04:02:05 oleg113-client systemd-logind[1020]: Removed session 223. May 25 04:02:07 oleg113-client sshd[45105]: Accepted publickey for root from 192.168.201.13 port 40710 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:02:07 oleg113-client systemd-logind[1020]: New session 224 of user root. May 25 04:02:07 oleg113-client systemd[1]: Started Session 224 of user root. May 25 04:02:07 oleg113-client sshd[45105]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:02:08 oleg113-client sshd[45118]: Received disconnect from 192.168.201.13 port 40710:11: disconnected by user May 25 04:02:08 oleg113-client sshd[45118]: Disconnected from user root 192.168.201.13 port 40710 May 25 04:02:08 oleg113-client sshd[45105]: pam_unix(sshd:session): session closed for user root May 25 04:02:08 oleg113-client systemd-logind[1020]: Session 224 logged out. Waiting for processes to exit. May 25 04:02:08 oleg113-client systemd[1]: session-224.scope: Succeeded. May 25 04:02:08 oleg113-client systemd-logind[1020]: Removed session 224. May 25 04:02:10 oleg113-client sshd[45260]: Accepted publickey for root from 192.168.201.13 port 57192 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:02:10 oleg113-client systemd-logind[1020]: New session 225 of user root. May 25 04:02:10 oleg113-client systemd[1]: Started Session 225 of user root. May 25 04:02:10 oleg113-client sshd[45260]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:02:11 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 04:02:09 (1779696129) May 25 04:02:11 oleg113-client sshd[45273]: Received disconnect from 192.168.201.13 port 57192:11: disconnected by user May 25 04:02:11 oleg113-client sshd[45273]: Disconnected from user root 192.168.201.13 port 57192 May 25 04:02:11 oleg113-client sshd[45260]: pam_unix(sshd:session): session closed for user root May 25 04:02:11 oleg113-client systemd-logind[1020]: Session 225 logged out. Waiting for processes to exit. May 25 04:02:11 oleg113-client systemd[1]: session-225.scope: Succeeded. May 25 04:02:11 oleg113-client systemd-logind[1020]: Removed session 225. May 25 04:02:17 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation mds_reint to node 192.168.201.113@tcp failed: rc = -19 May 25 04:02:17 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:02:17 oleg113-client kernel: Lustre: Skipped 5 previous similar messages May 25 04:02:37 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779696141/real 1779696141] req@ffff9b15c80e9c00 x1866143491182592/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779696157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:02:37 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 4 previous similar messages May 25 04:02:37 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:02:47 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3fbcf0f to 0x58062bb2b3fca2cf May 25 04:02:47 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 04:02:47 oleg113-client kernel: Lustre: Skipped 11 previous similar messages May 25 04:03:05 oleg113-client sshd[45683]: Accepted publickey for root from 192.168.201.13 port 43928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:03:05 oleg113-client systemd-logind[1020]: New session 226 of user root. May 25 04:03:05 oleg113-client systemd[1]: Started Session 226 of user root. May 25 04:03:05 oleg113-client sshd[45683]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:03:06 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 1 sec May 25 04:03:06 oleg113-client sshd[45696]: Received disconnect from 192.168.201.13 port 43928:11: disconnected by user May 25 04:03:06 oleg113-client sshd[45696]: Disconnected from user root 192.168.201.13 port 43928 May 25 04:03:06 oleg113-client sshd[45683]: pam_unix(sshd:session): session closed for user root May 25 04:03:07 oleg113-client systemd[1]: session-226.scope: Succeeded. May 25 04:03:07 oleg113-client systemd-logind[1020]: Session 226 logged out. Waiting for processes to exit. May 25 04:03:07 oleg113-client systemd-logind[1020]: Removed session 226. May 25 04:03:57 oleg113-client sshd[46089]: Accepted publickey for root from 192.168.201.13 port 36998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:03:57 oleg113-client systemd[1]: Started Session 227 of user root. May 25 04:03:57 oleg113-client systemd-logind[1020]: New session 227 of user root. May 25 04:03:57 oleg113-client sshd[46089]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:03:57 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 5 sec May 25 04:03:58 oleg113-client sshd[46102]: Received disconnect from 192.168.201.13 port 36998:11: disconnected by user May 25 04:03:58 oleg113-client sshd[46102]: Disconnected from user root 192.168.201.13 port 36998 May 25 04:03:58 oleg113-client sshd[46089]: pam_unix(sshd:session): session closed for user root May 25 04:03:58 oleg113-client systemd[1]: session-227.scope: Succeeded. May 25 04:03:58 oleg113-client systemd-logind[1020]: Session 227 logged out. Waiting for processes to exit. May 25 04:03:58 oleg113-client systemd-logind[1020]: Removed session 227. May 25 04:04:06 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation mds_reint to node 192.168.201.113@tcp failed: rc = -19 May 25 04:04:06 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 04:04:48 oleg113-client sshd[46496]: Accepted publickey for root from 192.168.201.13 port 40116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:04:48 oleg113-client systemd-logind[1020]: New session 228 of user root. May 25 04:04:48 oleg113-client systemd[1]: Started Session 228 of user root. May 25 04:04:48 oleg113-client sshd[46496]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:04:49 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 10 sec May 25 04:04:49 oleg113-client sshd[46509]: Received disconnect from 192.168.201.13 port 40116:11: disconnected by user May 25 04:04:49 oleg113-client sshd[46509]: Disconnected from user root 192.168.201.13 port 40116 May 25 04:04:49 oleg113-client sshd[46496]: pam_unix(sshd:session): session closed for user root May 25 04:04:49 oleg113-client systemd[1]: session-228.scope: Succeeded. May 25 04:04:49 oleg113-client systemd-logind[1020]: Session 228 logged out. Waiting for processes to exit. May 25 04:04:49 oleg113-client systemd-logind[1020]: Removed session 228. May 25 04:05:24 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:05:24 oleg113-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:05:34 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3fd2ea5 to 0x58062bb2b3fd9456 May 25 04:05:34 oleg113-client kernel: Lustre: Skipped 2 previous similar messages May 25 04:05:44 oleg113-client sshd[46901]: Accepted publickey for root from 192.168.201.13 port 35588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:05:44 oleg113-client systemd-logind[1020]: New session 229 of user root. May 25 04:05:44 oleg113-client systemd[1]: Started Session 229 of user root. May 25 04:05:44 oleg113-client sshd[46901]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:05:44 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 20 sec May 25 04:05:44 oleg113-client sshd[46914]: Received disconnect from 192.168.201.13 port 35588:11: disconnected by user May 25 04:05:45 oleg113-client sshd[46914]: Disconnected from user root 192.168.201.13 port 35588 May 25 04:05:45 oleg113-client sshd[46901]: pam_unix(sshd:session): session closed for user root May 25 04:05:45 oleg113-client systemd-logind[1020]: Session 229 logged out. Waiting for processes to exit. May 25 04:05:45 oleg113-client systemd[1]: session-229.scope: Succeeded. May 25 04:05:45 oleg113-client systemd-logind[1020]: Removed session 229. May 25 04:06:56 oleg113-client sshd[47311]: Accepted publickey for root from 192.168.201.13 port 36436 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:06:56 oleg113-client systemd[1]: Started Session 230 of user root. May 25 04:06:56 oleg113-client systemd-logind[1020]: New session 230 of user root. May 25 04:06:56 oleg113-client sshd[47311]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:06:57 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 25 sec May 25 04:06:57 oleg113-client sshd[47324]: Received disconnect from 192.168.201.13 port 36436:11: disconnected by user May 25 04:06:57 oleg113-client sshd[47324]: Disconnected from user root 192.168.201.13 port 36436 May 25 04:06:57 oleg113-client sshd[47311]: pam_unix(sshd:session): session closed for user root May 25 04:06:57 oleg113-client systemd[1]: session-230.scope: Succeeded. May 25 04:06:57 oleg113-client systemd-logind[1020]: Session 230 logged out. Waiting for processes to exit. May 25 04:06:57 oleg113-client systemd-logind[1020]: Removed session 230. May 25 04:07:26 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c64bc800: operation mds_close to node 192.168.201.113@tcp failed: rc = -19 May 25 04:07:26 oleg113-client kernel: LustreError: Skipped 5 previous similar messages May 25 04:07:55 oleg113-client kernel: Lustre: 16829:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 04:08:13 oleg113-client sshd[47721]: Accepted publickey for root from 192.168.201.13 port 60072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:08:13 oleg113-client systemd-logind[1020]: New session 231 of user root. May 25 04:08:13 oleg113-client systemd[1]: Started Session 231 of user root. May 25 04:08:13 oleg113-client sshd[47721]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:08:13 oleg113-client kernel: Lustre: DEBUG MARKER: test_51: failover in 30 sec May 25 04:08:13 oleg113-client sshd[47734]: Received disconnect from 192.168.201.13 port 60072:11: disconnected by user May 25 04:08:13 oleg113-client sshd[47734]: Disconnected from user root 192.168.201.13 port 60072 May 25 04:08:13 oleg113-client sshd[47721]: pam_unix(sshd:session): session closed for user root May 25 04:08:14 oleg113-client systemd-logind[1020]: Session 231 logged out. Waiting for processes to exit. May 25 04:08:14 oleg113-client systemd[1]: session-231.scope: Succeeded. May 25 04:08:14 oleg113-client systemd-logind[1020]: Removed session 231. May 25 04:09:18 oleg113-client kernel: Lustre: 16829:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 04:09:50 oleg113-client sshd[48131]: Accepted publickey for root from 192.168.201.13 port 34780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:09:50 oleg113-client systemd-logind[1020]: New session 232 of user root. May 25 04:09:50 oleg113-client systemd[1]: Started Session 232 of user root. May 25 04:09:50 oleg113-client sshd[48131]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:09:51 oleg113-client sshd[48145]: Received disconnect from 192.168.201.13 port 34780:11: disconnected by user May 25 04:09:51 oleg113-client sshd[48145]: Disconnected from user root 192.168.201.13 port 34780 May 25 04:09:51 oleg113-client sshd[48131]: pam_unix(sshd:session): session closed for user root May 25 04:09:51 oleg113-client systemd[1]: session-232.scope: Succeeded. May 25 04:09:51 oleg113-client systemd-logind[1020]: Session 232 logged out. Waiting for processes to exit. May 25 04:09:51 oleg113-client systemd-logind[1020]: Removed session 232. May 25 04:09:54 oleg113-client sshd[48272]: Accepted publickey for root from 192.168.201.13 port 34792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:09:54 oleg113-client systemd-logind[1020]: New session 233 of user root. May 25 04:09:54 oleg113-client systemd[1]: Started Session 233 of user root. May 25 04:09:54 oleg113-client sshd[48272]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:09:54 oleg113-client sshd[48285]: Received disconnect from 192.168.201.13 port 34792:11: disconnected by user May 25 04:09:54 oleg113-client sshd[48285]: Disconnected from user root 192.168.201.13 port 34792 May 25 04:09:54 oleg113-client sshd[48272]: pam_unix(sshd:session): session closed for user root May 25 04:09:54 oleg113-client systemd[1]: session-233.scope: Succeeded. May 25 04:09:54 oleg113-client systemd-logind[1020]: Session 233 logged out. Waiting for processes to exit. May 25 04:09:54 oleg113-client systemd-logind[1020]: Removed session 233. May 25 04:09:56 oleg113-client sshd[48419]: Accepted publickey for root from 192.168.201.13 port 34794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:09:56 oleg113-client systemd-logind[1020]: New session 234 of user root. May 25 04:09:56 oleg113-client systemd[1]: Started Session 234 of user root. May 25 04:09:56 oleg113-client sshd[48419]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:09:57 oleg113-client sshd[48432]: Received disconnect from 192.168.201.13 port 34794:11: disconnected by user May 25 04:09:57 oleg113-client sshd[48432]: Disconnected from user root 192.168.201.13 port 34794 May 25 04:09:57 oleg113-client sshd[48419]: pam_unix(sshd:session): session closed for user root May 25 04:09:57 oleg113-client systemd[1]: session-234.scope: Succeeded. May 25 04:09:57 oleg113-client systemd-logind[1020]: Session 234 logged out. Waiting for processes to exit. May 25 04:09:57 oleg113-client systemd-logind[1020]: Removed session 234. May 25 04:09:59 oleg113-client sshd[48575]: Accepted publickey for root from 192.168.201.13 port 33244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:09:59 oleg113-client systemd[1]: Started Session 235 of user root. May 25 04:09:59 oleg113-client systemd-logind[1020]: New session 235 of user root. May 25 04:09:59 oleg113-client sshd[48575]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:09:59 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 04:09:57 (1779696597) May 25 04:09:59 oleg113-client sshd[48588]: Received disconnect from 192.168.201.13 port 33244:11: disconnected by user May 25 04:09:59 oleg113-client sshd[48588]: Disconnected from user root 192.168.201.13 port 33244 May 25 04:09:59 oleg113-client sshd[48575]: pam_unix(sshd:session): session closed for user root May 25 04:10:00 oleg113-client systemd-logind[1020]: Session 235 logged out. Waiting for processes to exit. May 25 04:10:00 oleg113-client systemd[1]: session-235.scope: Succeeded. May 25 04:10:00 oleg113-client systemd-logind[1020]: Removed session 235. May 25 04:11:01 oleg113-client systemd[1]: Starting dnf makecache... May 25 04:11:01 oleg113-client sshd[48947]: Accepted publickey for root from 192.168.201.13 port 34504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:11:01 oleg113-client systemd-logind[1020]: New session 236 of user root. May 25 04:11:01 oleg113-client systemd[1]: Started Session 236 of user root. May 25 04:11:01 oleg113-client sshd[48947]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:11:02 oleg113-client sshd[48962]: Received disconnect from 192.168.201.13 port 34504:11: disconnected by user May 25 04:11:02 oleg113-client sshd[48962]: Disconnected from user root 192.168.201.13 port 34504 May 25 04:11:02 oleg113-client sshd[48947]: pam_unix(sshd:session): session closed for user root May 25 04:11:03 oleg113-client systemd[1]: session-236.scope: Succeeded. May 25 04:11:03 oleg113-client systemd-logind[1020]: Session 236 logged out. Waiting for processes to exit. May 25 04:11:03 oleg113-client systemd-logind[1020]: Removed session 236. May 25 04:11:12 oleg113-client sshd[49188]: Accepted publickey for root from 192.168.201.13 port 45434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:11:12 oleg113-client systemd[1]: Started Session 237 of user root. May 25 04:11:12 oleg113-client systemd-logind[1020]: New session 237 of user root. May 25 04:11:12 oleg113-client sshd[49188]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:11:13 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:11:13 oleg113-client sshd[49202]: Received disconnect from 192.168.201.13 port 45434:11: disconnected by user May 25 04:11:14 oleg113-client sshd[49202]: Disconnected from user root 192.168.201.13 port 45434 May 25 04:11:14 oleg113-client sshd[49188]: pam_unix(sshd:session): session closed for user root May 25 04:11:14 oleg113-client systemd[1]: session-237.scope: Succeeded. May 25 04:11:14 oleg113-client systemd-logind[1020]: Session 237 logged out. Waiting for processes to exit. May 25 04:11:14 oleg113-client systemd-logind[1020]: Removed session 237. May 25 04:11:17 oleg113-client sshd[49347]: Accepted publickey for root from 192.168.201.13 port 45436 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:11:17 oleg113-client systemd-logind[1020]: New session 238 of user root. May 25 04:11:17 oleg113-client systemd[1]: Started Session 238 of user root. May 25 04:11:17 oleg113-client sshd[49347]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:11:17 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:11:17 oleg113-client sshd[49360]: Received disconnect from 192.168.201.13 port 45436:11: disconnected by user May 25 04:11:17 oleg113-client sshd[49360]: Disconnected from user root 192.168.201.13 port 45436 May 25 04:11:17 oleg113-client sshd[49347]: pam_unix(sshd:session): session closed for user root May 25 04:11:18 oleg113-client systemd[1]: session-238.scope: Succeeded. May 25 04:11:18 oleg113-client systemd-logind[1020]: Session 238 logged out. Waiting for processes to exit. May 25 04:11:18 oleg113-client systemd-logind[1020]: Removed session 238. May 25 04:11:20 oleg113-client sshd[49401]: Accepted publickey for root from 192.168.201.13 port 55314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:11:20 oleg113-client systemd-logind[1020]: New session 239 of user root. May 25 04:11:20 oleg113-client systemd[1]: Started Session 239 of user root. May 25 04:11:20 oleg113-client sshd[49401]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:11:20 oleg113-client dnf[48954]: Failed determining last makecache time. May 25 04:11:20 oleg113-client sshd[49414]: Received disconnect from 192.168.201.13 port 55314:11: disconnected by user May 25 04:11:20 oleg113-client sshd[49414]: Disconnected from user root 192.168.201.13 port 55314 May 25 04:11:20 oleg113-client sshd[49401]: pam_unix(sshd:session): session closed for user root May 25 04:11:20 oleg113-client systemd[1]: session-239.scope: Succeeded. May 25 04:11:20 oleg113-client systemd-logind[1020]: Session 239 logged out. Waiting for processes to exit. May 25 04:11:20 oleg113-client systemd-logind[1020]: Removed session 239. May 25 04:11:21 oleg113-client dnf[48954]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' May 25 04:11:21 oleg113-client dnf[48954]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' May 25 04:11:22 oleg113-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE May 25 04:11:22 oleg113-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. May 25 04:11:22 oleg113-client systemd[1]: Failed to start dnf makecache. May 25 04:12:01 oleg113-client anacron[44145]: Job `cron.daily' started May 25 04:12:02 oleg113-client run-parts[49455]: (/etc/cron.daily) starting logrotate May 25 04:12:02 oleg113-client run-parts[49455]: (/etc/cron.daily) finished logrotate May 25 04:12:02 oleg113-client anacron[44145]: Job `cron.daily' terminated May 25 04:15:48 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bc800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 04:15:48 oleg113-client kernel: LustreError: Skipped 2 previous similar messages May 25 04:15:48 oleg113-client kernel: Lustre: lustre-OST0000-osc-ffff9b15c64bc800: Connection to lustre-OST0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:15:48 oleg113-client kernel: Lustre: Skipped 7 previous similar messages May 25 04:16:15 oleg113-client kernel: Lustre: lustre-OST0000-osc-ffff9b15c64bc800: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 04:16:15 oleg113-client kernel: Lustre: Skipped 13 previous similar messages May 25 04:16:30 oleg113-client sshd[49789]: Accepted publickey for root from 192.168.201.13 port 41730 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:30 oleg113-client systemd-logind[1020]: New session 240 of user root. May 25 04:16:30 oleg113-client systemd[1]: Started Session 240 of user root. May 25 04:16:30 oleg113-client sshd[49789]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:31 oleg113-client sshd[49802]: Received disconnect from 192.168.201.13 port 41730:11: disconnected by user May 25 04:16:31 oleg113-client sshd[49802]: Disconnected from user root 192.168.201.13 port 41730 May 25 04:16:31 oleg113-client sshd[49789]: pam_unix(sshd:session): session closed for user root May 25 04:16:31 oleg113-client systemd[1]: session-240.scope: Succeeded. May 25 04:16:31 oleg113-client systemd-logind[1020]: Session 240 logged out. Waiting for processes to exit. May 25 04:16:31 oleg113-client systemd-logind[1020]: Removed session 240. May 25 04:16:38 oleg113-client sshd[50027]: Accepted publickey for root from 192.168.201.13 port 41742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:38 oleg113-client systemd-logind[1020]: New session 241 of user root. May 25 04:16:38 oleg113-client systemd[1]: Started Session 241 of user root. May 25 04:16:38 oleg113-client sshd[50027]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:39 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:16:39 oleg113-client sshd[50041]: Received disconnect from 192.168.201.13 port 41742:11: disconnected by user May 25 04:16:39 oleg113-client sshd[50041]: Disconnected from user root 192.168.201.13 port 41742 May 25 04:16:39 oleg113-client sshd[50027]: pam_unix(sshd:session): session closed for user root May 25 04:16:39 oleg113-client systemd[1]: session-241.scope: Succeeded. May 25 04:16:39 oleg113-client systemd-logind[1020]: Session 241 logged out. Waiting for processes to exit. May 25 04:16:39 oleg113-client systemd-logind[1020]: Removed session 241. May 25 04:16:42 oleg113-client sshd[50185]: Accepted publickey for root from 192.168.201.13 port 45486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:42 oleg113-client systemd-logind[1020]: New session 242 of user root. May 25 04:16:42 oleg113-client systemd[1]: Started Session 242 of user root. May 25 04:16:42 oleg113-client sshd[50185]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:43 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:16:43 oleg113-client sshd[50199]: Received disconnect from 192.168.201.13 port 45486:11: disconnected by user May 25 04:16:43 oleg113-client sshd[50199]: Disconnected from user root 192.168.201.13 port 45486 May 25 04:16:43 oleg113-client sshd[50185]: pam_unix(sshd:session): session closed for user root May 25 04:16:44 oleg113-client systemd[1]: session-242.scope: Succeeded. May 25 04:16:44 oleg113-client systemd-logind[1020]: Session 242 logged out. Waiting for processes to exit. May 25 04:16:44 oleg113-client systemd-logind[1020]: Removed session 242. May 25 04:16:45 oleg113-client sshd[50241]: Accepted publickey for root from 192.168.201.13 port 45502 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:16:45 oleg113-client systemd-logind[1020]: New session 243 of user root. May 25 04:16:45 oleg113-client systemd[1]: Started Session 243 of user root. May 25 04:16:45 oleg113-client sshd[50241]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:16:46 oleg113-client sshd[50254]: Received disconnect from 192.168.201.13 port 45502:11: disconnected by user May 25 04:16:46 oleg113-client sshd[50254]: Disconnected from user root 192.168.201.13 port 45502 May 25 04:16:46 oleg113-client sshd[50241]: pam_unix(sshd:session): session closed for user root May 25 04:16:46 oleg113-client systemd-logind[1020]: Session 243 logged out. Waiting for processes to exit. May 25 04:16:46 oleg113-client systemd[1]: session-243.scope: Succeeded. May 25 04:16:46 oleg113-client systemd-logind[1020]: Removed session 243. May 25 04:22:01 oleg113-client sshd[50620]: Accepted publickey for root from 192.168.201.13 port 57266 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:01 oleg113-client systemd-logind[1020]: New session 244 of user root. May 25 04:22:01 oleg113-client systemd[1]: Started Session 244 of user root. May 25 04:22:01 oleg113-client sshd[50620]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:02 oleg113-client sshd[50634]: Received disconnect from 192.168.201.13 port 57266:11: disconnected by user May 25 04:22:02 oleg113-client sshd[50634]: Disconnected from user root 192.168.201.13 port 57266 May 25 04:22:02 oleg113-client sshd[50620]: pam_unix(sshd:session): session closed for user root May 25 04:22:02 oleg113-client systemd[1]: session-244.scope: Succeeded. May 25 04:22:02 oleg113-client systemd-logind[1020]: Session 244 logged out. Waiting for processes to exit. May 25 04:22:02 oleg113-client systemd-logind[1020]: Removed session 244. May 25 04:22:10 oleg113-client sshd[50859]: Accepted publickey for root from 192.168.201.13 port 52096 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:10 oleg113-client systemd-logind[1020]: New session 245 of user root. May 25 04:22:10 oleg113-client systemd[1]: Started Session 245 of user root. May 25 04:22:10 oleg113-client sshd[50859]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:11 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:22:11 oleg113-client sshd[50872]: Received disconnect from 192.168.201.13 port 52096:11: disconnected by user May 25 04:22:11 oleg113-client sshd[50872]: Disconnected from user root 192.168.201.13 port 52096 May 25 04:22:11 oleg113-client sshd[50859]: pam_unix(sshd:session): session closed for user root May 25 04:22:11 oleg113-client systemd[1]: session-245.scope: Succeeded. May 25 04:22:11 oleg113-client systemd-logind[1020]: Session 245 logged out. Waiting for processes to exit. May 25 04:22:11 oleg113-client systemd-logind[1020]: Removed session 245. May 25 04:22:15 oleg113-client sshd[51016]: Accepted publickey for root from 192.168.201.13 port 52098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:15 oleg113-client systemd[1]: Started Session 246 of user root. May 25 04:22:15 oleg113-client systemd-logind[1020]: New session 246 of user root. May 25 04:22:15 oleg113-client sshd[51016]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:16 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:22:16 oleg113-client sshd[51029]: Received disconnect from 192.168.201.13 port 52098:11: disconnected by user May 25 04:22:16 oleg113-client sshd[51029]: Disconnected from user root 192.168.201.13 port 52098 May 25 04:22:16 oleg113-client sshd[51016]: pam_unix(sshd:session): session closed for user root May 25 04:22:16 oleg113-client systemd[1]: session-246.scope: Succeeded. May 25 04:22:16 oleg113-client systemd-logind[1020]: Session 246 logged out. Waiting for processes to exit. May 25 04:22:16 oleg113-client systemd-logind[1020]: Removed session 246. May 25 04:22:18 oleg113-client sshd[51072]: Accepted publickey for root from 192.168.201.13 port 52100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:22:18 oleg113-client systemd[1]: Started Session 247 of user root. May 25 04:22:18 oleg113-client systemd-logind[1020]: New session 247 of user root. May 25 04:22:19 oleg113-client sshd[51072]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:22:20 oleg113-client sshd[51085]: Received disconnect from 192.168.201.13 port 52100:11: disconnected by user May 25 04:22:20 oleg113-client sshd[51085]: Disconnected from user root 192.168.201.13 port 52100 May 25 04:22:20 oleg113-client sshd[51072]: pam_unix(sshd:session): session closed for user root May 25 04:22:20 oleg113-client systemd[1]: session-247.scope: Succeeded. May 25 04:22:20 oleg113-client systemd-logind[1020]: Session 247 logged out. Waiting for processes to exit. May 25 04:22:20 oleg113-client systemd-logind[1020]: Removed session 247. May 25 04:26:09 oleg113-client sshd[51246]: Accepted publickey for root from 192.168.201.13 port 38302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:09 oleg113-client systemd-logind[1020]: New session 248 of user root. May 25 04:26:09 oleg113-client systemd[1]: Started Session 248 of user root. May 25 04:26:09 oleg113-client sshd[51246]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:09 oleg113-client sshd[51259]: Received disconnect from 192.168.201.13 port 38302:11: disconnected by user May 25 04:26:09 oleg113-client sshd[51259]: Disconnected from user root 192.168.201.13 port 38302 May 25 04:26:09 oleg113-client sshd[51246]: pam_unix(sshd:session): session closed for user root May 25 04:26:09 oleg113-client systemd[1]: session-248.scope: Succeeded. May 25 04:26:09 oleg113-client systemd-logind[1020]: Session 248 logged out. Waiting for processes to exit. May 25 04:26:10 oleg113-client systemd-logind[1020]: Removed session 248. May 25 04:26:11 oleg113-client sshd[51388]: Accepted publickey for root from 192.168.201.13 port 60756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:12 oleg113-client systemd-logind[1020]: New session 249 of user root. May 25 04:26:12 oleg113-client systemd[1]: Started Session 249 of user root. May 25 04:26:12 oleg113-client sshd[51388]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:12 oleg113-client sshd[51401]: Received disconnect from 192.168.201.13 port 60756:11: disconnected by user May 25 04:26:12 oleg113-client sshd[51401]: Disconnected from user root 192.168.201.13 port 60756 May 25 04:26:12 oleg113-client sshd[51388]: pam_unix(sshd:session): session closed for user root May 25 04:26:12 oleg113-client systemd[1]: session-249.scope: Succeeded. May 25 04:26:12 oleg113-client systemd-logind[1020]: Session 249 logged out. Waiting for processes to exit. May 25 04:26:12 oleg113-client systemd-logind[1020]: Removed session 249. May 25 04:26:13 oleg113-client sshd[51534]: Accepted publickey for root from 192.168.201.13 port 60766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:13 oleg113-client systemd-logind[1020]: New session 250 of user root. May 25 04:26:14 oleg113-client systemd[1]: Started Session 250 of user root. May 25 04:26:14 oleg113-client sshd[51534]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:14 oleg113-client sshd[51547]: Received disconnect from 192.168.201.13 port 60766:11: disconnected by user May 25 04:26:14 oleg113-client sshd[51547]: Disconnected from user root 192.168.201.13 port 60766 May 25 04:26:14 oleg113-client sshd[51534]: pam_unix(sshd:session): session closed for user root May 25 04:26:14 oleg113-client systemd-logind[1020]: Session 250 logged out. Waiting for processes to exit. May 25 04:26:14 oleg113-client systemd[1]: session-250.scope: Succeeded. May 25 04:26:14 oleg113-client systemd-logind[1020]: Removed session 250. May 25 04:26:16 oleg113-client sshd[51689]: Accepted publickey for root from 192.168.201.13 port 60774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:16 oleg113-client systemd-logind[1020]: New session 251 of user root. May 25 04:26:16 oleg113-client systemd[1]: Started Session 251 of user root. May 25 04:26:16 oleg113-client sshd[51689]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:16 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 04:26:14 (1779697574) May 25 04:26:16 oleg113-client sshd[51702]: Received disconnect from 192.168.201.13 port 60774:11: disconnected by user May 25 04:26:16 oleg113-client sshd[51702]: Disconnected from user root 192.168.201.13 port 60774 May 25 04:26:16 oleg113-client sshd[51689]: pam_unix(sshd:session): session closed for user root May 25 04:26:17 oleg113-client systemd-logind[1020]: Session 251 logged out. Waiting for processes to exit. May 25 04:26:17 oleg113-client systemd[1]: session-251.scope: Succeeded. May 25 04:26:17 oleg113-client systemd-logind[1020]: Removed session 251. May 25 04:26:34 oleg113-client kernel: Lustre: 51806:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697578/real 1779697578] req@ffff9b15c7dcbb80 x1866143506139520/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c64bc800@192.168.201.113@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779697594 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'openfile.0' uid:0 gid:0 projid:0 May 25 04:26:34 oleg113-client kernel: Lustre: 51806:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 6 previous similar messages May 25 04:26:34 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:26:34 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 04:26:34 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bc800: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 04:26:34 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 04:26:39 oleg113-client sshd[51932]: Accepted publickey for root from 192.168.201.13 port 54620 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:39 oleg113-client systemd-logind[1020]: New session 252 of user root. May 25 04:26:39 oleg113-client systemd[1]: Started Session 252 of user root. May 25 04:26:39 oleg113-client sshd[51932]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:39 oleg113-client sshd[51945]: Received disconnect from 192.168.201.13 port 54620:11: disconnected by user May 25 04:26:39 oleg113-client sshd[51945]: Disconnected from user root 192.168.201.13 port 54620 May 25 04:26:39 oleg113-client sshd[51932]: pam_unix(sshd:session): session closed for user root May 25 04:26:40 oleg113-client systemd[1]: session-252.scope: Succeeded. May 25 04:26:40 oleg113-client systemd-logind[1020]: Session 252 logged out. Waiting for processes to exit. May 25 04:26:40 oleg113-client systemd-logind[1020]: Removed session 252. May 25 04:26:41 oleg113-client sshd[52071]: Accepted publickey for root from 192.168.201.13 port 54292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:41 oleg113-client systemd[1]: Started Session 253 of user root. May 25 04:26:41 oleg113-client systemd-logind[1020]: New session 253 of user root. May 25 04:26:41 oleg113-client sshd[52071]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:41 oleg113-client sshd[52084]: Received disconnect from 192.168.201.13 port 54292:11: disconnected by user May 25 04:26:41 oleg113-client sshd[52084]: Disconnected from user root 192.168.201.13 port 54292 May 25 04:26:41 oleg113-client sshd[52071]: pam_unix(sshd:session): session closed for user root May 25 04:26:42 oleg113-client systemd-logind[1020]: Session 253 logged out. Waiting for processes to exit. May 25 04:26:42 oleg113-client systemd[1]: session-253.scope: Succeeded. May 25 04:26:42 oleg113-client systemd-logind[1020]: Removed session 253. May 25 04:26:43 oleg113-client sshd[52217]: Accepted publickey for root from 192.168.201.13 port 54302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:43 oleg113-client systemd-logind[1020]: New session 254 of user root. May 25 04:26:43 oleg113-client systemd[1]: Started Session 254 of user root. May 25 04:26:43 oleg113-client sshd[52217]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:44 oleg113-client sshd[52230]: Received disconnect from 192.168.201.13 port 54302:11: disconnected by user May 25 04:26:44 oleg113-client sshd[52230]: Disconnected from user root 192.168.201.13 port 54302 May 25 04:26:44 oleg113-client sshd[52217]: pam_unix(sshd:session): session closed for user root May 25 04:26:44 oleg113-client systemd[1]: session-254.scope: Succeeded. May 25 04:26:44 oleg113-client systemd-logind[1020]: Session 254 logged out. Waiting for processes to exit. May 25 04:26:44 oleg113-client systemd-logind[1020]: Removed session 254. May 25 04:26:46 oleg113-client sshd[52373]: Accepted publickey for root from 192.168.201.13 port 54314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:26:46 oleg113-client systemd-logind[1020]: New session 255 of user root. May 25 04:26:46 oleg113-client systemd[1]: Started Session 255 of user root. May 25 04:26:46 oleg113-client sshd[52373]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:26:47 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 04:26:45 (1779697605) May 25 04:26:47 oleg113-client sshd[52386]: Received disconnect from 192.168.201.13 port 54314:11: disconnected by user May 25 04:26:47 oleg113-client sshd[52386]: Disconnected from user root 192.168.201.13 port 54314 May 25 04:26:47 oleg113-client sshd[52373]: pam_unix(sshd:session): session closed for user root May 25 04:26:47 oleg113-client systemd[1]: session-255.scope: Succeeded. May 25 04:26:47 oleg113-client systemd-logind[1020]: Session 255 logged out. Waiting for processes to exit. May 25 04:26:47 oleg113-client systemd-logind[1020]: Removed session 255. May 25 04:27:10 oleg113-client sshd[52616]: Accepted publickey for root from 192.168.201.13 port 54926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:10 oleg113-client systemd-logind[1020]: New session 256 of user root. May 25 04:27:10 oleg113-client systemd[1]: Started Session 256 of user root. May 25 04:27:10 oleg113-client sshd[52616]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:11 oleg113-client sshd[52629]: Received disconnect from 192.168.201.13 port 54926:11: disconnected by user May 25 04:27:11 oleg113-client sshd[52629]: Disconnected from user root 192.168.201.13 port 54926 May 25 04:27:11 oleg113-client sshd[52616]: pam_unix(sshd:session): session closed for user root May 25 04:27:11 oleg113-client systemd[1]: session-256.scope: Succeeded. May 25 04:27:11 oleg113-client systemd-logind[1020]: Session 256 logged out. Waiting for processes to exit. May 25 04:27:11 oleg113-client systemd-logind[1020]: Removed session 256. May 25 04:27:13 oleg113-client sshd[52756]: Accepted publickey for root from 192.168.201.13 port 54942 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:13 oleg113-client systemd-logind[1020]: New session 257 of user root. May 25 04:27:13 oleg113-client systemd[1]: Started Session 257 of user root. May 25 04:27:13 oleg113-client sshd[52756]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:14 oleg113-client sshd[52770]: Received disconnect from 192.168.201.13 port 54942:11: disconnected by user May 25 04:27:14 oleg113-client sshd[52770]: Disconnected from user root 192.168.201.13 port 54942 May 25 04:27:14 oleg113-client sshd[52756]: pam_unix(sshd:session): session closed for user root May 25 04:27:14 oleg113-client systemd[1]: session-257.scope: Succeeded. May 25 04:27:14 oleg113-client systemd-logind[1020]: Session 257 logged out. Waiting for processes to exit. May 25 04:27:14 oleg113-client systemd-logind[1020]: Removed session 257. May 25 04:27:16 oleg113-client sshd[52903]: Accepted publickey for root from 192.168.201.13 port 54944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:16 oleg113-client systemd-logind[1020]: New session 258 of user root. May 25 04:27:16 oleg113-client systemd[1]: Started Session 258 of user root. May 25 04:27:16 oleg113-client sshd[52903]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:17 oleg113-client sshd[52916]: Received disconnect from 192.168.201.13 port 54944:11: disconnected by user May 25 04:27:17 oleg113-client sshd[52916]: Disconnected from user root 192.168.201.13 port 54944 May 25 04:27:17 oleg113-client sshd[52903]: pam_unix(sshd:session): session closed for user root May 25 04:27:17 oleg113-client systemd[1]: session-258.scope: Succeeded. May 25 04:27:17 oleg113-client systemd-logind[1020]: Session 258 logged out. Waiting for processes to exit. May 25 04:27:17 oleg113-client systemd-logind[1020]: Removed session 258. May 25 04:27:19 oleg113-client sshd[53058]: Accepted publickey for root from 192.168.201.13 port 59234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:19 oleg113-client systemd-logind[1020]: New session 259 of user root. May 25 04:27:19 oleg113-client systemd[1]: Started Session 259 of user root. May 25 04:27:19 oleg113-client sshd[53058]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:19 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 04:27:17 (1779697637) May 25 04:27:19 oleg113-client sshd[53071]: Received disconnect from 192.168.201.13 port 59234:11: disconnected by user May 25 04:27:19 oleg113-client sshd[53071]: Disconnected from user root 192.168.201.13 port 59234 May 25 04:27:19 oleg113-client sshd[53058]: pam_unix(sshd:session): session closed for user root May 25 04:27:20 oleg113-client systemd[1]: session-259.scope: Succeeded. May 25 04:27:20 oleg113-client systemd-logind[1020]: Session 259 logged out. Waiting for processes to exit. May 25 04:27:20 oleg113-client systemd-logind[1020]: Removed session 259. May 25 04:27:43 oleg113-client sshd[53303]: Accepted publickey for root from 192.168.201.13 port 57284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:43 oleg113-client systemd[1]: Started Session 260 of user root. May 25 04:27:43 oleg113-client systemd-logind[1020]: New session 260 of user root. May 25 04:27:43 oleg113-client sshd[53303]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:43 oleg113-client sshd[53316]: Received disconnect from 192.168.201.13 port 57284:11: disconnected by user May 25 04:27:43 oleg113-client sshd[53316]: Disconnected from user root 192.168.201.13 port 57284 May 25 04:27:43 oleg113-client sshd[53303]: pam_unix(sshd:session): session closed for user root May 25 04:27:44 oleg113-client systemd[1]: session-260.scope: Succeeded. May 25 04:27:44 oleg113-client systemd-logind[1020]: Session 260 logged out. Waiting for processes to exit. May 25 04:27:44 oleg113-client systemd-logind[1020]: Removed session 260. May 25 04:27:45 oleg113-client sshd[53443]: Accepted publickey for root from 192.168.201.13 port 57286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:45 oleg113-client systemd-logind[1020]: New session 261 of user root. May 25 04:27:45 oleg113-client systemd[1]: Started Session 261 of user root. May 25 04:27:45 oleg113-client sshd[53443]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:46 oleg113-client sshd[53456]: Received disconnect from 192.168.201.13 port 57286:11: disconnected by user May 25 04:27:46 oleg113-client sshd[53456]: Disconnected from user root 192.168.201.13 port 57286 May 25 04:27:46 oleg113-client sshd[53443]: pam_unix(sshd:session): session closed for user root May 25 04:27:46 oleg113-client systemd[1]: session-261.scope: Succeeded. May 25 04:27:46 oleg113-client systemd-logind[1020]: Session 261 logged out. Waiting for processes to exit. May 25 04:27:46 oleg113-client systemd-logind[1020]: Removed session 261. May 25 04:27:47 oleg113-client sshd[53589]: Accepted publickey for root from 192.168.201.13 port 57302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:48 oleg113-client systemd-logind[1020]: New session 262 of user root. May 25 04:27:48 oleg113-client systemd[1]: Started Session 262 of user root. May 25 04:27:48 oleg113-client sshd[53589]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:48 oleg113-client sshd[53603]: Received disconnect from 192.168.201.13 port 57302:11: disconnected by user May 25 04:27:48 oleg113-client sshd[53603]: Disconnected from user root 192.168.201.13 port 57302 May 25 04:27:48 oleg113-client sshd[53589]: pam_unix(sshd:session): session closed for user root May 25 04:27:48 oleg113-client systemd-logind[1020]: Session 262 logged out. Waiting for processes to exit. May 25 04:27:48 oleg113-client systemd[1]: session-262.scope: Succeeded. May 25 04:27:48 oleg113-client systemd-logind[1020]: Removed session 262. May 25 04:27:50 oleg113-client sshd[53745]: Accepted publickey for root from 192.168.201.13 port 33282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:27:50 oleg113-client systemd-logind[1020]: New session 263 of user root. May 25 04:27:50 oleg113-client systemd[1]: Started Session 263 of user root. May 25 04:27:50 oleg113-client sshd[53745]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:27:51 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 04:27:49 (1779697669) May 25 04:27:51 oleg113-client sshd[53758]: Received disconnect from 192.168.201.13 port 33282:11: disconnected by user May 25 04:27:51 oleg113-client sshd[53758]: Disconnected from user root 192.168.201.13 port 33282 May 25 04:27:51 oleg113-client sshd[53745]: pam_unix(sshd:session): session closed for user root May 25 04:27:51 oleg113-client systemd[1]: session-263.scope: Succeeded. May 25 04:27:51 oleg113-client systemd-logind[1020]: Session 263 logged out. Waiting for processes to exit. May 25 04:27:51 oleg113-client systemd-logind[1020]: Removed session 263. May 25 04:27:51 oleg113-client systemd-udevd[53811]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:27:51 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:28:23 oleg113-client kernel: Lustre: 2419:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697687/real 1779697687] req@ffff9b15c7dca300 x1866143506163456/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779697703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:28:23 oleg113-client kernel: Lustre: 2419:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 04:28:23 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:28:23 oleg113-client kernel: LustreError: Skipped 3 previous similar messages May 25 04:28:33 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b3ff5de1 to 0x58062bb2b40ef75a May 25 04:28:33 oleg113-client kernel: Lustre: Skipped 3 previous similar messages May 25 04:28:44 oleg113-client sshd[54107]: Accepted publickey for root from 192.168.201.13 port 56930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:45 oleg113-client systemd-logind[1020]: New session 264 of user root. May 25 04:28:45 oleg113-client systemd[1]: Started Session 264 of user root. May 25 04:28:45 oleg113-client sshd[54107]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:45 oleg113-client sshd[54120]: Received disconnect from 192.168.201.13 port 56930:11: disconnected by user May 25 04:28:45 oleg113-client sshd[54120]: Disconnected from user root 192.168.201.13 port 56930 May 25 04:28:45 oleg113-client sshd[54107]: pam_unix(sshd:session): session closed for user root May 25 04:28:45 oleg113-client systemd-logind[1020]: Session 264 logged out. Waiting for processes to exit. May 25 04:28:45 oleg113-client systemd[1]: session-264.scope: Succeeded. May 25 04:28:46 oleg113-client systemd-logind[1020]: Removed session 264. May 25 04:28:50 oleg113-client sshd[54342]: Accepted publickey for root from 192.168.201.13 port 33214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:50 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:28:50 oleg113-client systemd-logind[1020]: New session 265 of user root. May 25 04:28:50 oleg113-client systemd[1]: Started Session 265 of user root. May 25 04:28:50 oleg113-client sshd[54342]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:50 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:28:50 oleg113-client sshd[54357]: Received disconnect from 192.168.201.13 port 33214:11: disconnected by user May 25 04:28:50 oleg113-client sshd[54357]: Disconnected from user root 192.168.201.13 port 33214 May 25 04:28:51 oleg113-client sshd[54342]: pam_unix(sshd:session): session closed for user root May 25 04:28:51 oleg113-client systemd-logind[1020]: Session 265 logged out. Waiting for processes to exit. May 25 04:28:51 oleg113-client systemd[1]: session-265.scope: Succeeded. May 25 04:28:51 oleg113-client systemd-logind[1020]: Removed session 265. May 25 04:28:52 oleg113-client sshd[54500]: Accepted publickey for root from 192.168.201.13 port 33216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:52 oleg113-client systemd-logind[1020]: New session 266 of user root. May 25 04:28:52 oleg113-client systemd[1]: Started Session 266 of user root. May 25 04:28:52 oleg113-client sshd[54500]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:52 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:28:53 oleg113-client sshd[54513]: Received disconnect from 192.168.201.13 port 33216:11: disconnected by user May 25 04:28:53 oleg113-client sshd[54513]: Disconnected from user root 192.168.201.13 port 33216 May 25 04:28:53 oleg113-client sshd[54500]: pam_unix(sshd:session): session closed for user root May 25 04:28:53 oleg113-client systemd-logind[1020]: Session 266 logged out. Waiting for processes to exit. May 25 04:28:53 oleg113-client systemd[1]: session-266.scope: Succeeded. May 25 04:28:53 oleg113-client systemd-logind[1020]: Removed session 266. May 25 04:28:54 oleg113-client sshd[54554]: Accepted publickey for root from 192.168.201.13 port 33230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:54 oleg113-client systemd-logind[1020]: New session 267 of user root. May 25 04:28:54 oleg113-client systemd[1]: Started Session 267 of user root. May 25 04:28:54 oleg113-client sshd[54554]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:55 oleg113-client sshd[54567]: Received disconnect from 192.168.201.13 port 33230:11: disconnected by user May 25 04:28:55 oleg113-client sshd[54567]: Disconnected from user root 192.168.201.13 port 33230 May 25 04:28:55 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:28:55 oleg113-client sshd[54554]: pam_unix(sshd:session): session closed for user root May 25 04:28:55 oleg113-client kernel: LustreError: 54591:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c8dfc000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:28:55 oleg113-client kernel: LustreError: 54591:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:28:55 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:28:55 oleg113-client systemd[1]: session-267.scope: Succeeded. May 25 04:28:55 oleg113-client systemd-logind[1020]: Session 267 logged out. Waiting for processes to exit. May 25 04:28:55 oleg113-client systemd-logind[1020]: Removed session 267. May 25 04:28:56 oleg113-client sshd[54694]: Accepted publickey for root from 192.168.201.13 port 33246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:57 oleg113-client systemd[1]: Started Session 268 of user root. May 25 04:28:57 oleg113-client systemd-logind[1020]: New session 268 of user root. May 25 04:28:57 oleg113-client sshd[54694]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:57 oleg113-client sshd[54707]: Received disconnect from 192.168.201.13 port 33246:11: disconnected by user May 25 04:28:57 oleg113-client sshd[54707]: Disconnected from user root 192.168.201.13 port 33246 May 25 04:28:57 oleg113-client sshd[54694]: pam_unix(sshd:session): session closed for user root May 25 04:28:57 oleg113-client systemd[1]: session-268.scope: Succeeded. May 25 04:28:57 oleg113-client systemd-logind[1020]: Session 268 logged out. Waiting for processes to exit. May 25 04:28:57 oleg113-client systemd-logind[1020]: Removed session 268. May 25 04:28:59 oleg113-client sshd[54834]: Accepted publickey for root from 192.168.201.13 port 33248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:28:59 oleg113-client systemd-logind[1020]: New session 269 of user root. May 25 04:28:59 oleg113-client systemd[1]: Started Session 269 of user root. May 25 04:28:59 oleg113-client sshd[54834]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:28:59 oleg113-client sshd[54847]: Received disconnect from 192.168.201.13 port 33248:11: disconnected by user May 25 04:28:59 oleg113-client sshd[54847]: Disconnected from user root 192.168.201.13 port 33248 May 25 04:28:59 oleg113-client sshd[54834]: pam_unix(sshd:session): session closed for user root May 25 04:28:59 oleg113-client systemd[1]: session-269.scope: Succeeded. May 25 04:28:59 oleg113-client systemd-logind[1020]: Session 269 logged out. Waiting for processes to exit. May 25 04:28:59 oleg113-client systemd-logind[1020]: Removed session 269. May 25 04:29:01 oleg113-client sshd[54981]: Accepted publickey for root from 192.168.201.13 port 60712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:01 oleg113-client systemd-logind[1020]: New session 270 of user root. May 25 04:29:01 oleg113-client systemd[1]: Started Session 270 of user root. May 25 04:29:01 oleg113-client sshd[54981]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:01 oleg113-client sshd[54994]: Received disconnect from 192.168.201.13 port 60712:11: disconnected by user May 25 04:29:01 oleg113-client sshd[54994]: Disconnected from user root 192.168.201.13 port 60712 May 25 04:29:01 oleg113-client sshd[54981]: pam_unix(sshd:session): session closed for user root May 25 04:29:02 oleg113-client systemd[1]: session-270.scope: Succeeded. May 25 04:29:02 oleg113-client systemd-logind[1020]: Session 270 logged out. Waiting for processes to exit. May 25 04:29:02 oleg113-client systemd-logind[1020]: Removed session 270. May 25 04:29:03 oleg113-client sshd[55137]: Accepted publickey for root from 192.168.201.13 port 60716 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:29:03 oleg113-client systemd[1]: Started Session 271 of user root. May 25 04:29:03 oleg113-client systemd-logind[1020]: New session 271 of user root. May 25 04:29:03 oleg113-client sshd[55137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:29:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 04:29:02 (1779697742) May 25 04:29:04 oleg113-client sshd[55150]: Received disconnect from 192.168.201.13 port 60716:11: disconnected by user May 25 04:29:04 oleg113-client sshd[55150]: Disconnected from user root 192.168.201.13 port 60716 May 25 04:29:04 oleg113-client sshd[55137]: pam_unix(sshd:session): session closed for user root May 25 04:29:04 oleg113-client systemd[1]: session-271.scope: Succeeded. May 25 04:29:04 oleg113-client systemd-logind[1020]: Session 271 logged out. Waiting for processes to exit. May 25 04:29:04 oleg113-client systemd-logind[1020]: Removed session 271. May 25 04:30:42 oleg113-client sshd[55433]: Accepted publickey for root from 192.168.201.13 port 56032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:42 oleg113-client systemd-logind[1020]: New session 272 of user root. May 25 04:30:42 oleg113-client systemd[1]: Started Session 272 of user root. May 25 04:30:42 oleg113-client sshd[55433]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:42 oleg113-client sshd[55447]: Received disconnect from 192.168.201.13 port 56032:11: disconnected by user May 25 04:30:42 oleg113-client sshd[55447]: Disconnected from user root 192.168.201.13 port 56032 May 25 04:30:42 oleg113-client sshd[55433]: pam_unix(sshd:session): session closed for user root May 25 04:30:43 oleg113-client systemd-logind[1020]: Session 272 logged out. Waiting for processes to exit. May 25 04:30:43 oleg113-client systemd[1]: session-272.scope: Succeeded. May 25 04:30:43 oleg113-client systemd-logind[1020]: Removed session 272. May 25 04:30:44 oleg113-client sshd[55573]: Accepted publickey for root from 192.168.201.13 port 56044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:45 oleg113-client systemd[1]: Started Session 273 of user root. May 25 04:30:45 oleg113-client systemd-logind[1020]: New session 273 of user root. May 25 04:30:45 oleg113-client sshd[55573]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:45 oleg113-client sshd[55586]: Received disconnect from 192.168.201.13 port 56044:11: disconnected by user May 25 04:30:45 oleg113-client sshd[55586]: Disconnected from user root 192.168.201.13 port 56044 May 25 04:30:45 oleg113-client sshd[55573]: pam_unix(sshd:session): session closed for user root May 25 04:30:45 oleg113-client systemd-logind[1020]: Session 273 logged out. Waiting for processes to exit. May 25 04:30:45 oleg113-client systemd[1]: session-273.scope: Succeeded. May 25 04:30:45 oleg113-client systemd-logind[1020]: Removed session 273. May 25 04:30:47 oleg113-client sshd[55719]: Accepted publickey for root from 192.168.201.13 port 56046 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:47 oleg113-client systemd-logind[1020]: New session 274 of user root. May 25 04:30:47 oleg113-client systemd[1]: Started Session 274 of user root. May 25 04:30:47 oleg113-client sshd[55719]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:48 oleg113-client sshd[55732]: Received disconnect from 192.168.201.13 port 56046:11: disconnected by user May 25 04:30:48 oleg113-client sshd[55732]: Disconnected from user root 192.168.201.13 port 56046 May 25 04:30:48 oleg113-client sshd[55719]: pam_unix(sshd:session): session closed for user root May 25 04:30:48 oleg113-client systemd[1]: session-274.scope: Succeeded. May 25 04:30:48 oleg113-client systemd-logind[1020]: Session 274 logged out. Waiting for processes to exit. May 25 04:30:48 oleg113-client systemd-logind[1020]: Removed session 274. May 25 04:30:49 oleg113-client sshd[55876]: Accepted publickey for root from 192.168.201.13 port 53626 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:30:50 oleg113-client systemd-logind[1020]: New session 275 of user root. May 25 04:30:50 oleg113-client systemd[1]: Started Session 275 of user root. May 25 04:30:50 oleg113-client sshd[55876]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:30:50 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 04:30:48 (1779697848) May 25 04:30:50 oleg113-client sshd[55889]: Received disconnect from 192.168.201.13 port 53626:11: disconnected by user May 25 04:30:50 oleg113-client sshd[55889]: Disconnected from user root 192.168.201.13 port 53626 May 25 04:30:50 oleg113-client sshd[55876]: pam_unix(sshd:session): session closed for user root May 25 04:30:50 oleg113-client systemd[1]: session-275.scope: Succeeded. May 25 04:30:50 oleg113-client systemd-logind[1020]: Session 275 logged out. Waiting for processes to exit. May 25 04:30:50 oleg113-client systemd-logind[1020]: Removed session 275. May 25 04:31:07 oleg113-client kernel: Lustre: 55933:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779697851/real 1779697851] req@ffff9b15d1f63100 x1866143506213632/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c64bc800@192.168.201.113@tcp:12/10 lens 576/1152 e 0 to 1 dl 1779697867 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 May 25 04:31:07 oleg113-client kernel: Lustre: 55933:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 40 previous similar messages May 25 04:31:35 oleg113-client sshd[56037]: Accepted publickey for root from 192.168.201.13 port 38182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:35 oleg113-client systemd-logind[1020]: New session 276 of user root. May 25 04:31:35 oleg113-client systemd[1]: Started Session 276 of user root. May 25 04:31:35 oleg113-client sshd[56037]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:36 oleg113-client sshd[56050]: Received disconnect from 192.168.201.13 port 38182:11: disconnected by user May 25 04:31:36 oleg113-client sshd[56050]: Disconnected from user root 192.168.201.13 port 38182 May 25 04:31:36 oleg113-client sshd[56037]: pam_unix(sshd:session): session closed for user root May 25 04:31:36 oleg113-client systemd[1]: session-276.scope: Succeeded. May 25 04:31:36 oleg113-client systemd-logind[1020]: Session 276 logged out. Waiting for processes to exit. May 25 04:31:36 oleg113-client systemd-logind[1020]: Removed session 276. May 25 04:31:37 oleg113-client sshd[56176]: Accepted publickey for root from 192.168.201.13 port 38184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:38 oleg113-client systemd-logind[1020]: New session 277 of user root. May 25 04:31:38 oleg113-client systemd[1]: Started Session 277 of user root. May 25 04:31:38 oleg113-client sshd[56176]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:38 oleg113-client sshd[56190]: Received disconnect from 192.168.201.13 port 38184:11: disconnected by user May 25 04:31:38 oleg113-client sshd[56190]: Disconnected from user root 192.168.201.13 port 38184 May 25 04:31:38 oleg113-client sshd[56176]: pam_unix(sshd:session): session closed for user root May 25 04:31:38 oleg113-client systemd[1]: session-277.scope: Succeeded. May 25 04:31:38 oleg113-client systemd-logind[1020]: Session 277 logged out. Waiting for processes to exit. May 25 04:31:38 oleg113-client systemd-logind[1020]: Removed session 277. May 25 04:31:40 oleg113-client sshd[56323]: Accepted publickey for root from 192.168.201.13 port 56474 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:40 oleg113-client systemd-logind[1020]: New session 278 of user root. May 25 04:31:40 oleg113-client systemd[1]: Started Session 278 of user root. May 25 04:31:40 oleg113-client sshd[56323]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:41 oleg113-client sshd[56336]: Received disconnect from 192.168.201.13 port 56474:11: disconnected by user May 25 04:31:41 oleg113-client sshd[56336]: Disconnected from user root 192.168.201.13 port 56474 May 25 04:31:41 oleg113-client sshd[56323]: pam_unix(sshd:session): session closed for user root May 25 04:31:41 oleg113-client systemd-logind[1020]: Session 278 logged out. Waiting for processes to exit. May 25 04:31:41 oleg113-client systemd[1]: session-278.scope: Succeeded. May 25 04:31:41 oleg113-client systemd-logind[1020]: Removed session 278. May 25 04:31:43 oleg113-client sshd[56478]: Accepted publickey for root from 192.168.201.13 port 56478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:31:43 oleg113-client systemd-logind[1020]: New session 279 of user root. May 25 04:31:43 oleg113-client systemd[1]: Started Session 279 of user root. May 25 04:31:43 oleg113-client sshd[56478]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:31:43 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 04:31:41 (1779697901) May 25 04:31:43 oleg113-client sshd[56491]: Received disconnect from 192.168.201.13 port 56478:11: disconnected by user May 25 04:31:43 oleg113-client sshd[56491]: Disconnected from user root 192.168.201.13 port 56478 May 25 04:31:43 oleg113-client sshd[56478]: pam_unix(sshd:session): session closed for user root May 25 04:31:44 oleg113-client systemd[1]: session-279.scope: Succeeded. May 25 04:31:44 oleg113-client systemd-logind[1020]: Session 279 logged out. Waiting for processes to exit. May 25 04:31:44 oleg113-client systemd-logind[1020]: Removed session 279. May 25 04:31:48 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 04:31:48 oleg113-client kernel: LustreError: 56549:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c64bc800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:31:48 oleg113-client kernel: LustreError: 56549:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:31:48 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:32:01 oleg113-client anacron[44145]: Job `cron.weekly' started May 25 04:32:02 oleg113-client anacron[44145]: Job `cron.weekly' terminated May 25 04:32:18 oleg113-client sshd[56814]: Accepted publickey for root from 192.168.201.13 port 55554 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:18 oleg113-client systemd-logind[1020]: New session 280 of user root. May 25 04:32:18 oleg113-client systemd[1]: Started Session 280 of user root. May 25 04:32:18 oleg113-client sshd[56814]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:18 oleg113-client sshd[56827]: Received disconnect from 192.168.201.13 port 55554:11: disconnected by user May 25 04:32:18 oleg113-client sshd[56827]: Disconnected from user root 192.168.201.13 port 55554 May 25 04:32:18 oleg113-client sshd[56814]: pam_unix(sshd:session): session closed for user root May 25 04:32:18 oleg113-client systemd-logind[1020]: Session 280 logged out. Waiting for processes to exit. May 25 04:32:18 oleg113-client systemd[1]: session-280.scope: Succeeded. May 25 04:32:18 oleg113-client systemd-logind[1020]: Removed session 280. May 25 04:32:20 oleg113-client sshd[56867]: Accepted publickey for root from 192.168.201.13 port 54806 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:20 oleg113-client systemd-logind[1020]: New session 281 of user root. May 25 04:32:20 oleg113-client systemd[1]: Started Session 281 of user root. May 25 04:32:20 oleg113-client sshd[56867]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:20 oleg113-client sshd[56880]: Received disconnect from 192.168.201.13 port 54806:11: disconnected by user May 25 04:32:20 oleg113-client sshd[56880]: Disconnected from user root 192.168.201.13 port 54806 May 25 04:32:20 oleg113-client sshd[56867]: pam_unix(sshd:session): session closed for user root May 25 04:32:20 oleg113-client systemd-logind[1020]: Session 281 logged out. Waiting for processes to exit. May 25 04:32:20 oleg113-client systemd[1]: session-281.scope: Succeeded. May 25 04:32:20 oleg113-client systemd-logind[1020]: Removed session 281. May 25 04:32:31 oleg113-client systemd-udevd[57060]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:32:31 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:32:33 oleg113-client sshd[57168]: Accepted publickey for root from 192.168.201.13 port 53218 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:33 oleg113-client systemd-logind[1020]: New session 282 of user root. May 25 04:32:33 oleg113-client systemd[1]: Started Session 282 of user root. May 25 04:32:33 oleg113-client sshd[57168]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:34 oleg113-client sshd[57181]: Received disconnect from 192.168.201.13 port 53218:11: disconnected by user May 25 04:32:34 oleg113-client sshd[57181]: Disconnected from user root 192.168.201.13 port 53218 May 25 04:32:34 oleg113-client sshd[57168]: pam_unix(sshd:session): session closed for user root May 25 04:32:34 oleg113-client systemd[1]: session-282.scope: Succeeded. May 25 04:32:34 oleg113-client systemd-logind[1020]: Session 282 logged out. Waiting for processes to exit. May 25 04:32:34 oleg113-client systemd-logind[1020]: Removed session 282. May 25 04:32:35 oleg113-client sshd[57307]: Accepted publickey for root from 192.168.201.13 port 53230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:36 oleg113-client systemd-logind[1020]: New session 283 of user root. May 25 04:32:36 oleg113-client systemd[1]: Started Session 283 of user root. May 25 04:32:36 oleg113-client sshd[57307]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:36 oleg113-client sshd[57320]: Received disconnect from 192.168.201.13 port 53230:11: disconnected by user May 25 04:32:36 oleg113-client sshd[57320]: Disconnected from user root 192.168.201.13 port 53230 May 25 04:32:36 oleg113-client sshd[57307]: pam_unix(sshd:session): session closed for user root May 25 04:32:37 oleg113-client systemd-logind[1020]: Session 283 logged out. Waiting for processes to exit. May 25 04:32:37 oleg113-client systemd[1]: session-283.scope: Succeeded. May 25 04:32:37 oleg113-client systemd-logind[1020]: Removed session 283. May 25 04:32:38 oleg113-client sshd[57454]: Accepted publickey for root from 192.168.201.13 port 53242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:38 oleg113-client systemd-logind[1020]: New session 284 of user root. May 25 04:32:38 oleg113-client systemd[1]: Started Session 284 of user root. May 25 04:32:38 oleg113-client sshd[57454]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:39 oleg113-client sshd[57467]: Received disconnect from 192.168.201.13 port 53242:11: disconnected by user May 25 04:32:39 oleg113-client sshd[57467]: Disconnected from user root 192.168.201.13 port 53242 May 25 04:32:39 oleg113-client sshd[57454]: pam_unix(sshd:session): session closed for user root May 25 04:32:39 oleg113-client systemd[1]: session-284.scope: Succeeded. May 25 04:32:39 oleg113-client systemd-logind[1020]: Session 284 logged out. Waiting for processes to exit. May 25 04:32:39 oleg113-client systemd-logind[1020]: Removed session 284. May 25 04:32:41 oleg113-client sshd[57610]: Accepted publickey for root from 192.168.201.13 port 48286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:32:41 oleg113-client systemd-logind[1020]: New session 285 of user root. May 25 04:32:41 oleg113-client systemd[1]: Started Session 285 of user root. May 25 04:32:41 oleg113-client sshd[57610]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:32:42 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 04:32:40 (1779697960) May 25 04:32:42 oleg113-client sshd[57623]: Received disconnect from 192.168.201.13 port 48286:11: disconnected by user May 25 04:32:42 oleg113-client sshd[57623]: Disconnected from user root 192.168.201.13 port 48286 May 25 04:32:42 oleg113-client sshd[57610]: pam_unix(sshd:session): session closed for user root May 25 04:32:42 oleg113-client systemd[1]: session-285.scope: Succeeded. May 25 04:32:42 oleg113-client systemd-logind[1020]: Session 285 logged out. Waiting for processes to exit. May 25 04:32:42 oleg113-client kernel: LustreError: 57660:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout id 801 sleeping for 20000ms May 25 04:32:42 oleg113-client systemd-logind[1020]: Removed session 285. May 25 04:32:43 oleg113-client kernel: LustreError: 57660:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout interrupted May 25 04:32:44 oleg113-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** May 25 04:33:01 oleg113-client sshd[57795]: Accepted publickey for root from 192.168.201.13 port 43336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:01 oleg113-client systemd-logind[1020]: New session 286 of user root. May 25 04:33:01 oleg113-client systemd[1]: Started Session 286 of user root. May 25 04:33:01 oleg113-client sshd[57795]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:02 oleg113-client sshd[57808]: Received disconnect from 192.168.201.13 port 43336:11: disconnected by user May 25 04:33:02 oleg113-client sshd[57808]: Disconnected from user root 192.168.201.13 port 43336 May 25 04:33:02 oleg113-client sshd[57795]: pam_unix(sshd:session): session closed for user root May 25 04:33:02 oleg113-client systemd[1]: session-286.scope: Succeeded. May 25 04:33:02 oleg113-client systemd-logind[1020]: Session 286 logged out. Waiting for processes to exit. May 25 04:33:02 oleg113-client systemd-logind[1020]: Removed session 286. May 25 04:33:05 oleg113-client sshd[57936]: Accepted publickey for root from 192.168.201.13 port 43338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:05 oleg113-client systemd-logind[1020]: New session 287 of user root. May 25 04:33:05 oleg113-client systemd[1]: Started Session 287 of user root. May 25 04:33:05 oleg113-client sshd[57936]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:05 oleg113-client sshd[57949]: Received disconnect from 192.168.201.13 port 43338:11: disconnected by user May 25 04:33:05 oleg113-client sshd[57949]: Disconnected from user root 192.168.201.13 port 43338 May 25 04:33:05 oleg113-client sshd[57936]: pam_unix(sshd:session): session closed for user root May 25 04:33:05 oleg113-client systemd-logind[1020]: Session 287 logged out. Waiting for processes to exit. May 25 04:33:05 oleg113-client systemd[1]: session-287.scope: Succeeded. May 25 04:33:05 oleg113-client systemd-logind[1020]: Removed session 287. May 25 04:33:07 oleg113-client sshd[58082]: Accepted publickey for root from 192.168.201.13 port 43350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:07 oleg113-client systemd-logind[1020]: New session 288 of user root. May 25 04:33:07 oleg113-client systemd[1]: Started Session 288 of user root. May 25 04:33:07 oleg113-client sshd[58082]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:07 oleg113-client sshd[58095]: Received disconnect from 192.168.201.13 port 43350:11: disconnected by user May 25 04:33:07 oleg113-client sshd[58095]: Disconnected from user root 192.168.201.13 port 43350 May 25 04:33:07 oleg113-client sshd[58082]: pam_unix(sshd:session): session closed for user root May 25 04:33:08 oleg113-client systemd-logind[1020]: Session 288 logged out. Waiting for processes to exit. May 25 04:33:08 oleg113-client systemd[1]: session-288.scope: Succeeded. May 25 04:33:08 oleg113-client systemd-logind[1020]: Removed session 288. May 25 04:33:10 oleg113-client sshd[58237]: Accepted publickey for root from 192.168.201.13 port 46090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:10 oleg113-client systemd[1]: Started Session 289 of user root. May 25 04:33:10 oleg113-client systemd-logind[1020]: New session 289 of user root. May 25 04:33:10 oleg113-client sshd[58237]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:11 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 04:33:08 (1779697988) May 25 04:33:11 oleg113-client sshd[58251]: Received disconnect from 192.168.201.13 port 46090:11: disconnected by user May 25 04:33:11 oleg113-client sshd[58251]: Disconnected from user root 192.168.201.13 port 46090 May 25 04:33:11 oleg113-client sshd[58237]: pam_unix(sshd:session): session closed for user root May 25 04:33:11 oleg113-client systemd[1]: session-289.scope: Succeeded. May 25 04:33:11 oleg113-client systemd-logind[1020]: Session 289 logged out. Waiting for processes to exit. May 25 04:33:11 oleg113-client systemd-logind[1020]: Removed session 289. May 25 04:33:12 oleg113-client systemd-udevd[58304]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:33:12 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:33:16 oleg113-client kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 25 04:33:26 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:33:26 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:33:28 oleg113-client sshd[58443]: Accepted publickey for root from 192.168.201.13 port 56970 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:28 oleg113-client systemd[1]: Started Session 290 of user root. May 25 04:33:28 oleg113-client systemd-logind[1020]: New session 290 of user root. May 25 04:33:28 oleg113-client sshd[58443]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:29 oleg113-client sshd[58456]: Received disconnect from 192.168.201.13 port 56970:11: disconnected by user May 25 04:33:29 oleg113-client sshd[58456]: Disconnected from user root 192.168.201.13 port 56970 May 25 04:33:29 oleg113-client sshd[58443]: pam_unix(sshd:session): session closed for user root May 25 04:33:29 oleg113-client systemd[1]: session-290.scope: Succeeded. May 25 04:33:29 oleg113-client systemd-logind[1020]: Session 290 logged out. Waiting for processes to exit. May 25 04:33:29 oleg113-client systemd-logind[1020]: Removed session 290. May 25 04:33:31 oleg113-client sshd[58583]: Accepted publickey for root from 192.168.201.13 port 58206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:31 oleg113-client systemd-logind[1020]: New session 291 of user root. May 25 04:33:31 oleg113-client systemd[1]: Started Session 291 of user root. May 25 04:33:31 oleg113-client sshd[58583]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:32 oleg113-client sshd[58596]: Received disconnect from 192.168.201.13 port 58206:11: disconnected by user May 25 04:33:32 oleg113-client sshd[58596]: Disconnected from user root 192.168.201.13 port 58206 May 25 04:33:32 oleg113-client sshd[58583]: pam_unix(sshd:session): session closed for user root May 25 04:33:32 oleg113-client systemd[1]: session-291.scope: Succeeded. May 25 04:33:32 oleg113-client systemd-logind[1020]: Session 291 logged out. Waiting for processes to exit. May 25 04:33:32 oleg113-client systemd-logind[1020]: Removed session 291. May 25 04:33:34 oleg113-client sshd[58729]: Accepted publickey for root from 192.168.201.13 port 58212 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:34 oleg113-client systemd-logind[1020]: New session 292 of user root. May 25 04:33:34 oleg113-client systemd[1]: Started Session 292 of user root. May 25 04:33:34 oleg113-client sshd[58729]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:34 oleg113-client sshd[58742]: Received disconnect from 192.168.201.13 port 58212:11: disconnected by user May 25 04:33:34 oleg113-client sshd[58742]: Disconnected from user root 192.168.201.13 port 58212 May 25 04:33:34 oleg113-client sshd[58729]: pam_unix(sshd:session): session closed for user root May 25 04:33:34 oleg113-client systemd-logind[1020]: Session 292 logged out. Waiting for processes to exit. May 25 04:33:34 oleg113-client systemd[1]: session-292.scope: Succeeded. May 25 04:33:34 oleg113-client systemd-logind[1020]: Removed session 292. May 25 04:33:36 oleg113-client sshd[58884]: Accepted publickey for root from 192.168.201.13 port 58226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:36 oleg113-client systemd-logind[1020]: New session 293 of user root. May 25 04:33:36 oleg113-client systemd[1]: Started Session 293 of user root. May 25 04:33:36 oleg113-client sshd[58884]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:36 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 04:33:35 (1779698015) May 25 04:33:36 oleg113-client sshd[58897]: Received disconnect from 192.168.201.13 port 58226:11: disconnected by user May 25 04:33:36 oleg113-client sshd[58897]: Disconnected from user root 192.168.201.13 port 58226 May 25 04:33:36 oleg113-client sshd[58884]: pam_unix(sshd:session): session closed for user root May 25 04:33:36 oleg113-client systemd-logind[1020]: Session 293 logged out. Waiting for processes to exit. May 25 04:33:36 oleg113-client systemd[1]: session-293.scope: Succeeded. May 25 04:33:36 oleg113-client systemd-logind[1020]: Removed session 293. May 25 04:33:47 oleg113-client sshd[59090]: Accepted publickey for root from 192.168.201.13 port 55260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:33:47 oleg113-client systemd[1]: Started Session 294 of user root. May 25 04:33:47 oleg113-client systemd-logind[1020]: New session 294 of user root. May 25 04:33:47 oleg113-client sshd[59090]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:33:48 oleg113-client sshd[59103]: Received disconnect from 192.168.201.13 port 55260:11: disconnected by user May 25 04:33:48 oleg113-client sshd[59103]: Disconnected from user root 192.168.201.13 port 55260 May 25 04:33:48 oleg113-client sshd[59090]: pam_unix(sshd:session): session closed for user root May 25 04:33:48 oleg113-client systemd[1]: session-294.scope: Succeeded. May 25 04:33:48 oleg113-client systemd-logind[1020]: Session 294 logged out. Waiting for processes to exit. May 25 04:33:48 oleg113-client systemd-logind[1020]: Removed session 294. May 25 04:35:24 oleg113-client sshd[59325]: Accepted publickey for root from 192.168.201.13 port 36284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:35:24 oleg113-client systemd-logind[1020]: New session 295 of user root. May 25 04:35:24 oleg113-client systemd[1]: Started Session 295 of user root. May 25 04:35:24 oleg113-client sshd[59325]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:35:24 oleg113-client sshd[59339]: Received disconnect from 192.168.201.13 port 36284:11: disconnected by user May 25 04:35:25 oleg113-client sshd[59339]: Disconnected from user root 192.168.201.13 port 36284 May 25 04:35:25 oleg113-client sshd[59325]: pam_unix(sshd:session): session closed for user root May 25 04:35:25 oleg113-client systemd[1]: session-295.scope: Succeeded. May 25 04:35:25 oleg113-client systemd-logind[1020]: Session 295 logged out. Waiting for processes to exit. May 25 04:35:25 oleg113-client systemd-logind[1020]: Removed session 295. May 25 04:35:25 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15d1fcd800: operation mds_reint to node 192.168.201.113@tcp failed: rc = -19 May 25 04:35:25 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 04:35:47 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:35:58 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b40f0bc7 to 0x58062bb2b411bcfa May 25 04:38:17 oleg113-client sshd[59875]: Accepted publickey for root from 192.168.201.13 port 37780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:17 oleg113-client systemd[1]: Started Session 296 of user root. May 25 04:38:17 oleg113-client systemd-logind[1020]: New session 296 of user root. May 25 04:38:17 oleg113-client sshd[59875]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:18 oleg113-client sshd[59888]: Received disconnect from 192.168.201.13 port 37780:11: disconnected by user May 25 04:38:18 oleg113-client sshd[59888]: Disconnected from user root 192.168.201.13 port 37780 May 25 04:38:18 oleg113-client sshd[59875]: pam_unix(sshd:session): session closed for user root May 25 04:38:18 oleg113-client systemd-logind[1020]: Session 296 logged out. Waiting for processes to exit. May 25 04:38:18 oleg113-client systemd[1]: session-296.scope: Succeeded. May 25 04:38:18 oleg113-client systemd-logind[1020]: Removed session 296. May 25 04:38:20 oleg113-client sshd[60017]: Accepted publickey for root from 192.168.201.13 port 53204 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:20 oleg113-client systemd[1]: Started Session 297 of user root. May 25 04:38:20 oleg113-client systemd-logind[1020]: New session 297 of user root. May 25 04:38:20 oleg113-client sshd[60017]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:20 oleg113-client sshd[60030]: Received disconnect from 192.168.201.13 port 53204:11: disconnected by user May 25 04:38:20 oleg113-client sshd[60030]: Disconnected from user root 192.168.201.13 port 53204 May 25 04:38:20 oleg113-client sshd[60017]: pam_unix(sshd:session): session closed for user root May 25 04:38:21 oleg113-client systemd-logind[1020]: Session 297 logged out. Waiting for processes to exit. May 25 04:38:21 oleg113-client systemd[1]: session-297.scope: Succeeded. May 25 04:38:21 oleg113-client systemd-logind[1020]: Removed session 297. May 25 04:38:22 oleg113-client sshd[60163]: Accepted publickey for root from 192.168.201.13 port 53206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:23 oleg113-client systemd-logind[1020]: New session 298 of user root. May 25 04:38:23 oleg113-client systemd[1]: Started Session 298 of user root. May 25 04:38:23 oleg113-client sshd[60163]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:23 oleg113-client sshd[60176]: Received disconnect from 192.168.201.13 port 53206:11: disconnected by user May 25 04:38:23 oleg113-client sshd[60176]: Disconnected from user root 192.168.201.13 port 53206 May 25 04:38:23 oleg113-client sshd[60163]: pam_unix(sshd:session): session closed for user root May 25 04:38:24 oleg113-client systemd-logind[1020]: Session 298 logged out. Waiting for processes to exit. May 25 04:38:24 oleg113-client systemd[1]: session-298.scope: Succeeded. May 25 04:38:24 oleg113-client systemd-logind[1020]: Removed session 298. May 25 04:38:29 oleg113-client sshd[60365]: Accepted publickey for root from 192.168.201.13 port 49808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:38:29 oleg113-client systemd-logind[1020]: New session 299 of user root. May 25 04:38:29 oleg113-client systemd[1]: Started Session 299 of user root. May 25 04:38:29 oleg113-client sshd[60365]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:38:30 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 04:38:28 (1779698308) May 25 04:38:30 oleg113-client sshd[60378]: Received disconnect from 192.168.201.13 port 49808:11: disconnected by user May 25 04:38:30 oleg113-client sshd[60378]: Disconnected from user root 192.168.201.13 port 49808 May 25 04:38:30 oleg113-client sshd[60365]: pam_unix(sshd:session): session closed for user root May 25 04:38:30 oleg113-client systemd[1]: session-299.scope: Succeeded. May 25 04:38:30 oleg113-client systemd-logind[1020]: Session 299 logged out. Waiting for processes to exit. May 25 04:38:30 oleg113-client systemd-logind[1020]: Removed session 299. May 25 04:38:41 oleg113-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 04:38:46 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15d1fcd800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:38:46 oleg113-client kernel: Lustre: Skipped 12 previous similar messages May 25 04:39:02 oleg113-client kernel: Lustre: 2420:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779698326/real 1779698326] req@ffff9b15c7878a80 x1866143510484480/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779698342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 04:39:02 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:39:02 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15d1fcd800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:39:02 oleg113-client kernel: Lustre: 2420:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 04:39:02 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15d1fcd800: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 04:39:02 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b411bcfa to 0x58062bb2b4157f81 May 25 04:39:02 oleg113-client kernel: Lustre: Skipped 14 previous similar messages May 25 04:39:11 oleg113-client sshd[60830]: Accepted publickey for root from 192.168.201.13 port 43594 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:11 oleg113-client systemd-logind[1020]: New session 300 of user root. May 25 04:39:11 oleg113-client systemd[1]: Started Session 300 of user root. May 25 04:39:11 oleg113-client sshd[60830]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:11 oleg113-client sshd[60843]: Received disconnect from 192.168.201.13 port 43594:11: disconnected by user May 25 04:39:11 oleg113-client sshd[60843]: Disconnected from user root 192.168.201.13 port 43594 May 25 04:39:11 oleg113-client sshd[60830]: pam_unix(sshd:session): session closed for user root May 25 04:39:11 oleg113-client systemd[1]: session-300.scope: Succeeded. May 25 04:39:11 oleg113-client systemd-logind[1020]: Session 300 logged out. Waiting for processes to exit. May 25 04:39:11 oleg113-client systemd-logind[1020]: Removed session 300. May 25 04:39:13 oleg113-client sshd[60883]: Accepted publickey for root from 192.168.201.13 port 43610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:13 oleg113-client systemd-logind[1020]: New session 301 of user root. May 25 04:39:13 oleg113-client systemd[1]: Started Session 301 of user root. May 25 04:39:13 oleg113-client sshd[60883]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:13 oleg113-client sshd[60896]: Received disconnect from 192.168.201.13 port 43610:11: disconnected by user May 25 04:39:13 oleg113-client sshd[60896]: Disconnected from user root 192.168.201.13 port 43610 May 25 04:39:13 oleg113-client sshd[60883]: pam_unix(sshd:session): session closed for user root May 25 04:39:14 oleg113-client systemd-logind[1020]: Session 301 logged out. Waiting for processes to exit. May 25 04:39:14 oleg113-client systemd[1]: session-301.scope: Succeeded. May 25 04:39:14 oleg113-client systemd-logind[1020]: Removed session 301. May 25 04:39:26 oleg113-client sshd[61132]: Accepted publickey for root from 192.168.201.13 port 37280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:26 oleg113-client systemd-logind[1020]: New session 302 of user root. May 25 04:39:26 oleg113-client systemd[1]: Started Session 302 of user root. May 25 04:39:26 oleg113-client sshd[61132]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:27 oleg113-client sshd[61145]: Received disconnect from 192.168.201.13 port 37280:11: disconnected by user May 25 04:39:27 oleg113-client sshd[61145]: Disconnected from user root 192.168.201.13 port 37280 May 25 04:39:27 oleg113-client sshd[61132]: pam_unix(sshd:session): session closed for user root May 25 04:39:27 oleg113-client systemd-logind[1020]: Session 302 logged out. Waiting for processes to exit. May 25 04:39:27 oleg113-client systemd[1]: session-302.scope: Succeeded. May 25 04:39:27 oleg113-client systemd-logind[1020]: Removed session 302. May 25 04:39:29 oleg113-client sshd[61272]: Accepted publickey for root from 192.168.201.13 port 42564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:29 oleg113-client systemd-logind[1020]: New session 303 of user root. May 25 04:39:29 oleg113-client systemd[1]: Started Session 303 of user root. May 25 04:39:29 oleg113-client sshd[61272]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:30 oleg113-client sshd[61285]: Received disconnect from 192.168.201.13 port 42564:11: disconnected by user May 25 04:39:30 oleg113-client sshd[61285]: Disconnected from user root 192.168.201.13 port 42564 May 25 04:39:30 oleg113-client sshd[61272]: pam_unix(sshd:session): session closed for user root May 25 04:39:30 oleg113-client systemd[1]: session-303.scope: Succeeded. May 25 04:39:30 oleg113-client systemd-logind[1020]: Session 303 logged out. Waiting for processes to exit. May 25 04:39:30 oleg113-client systemd-logind[1020]: Removed session 303. May 25 04:39:32 oleg113-client sshd[61418]: Accepted publickey for root from 192.168.201.13 port 42570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:32 oleg113-client systemd-logind[1020]: New session 304 of user root. May 25 04:39:32 oleg113-client systemd[1]: Started Session 304 of user root. May 25 04:39:32 oleg113-client sshd[61418]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:33 oleg113-client sshd[61431]: Received disconnect from 192.168.201.13 port 42570:11: disconnected by user May 25 04:39:33 oleg113-client sshd[61431]: Disconnected from user root 192.168.201.13 port 42570 May 25 04:39:33 oleg113-client sshd[61418]: pam_unix(sshd:session): session closed for user root May 25 04:39:33 oleg113-client systemd-logind[1020]: Session 304 logged out. Waiting for processes to exit. May 25 04:39:33 oleg113-client systemd[1]: session-304.scope: Succeeded. May 25 04:39:33 oleg113-client systemd-logind[1020]: Removed session 304. May 25 04:39:35 oleg113-client sshd[61573]: Accepted publickey for root from 192.168.201.13 port 42572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:35 oleg113-client systemd-logind[1020]: New session 305 of user root. May 25 04:39:35 oleg113-client systemd[1]: Started Session 305 of user root. May 25 04:39:35 oleg113-client sshd[61573]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:35 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 04:39:33 (1779698373) May 25 04:39:35 oleg113-client sshd[61587]: Received disconnect from 192.168.201.13 port 42572:11: disconnected by user May 25 04:39:35 oleg113-client sshd[61587]: Disconnected from user root 192.168.201.13 port 42572 May 25 04:39:36 oleg113-client sshd[61573]: pam_unix(sshd:session): session closed for user root May 25 04:39:36 oleg113-client systemd[1]: session-305.scope: Succeeded. May 25 04:39:36 oleg113-client systemd-logind[1020]: Session 305 logged out. Waiting for processes to exit. May 25 04:39:36 oleg113-client systemd-logind[1020]: Removed session 305. May 25 04:39:36 oleg113-client systemd-udevd[61643]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:39:36 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:39:45 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15d1fcd800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 04:39:45 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15d1fcd800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 04:39:56 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:39:56 oleg113-client kernel: LustreError: 61716:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c3779800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:39:56 oleg113-client kernel: LustreError: 61716:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:39:56 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:39:57 oleg113-client sshd[61804]: Accepted publickey for root from 192.168.201.13 port 52564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:39:58 oleg113-client systemd-logind[1020]: New session 306 of user root. May 25 04:39:58 oleg113-client systemd[1]: Started Session 306 of user root. May 25 04:39:58 oleg113-client sshd[61804]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:39:58 oleg113-client sshd[61817]: Received disconnect from 192.168.201.13 port 52564:11: disconnected by user May 25 04:39:58 oleg113-client sshd[61817]: Disconnected from user root 192.168.201.13 port 52564 May 25 04:39:58 oleg113-client sshd[61804]: pam_unix(sshd:session): session closed for user root May 25 04:39:58 oleg113-client systemd[1]: session-306.scope: Succeeded. May 25 04:39:58 oleg113-client systemd-logind[1020]: Session 306 logged out. Waiting for processes to exit. May 25 04:39:58 oleg113-client systemd-logind[1020]: Removed session 306. May 25 04:40:00 oleg113-client sshd[61943]: Accepted publickey for root from 192.168.201.13 port 59916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:00 oleg113-client systemd-logind[1020]: New session 307 of user root. May 25 04:40:00 oleg113-client systemd[1]: Started Session 307 of user root. May 25 04:40:00 oleg113-client sshd[61943]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:01 oleg113-client sshd[61957]: Received disconnect from 192.168.201.13 port 59916:11: disconnected by user May 25 04:40:01 oleg113-client sshd[61957]: Disconnected from user root 192.168.201.13 port 59916 May 25 04:40:01 oleg113-client sshd[61943]: pam_unix(sshd:session): session closed for user root May 25 04:40:01 oleg113-client systemd[1]: session-307.scope: Succeeded. May 25 04:40:01 oleg113-client systemd-logind[1020]: Session 307 logged out. Waiting for processes to exit. May 25 04:40:01 oleg113-client systemd-logind[1020]: Removed session 307. May 25 04:40:02 oleg113-client sshd[62090]: Accepted publickey for root from 192.168.201.13 port 59932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:02 oleg113-client systemd-logind[1020]: New session 308 of user root. May 25 04:40:02 oleg113-client systemd[1]: Started Session 308 of user root. May 25 04:40:02 oleg113-client sshd[62090]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:03 oleg113-client sshd[62103]: Received disconnect from 192.168.201.13 port 59932:11: disconnected by user May 25 04:40:03 oleg113-client sshd[62103]: Disconnected from user root 192.168.201.13 port 59932 May 25 04:40:03 oleg113-client sshd[62090]: pam_unix(sshd:session): session closed for user root May 25 04:40:03 oleg113-client systemd-logind[1020]: Session 308 logged out. Waiting for processes to exit. May 25 04:40:03 oleg113-client systemd[1]: session-308.scope: Succeeded. May 25 04:40:03 oleg113-client systemd-logind[1020]: Removed session 308. May 25 04:40:05 oleg113-client sshd[62245]: Accepted publickey for root from 192.168.201.13 port 59946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:05 oleg113-client systemd-logind[1020]: New session 309 of user root. May 25 04:40:05 oleg113-client systemd[1]: Started Session 309 of user root. May 25 04:40:05 oleg113-client sshd[62245]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 04:40:03 (1779698403) May 25 04:40:05 oleg113-client sshd[62258]: Received disconnect from 192.168.201.13 port 59946:11: disconnected by user May 25 04:40:05 oleg113-client sshd[62258]: Disconnected from user root 192.168.201.13 port 59946 May 25 04:40:05 oleg113-client sshd[62245]: pam_unix(sshd:session): session closed for user root May 25 04:40:06 oleg113-client systemd[1]: session-309.scope: Succeeded. May 25 04:40:06 oleg113-client systemd-logind[1020]: Session 309 logged out. Waiting for processes to exit. May 25 04:40:06 oleg113-client systemd-logind[1020]: Removed session 309. May 25 04:40:13 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15d1fcd800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:40:13 oleg113-client kernel: LustreError: 62372:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 May 25 04:40:17 oleg113-client sshd[62584]: Accepted publickey for root from 192.168.201.13 port 47230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:17 oleg113-client systemd[1]: Started Session 310 of user root. May 25 04:40:17 oleg113-client systemd-logind[1020]: New session 310 of user root. May 25 04:40:17 oleg113-client sshd[62584]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:17 oleg113-client sshd[62597]: Received disconnect from 192.168.201.13 port 47230:11: disconnected by user May 25 04:40:17 oleg113-client sshd[62597]: Disconnected from user root 192.168.201.13 port 47230 May 25 04:40:17 oleg113-client sshd[62584]: pam_unix(sshd:session): session closed for user root May 25 04:40:18 oleg113-client systemd[1]: session-310.scope: Succeeded. May 25 04:40:18 oleg113-client systemd-logind[1020]: Session 310 logged out. Waiting for processes to exit. May 25 04:40:18 oleg113-client systemd-logind[1020]: Removed session 310. May 25 04:40:19 oleg113-client sshd[62725]: Accepted publickey for root from 192.168.201.13 port 47232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:19 oleg113-client systemd[1]: Started Session 311 of user root. May 25 04:40:19 oleg113-client systemd-logind[1020]: New session 311 of user root. May 25 04:40:19 oleg113-client sshd[62725]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:19 oleg113-client sshd[62738]: Received disconnect from 192.168.201.13 port 47232:11: disconnected by user May 25 04:40:19 oleg113-client sshd[62738]: Disconnected from user root 192.168.201.13 port 47232 May 25 04:40:19 oleg113-client sshd[62725]: pam_unix(sshd:session): session closed for user root May 25 04:40:19 oleg113-client systemd-logind[1020]: Session 311 logged out. Waiting for processes to exit. May 25 04:40:19 oleg113-client systemd[1]: session-311.scope: Succeeded. May 25 04:40:19 oleg113-client systemd-logind[1020]: Removed session 311. May 25 04:40:21 oleg113-client sshd[62871]: Accepted publickey for root from 192.168.201.13 port 50358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:21 oleg113-client systemd-logind[1020]: New session 312 of user root. May 25 04:40:21 oleg113-client systemd[1]: Started Session 312 of user root. May 25 04:40:21 oleg113-client sshd[62871]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:21 oleg113-client sshd[62884]: Received disconnect from 192.168.201.13 port 50358:11: disconnected by user May 25 04:40:21 oleg113-client sshd[62884]: Disconnected from user root 192.168.201.13 port 50358 May 25 04:40:21 oleg113-client sshd[62871]: pam_unix(sshd:session): session closed for user root May 25 04:40:21 oleg113-client systemd[1]: session-312.scope: Succeeded. May 25 04:40:21 oleg113-client systemd-logind[1020]: Session 312 logged out. Waiting for processes to exit. May 25 04:40:21 oleg113-client systemd-logind[1020]: Removed session 312. May 25 04:40:23 oleg113-client sshd[63026]: Accepted publickey for root from 192.168.201.13 port 50374 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:23 oleg113-client systemd-logind[1020]: New session 313 of user root. May 25 04:40:23 oleg113-client systemd[1]: Started Session 313 of user root. May 25 04:40:23 oleg113-client sshd[63026]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:23 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:40:23 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 04:40:22 (1779698422) May 25 04:40:23 oleg113-client sshd[63041]: Received disconnect from 192.168.201.13 port 50374:11: disconnected by user May 25 04:40:23 oleg113-client sshd[63041]: Disconnected from user root 192.168.201.13 port 50374 May 25 04:40:23 oleg113-client sshd[63026]: pam_unix(sshd:session): session closed for user root May 25 04:40:24 oleg113-client kernel: LustreError: 63078:0:(recover.c:329:ptlrpc_recover_import()) cfs_race id 531 sleeping May 25 04:40:24 oleg113-client systemd[1]: session-313.scope: Succeeded. May 25 04:40:24 oleg113-client systemd-logind[1020]: Session 313 logged out. Waiting for processes to exit. May 25 04:40:24 oleg113-client systemd-logind[1020]: Removed session 313. May 25 04:40:28 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15d1fcd800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 04:40:28 oleg113-client kernel: LustreError: 63098:0:(import.c:293:ptlrpc_invalidate_import()) cfs_fail_race id 531 waking May 25 04:40:28 oleg113-client kernel: LustreError: 63078:0:(recover.c:329:ptlrpc_recover_import()) cfs_fail_race id 531 awake: rc=1015 May 25 04:40:28 oleg113-client kernel: LustreError: 63078:0:(import.c:719:ptlrpc_connect_import_locked()) already connecting May 25 04:40:28 oleg113-client kernel: LustreError: 63103:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:40:29 oleg113-client kernel: LustreError: 63110:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:40:29 oleg113-client kernel: LustreError: 63110:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 5 previous similar messages May 25 04:40:32 oleg113-client kernel: LustreError: 63132:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:40:32 oleg113-client kernel: LustreError: 63132:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 13 previous similar messages May 25 04:40:36 oleg113-client kernel: LustreError: 63174:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 04:40:36 oleg113-client kernel: LustreError: 63174:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 26 previous similar messages May 25 04:40:41 oleg113-client sshd[63296]: Accepted publickey for root from 192.168.201.13 port 57648 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:41 oleg113-client systemd[1]: Started Session 314 of user root. May 25 04:40:41 oleg113-client systemd-logind[1020]: New session 314 of user root. May 25 04:40:41 oleg113-client sshd[63296]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:42 oleg113-client sshd[63309]: Received disconnect from 192.168.201.13 port 57648:11: disconnected by user May 25 04:40:42 oleg113-client sshd[63309]: Disconnected from user root 192.168.201.13 port 57648 May 25 04:40:42 oleg113-client sshd[63296]: pam_unix(sshd:session): session closed for user root May 25 04:40:42 oleg113-client systemd-logind[1020]: Session 314 logged out. Waiting for processes to exit. May 25 04:40:42 oleg113-client systemd[1]: session-314.scope: Succeeded. May 25 04:40:42 oleg113-client systemd-logind[1020]: Removed session 314. May 25 04:40:44 oleg113-client sshd[63436]: Accepted publickey for root from 192.168.201.13 port 57654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:44 oleg113-client systemd[1]: Started Session 315 of user root. May 25 04:40:44 oleg113-client systemd-logind[1020]: New session 315 of user root. May 25 04:40:44 oleg113-client sshd[63436]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:44 oleg113-client sshd[63449]: Received disconnect from 192.168.201.13 port 57654:11: disconnected by user May 25 04:40:44 oleg113-client sshd[63449]: Disconnected from user root 192.168.201.13 port 57654 May 25 04:40:44 oleg113-client sshd[63436]: pam_unix(sshd:session): session closed for user root May 25 04:40:45 oleg113-client systemd[1]: session-315.scope: Succeeded. May 25 04:40:45 oleg113-client systemd-logind[1020]: Session 315 logged out. Waiting for processes to exit. May 25 04:40:45 oleg113-client systemd-logind[1020]: Removed session 315. May 25 04:40:46 oleg113-client sshd[63582]: Accepted publickey for root from 192.168.201.13 port 57668 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:46 oleg113-client systemd[1]: Started Session 316 of user root. May 25 04:40:46 oleg113-client systemd-logind[1020]: New session 316 of user root. May 25 04:40:47 oleg113-client sshd[63582]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:47 oleg113-client sshd[63595]: Received disconnect from 192.168.201.13 port 57668:11: disconnected by user May 25 04:40:47 oleg113-client sshd[63595]: Disconnected from user root 192.168.201.13 port 57668 May 25 04:40:47 oleg113-client sshd[63582]: pam_unix(sshd:session): session closed for user root May 25 04:40:47 oleg113-client systemd-logind[1020]: Session 316 logged out. Waiting for processes to exit. May 25 04:40:47 oleg113-client systemd[1]: session-316.scope: Succeeded. May 25 04:40:47 oleg113-client systemd-logind[1020]: Removed session 316. May 25 04:40:49 oleg113-client sshd[63738]: Accepted publickey for root from 192.168.201.13 port 57068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:40:49 oleg113-client systemd-logind[1020]: New session 317 of user root. May 25 04:40:49 oleg113-client systemd[1]: Started Session 317 of user root. May 25 04:40:49 oleg113-client sshd[63738]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:40:50 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 04:40:48 (1779698448) May 25 04:40:50 oleg113-client sshd[63751]: Received disconnect from 192.168.201.13 port 57068:11: disconnected by user May 25 04:40:50 oleg113-client sshd[63751]: Disconnected from user root 192.168.201.13 port 57068 May 25 04:40:50 oleg113-client sshd[63738]: pam_unix(sshd:session): session closed for user root May 25 04:40:50 oleg113-client systemd[1]: session-317.scope: Succeeded. May 25 04:40:50 oleg113-client systemd-logind[1020]: Session 317 logged out. Waiting for processes to exit. May 25 04:40:50 oleg113-client systemd-logind[1020]: Removed session 317. May 25 04:41:32 oleg113-client sshd[64103]: Accepted publickey for root from 192.168.201.13 port 47760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:32 oleg113-client systemd-logind[1020]: New session 318 of user root. May 25 04:41:32 oleg113-client systemd[1]: Started Session 318 of user root. May 25 04:41:32 oleg113-client sshd[64103]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:33 oleg113-client sshd[64116]: Received disconnect from 192.168.201.13 port 47760:11: disconnected by user May 25 04:41:33 oleg113-client sshd[64116]: Disconnected from user root 192.168.201.13 port 47760 May 25 04:41:33 oleg113-client sshd[64103]: pam_unix(sshd:session): session closed for user root May 25 04:41:33 oleg113-client systemd[1]: session-318.scope: Succeeded. May 25 04:41:33 oleg113-client systemd-logind[1020]: Session 318 logged out. Waiting for processes to exit. May 25 04:41:33 oleg113-client systemd-logind[1020]: Removed session 318. May 25 04:41:38 oleg113-client sshd[64341]: Accepted publickey for root from 192.168.201.13 port 47774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:39 oleg113-client systemd-logind[1020]: New session 319 of user root. May 25 04:41:39 oleg113-client systemd[1]: Started Session 319 of user root. May 25 04:41:39 oleg113-client sshd[64341]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:39 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:41:39 oleg113-client sshd[64354]: Received disconnect from 192.168.201.13 port 47774:11: disconnected by user May 25 04:41:39 oleg113-client sshd[64354]: Disconnected from user root 192.168.201.13 port 47774 May 25 04:41:39 oleg113-client sshd[64341]: pam_unix(sshd:session): session closed for user root May 25 04:41:40 oleg113-client systemd[1]: session-319.scope: Succeeded. May 25 04:41:40 oleg113-client systemd-logind[1020]: Session 319 logged out. Waiting for processes to exit. May 25 04:41:40 oleg113-client systemd-logind[1020]: Removed session 319. May 25 04:41:41 oleg113-client sshd[64497]: Accepted publickey for root from 192.168.201.13 port 60920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:42 oleg113-client systemd-logind[1020]: New session 320 of user root. May 25 04:41:42 oleg113-client systemd[1]: Started Session 320 of user root. May 25 04:41:42 oleg113-client sshd[64497]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:42 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:41:42 oleg113-client sshd[64510]: Received disconnect from 192.168.201.13 port 60920:11: disconnected by user May 25 04:41:42 oleg113-client sshd[64510]: Disconnected from user root 192.168.201.13 port 60920 May 25 04:41:42 oleg113-client sshd[64497]: pam_unix(sshd:session): session closed for user root May 25 04:41:43 oleg113-client systemd[1]: session-320.scope: Succeeded. May 25 04:41:43 oleg113-client systemd-logind[1020]: Session 320 logged out. Waiting for processes to exit. May 25 04:41:43 oleg113-client systemd-logind[1020]: Removed session 320. May 25 04:41:44 oleg113-client sshd[64552]: Accepted publickey for root from 192.168.201.13 port 60934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:44 oleg113-client systemd[1]: Started Session 321 of user root. May 25 04:41:44 oleg113-client systemd-logind[1020]: New session 321 of user root. May 25 04:41:44 oleg113-client sshd[64552]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:45 oleg113-client sshd[64565]: Received disconnect from 192.168.201.13 port 60934:11: disconnected by user May 25 04:41:45 oleg113-client sshd[64565]: Disconnected from user root 192.168.201.13 port 60934 May 25 04:41:45 oleg113-client sshd[64552]: pam_unix(sshd:session): session closed for user root May 25 04:41:45 oleg113-client systemd[1]: session-321.scope: Succeeded. May 25 04:41:45 oleg113-client systemd-logind[1020]: Session 321 logged out. Waiting for processes to exit. May 25 04:41:45 oleg113-client systemd-logind[1020]: Removed session 321. May 25 04:41:50 oleg113-client sshd[64715]: Accepted publickey for root from 192.168.201.13 port 38064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:50 oleg113-client systemd-logind[1020]: New session 322 of user root. May 25 04:41:50 oleg113-client systemd[1]: Started Session 322 of user root. May 25 04:41:50 oleg113-client sshd[64715]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:51 oleg113-client sshd[64728]: Received disconnect from 192.168.201.13 port 38064:11: disconnected by user May 25 04:41:51 oleg113-client sshd[64728]: Disconnected from user root 192.168.201.13 port 38064 May 25 04:41:51 oleg113-client sshd[64715]: pam_unix(sshd:session): session closed for user root May 25 04:41:51 oleg113-client systemd-logind[1020]: Session 322 logged out. Waiting for processes to exit. May 25 04:41:51 oleg113-client systemd[1]: session-322.scope: Succeeded. May 25 04:41:51 oleg113-client systemd-logind[1020]: Removed session 322. May 25 04:41:53 oleg113-client sshd[64855]: Accepted publickey for root from 192.168.201.13 port 38076 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:53 oleg113-client systemd-logind[1020]: New session 323 of user root. May 25 04:41:53 oleg113-client systemd[1]: Started Session 323 of user root. May 25 04:41:53 oleg113-client sshd[64855]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:53 oleg113-client sshd[64868]: Received disconnect from 192.168.201.13 port 38076:11: disconnected by user May 25 04:41:53 oleg113-client sshd[64868]: Disconnected from user root 192.168.201.13 port 38076 May 25 04:41:53 oleg113-client sshd[64855]: pam_unix(sshd:session): session closed for user root May 25 04:41:54 oleg113-client systemd[1]: session-323.scope: Succeeded. May 25 04:41:54 oleg113-client systemd-logind[1020]: Session 323 logged out. Waiting for processes to exit. May 25 04:41:54 oleg113-client systemd-logind[1020]: Removed session 323. May 25 04:41:56 oleg113-client sshd[65001]: Accepted publickey for root from 192.168.201.13 port 38082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:56 oleg113-client systemd[1]: Started Session 324 of user root. May 25 04:41:56 oleg113-client systemd-logind[1020]: New session 324 of user root. May 25 04:41:56 oleg113-client sshd[65001]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:41:57 oleg113-client sshd[65014]: Received disconnect from 192.168.201.13 port 38082:11: disconnected by user May 25 04:41:57 oleg113-client sshd[65014]: Disconnected from user root 192.168.201.13 port 38082 May 25 04:41:57 oleg113-client sshd[65001]: pam_unix(sshd:session): session closed for user root May 25 04:41:57 oleg113-client systemd-logind[1020]: Session 324 logged out. Waiting for processes to exit. May 25 04:41:57 oleg113-client systemd[1]: session-324.scope: Succeeded. May 25 04:41:57 oleg113-client systemd-logind[1020]: Removed session 324. May 25 04:41:59 oleg113-client sshd[65157]: Accepted publickey for root from 192.168.201.13 port 41828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:41:59 oleg113-client systemd-logind[1020]: New session 325 of user root. May 25 04:41:59 oleg113-client systemd[1]: Started Session 325 of user root. May 25 04:41:59 oleg113-client sshd[65157]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:00 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 04:41:57 (1779698517) May 25 04:42:00 oleg113-client sshd[65170]: Received disconnect from 192.168.201.13 port 41828:11: disconnected by user May 25 04:42:00 oleg113-client sshd[65170]: Disconnected from user root 192.168.201.13 port 41828 May 25 04:42:00 oleg113-client sshd[65157]: pam_unix(sshd:session): session closed for user root May 25 04:42:00 oleg113-client systemd-logind[1020]: Session 325 logged out. Waiting for processes to exit. May 25 04:42:01 oleg113-client systemd[1]: session-325.scope: Succeeded. May 25 04:42:01 oleg113-client systemd-logind[1020]: Removed session 325. May 25 04:42:42 oleg113-client sshd[65496]: Accepted publickey for root from 192.168.201.13 port 54222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:42 oleg113-client systemd-logind[1020]: New session 326 of user root. May 25 04:42:42 oleg113-client systemd[1]: Started Session 326 of user root. May 25 04:42:42 oleg113-client sshd[65496]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:43 oleg113-client sshd[65509]: Received disconnect from 192.168.201.13 port 54222:11: disconnected by user May 25 04:42:43 oleg113-client sshd[65509]: Disconnected from user root 192.168.201.13 port 54222 May 25 04:42:43 oleg113-client sshd[65496]: pam_unix(sshd:session): session closed for user root May 25 04:42:43 oleg113-client systemd[1]: session-326.scope: Succeeded. May 25 04:42:43 oleg113-client systemd-logind[1020]: Session 326 logged out. Waiting for processes to exit. May 25 04:42:43 oleg113-client systemd-logind[1020]: Removed session 326. May 25 04:42:48 oleg113-client sshd[65732]: Accepted publickey for root from 192.168.201.13 port 54228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:48 oleg113-client systemd-logind[1020]: New session 327 of user root. May 25 04:42:48 oleg113-client systemd[1]: Started Session 327 of user root. May 25 04:42:48 oleg113-client sshd[65732]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:49 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:42:49 oleg113-client sshd[65746]: Received disconnect from 192.168.201.13 port 54228:11: disconnected by user May 25 04:42:49 oleg113-client sshd[65746]: Disconnected from user root 192.168.201.13 port 54228 May 25 04:42:49 oleg113-client sshd[65732]: pam_unix(sshd:session): session closed for user root May 25 04:42:49 oleg113-client systemd[1]: session-327.scope: Succeeded. May 25 04:42:49 oleg113-client systemd-logind[1020]: Session 327 logged out. Waiting for processes to exit. May 25 04:42:49 oleg113-client systemd-logind[1020]: Removed session 327. May 25 04:42:51 oleg113-client sshd[65889]: Accepted publickey for root from 192.168.201.13 port 42098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:51 oleg113-client systemd-logind[1020]: New session 328 of user root. May 25 04:42:51 oleg113-client systemd[1]: Started Session 328 of user root. May 25 04:42:51 oleg113-client sshd[65889]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:51 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:42:51 oleg113-client sshd[65902]: Received disconnect from 192.168.201.13 port 42098:11: disconnected by user May 25 04:42:51 oleg113-client sshd[65902]: Disconnected from user root 192.168.201.13 port 42098 May 25 04:42:51 oleg113-client sshd[65889]: pam_unix(sshd:session): session closed for user root May 25 04:42:52 oleg113-client systemd-logind[1020]: Session 328 logged out. Waiting for processes to exit. May 25 04:42:52 oleg113-client systemd[1]: session-328.scope: Succeeded. May 25 04:42:52 oleg113-client systemd-logind[1020]: Removed session 328. May 25 04:42:53 oleg113-client sshd[65943]: Accepted publickey for root from 192.168.201.13 port 42102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:53 oleg113-client systemd[1]: Started Session 329 of user root. May 25 04:42:53 oleg113-client systemd-logind[1020]: New session 329 of user root. May 25 04:42:53 oleg113-client sshd[65943]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:54 oleg113-client sshd[65956]: Received disconnect from 192.168.201.13 port 42102:11: disconnected by user May 25 04:42:54 oleg113-client sshd[65956]: Disconnected from user root 192.168.201.13 port 42102 May 25 04:42:54 oleg113-client sshd[65943]: pam_unix(sshd:session): session closed for user root May 25 04:42:54 oleg113-client systemd[1]: session-329.scope: Succeeded. May 25 04:42:54 oleg113-client systemd-logind[1020]: Session 329 logged out. Waiting for processes to exit. May 25 04:42:54 oleg113-client systemd-logind[1020]: Removed session 329. May 25 04:42:58 oleg113-client sshd[66109]: Accepted publickey for root from 192.168.201.13 port 42106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:42:59 oleg113-client systemd-logind[1020]: New session 330 of user root. May 25 04:42:59 oleg113-client systemd[1]: Started Session 330 of user root. May 25 04:42:59 oleg113-client sshd[66109]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:42:59 oleg113-client sshd[66122]: Received disconnect from 192.168.201.13 port 42106:11: disconnected by user May 25 04:42:59 oleg113-client sshd[66122]: Disconnected from user root 192.168.201.13 port 42106 May 25 04:42:59 oleg113-client sshd[66109]: pam_unix(sshd:session): session closed for user root May 25 04:42:59 oleg113-client systemd[1]: session-330.scope: Succeeded. May 25 04:42:59 oleg113-client systemd-logind[1020]: Session 330 logged out. Waiting for processes to exit. May 25 04:42:59 oleg113-client systemd-logind[1020]: Removed session 330. May 25 04:43:01 oleg113-client sshd[66248]: Accepted publickey for root from 192.168.201.13 port 44704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:01 oleg113-client systemd-logind[1020]: New session 331 of user root. May 25 04:43:01 oleg113-client systemd[1]: Started Session 331 of user root. May 25 04:43:01 oleg113-client sshd[66248]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:01 oleg113-client sshd[66261]: Received disconnect from 192.168.201.13 port 44704:11: disconnected by user May 25 04:43:01 oleg113-client sshd[66261]: Disconnected from user root 192.168.201.13 port 44704 May 25 04:43:02 oleg113-client sshd[66248]: pam_unix(sshd:session): session closed for user root May 25 04:43:02 oleg113-client systemd[1]: session-331.scope: Succeeded. May 25 04:43:02 oleg113-client systemd-logind[1020]: Session 331 logged out. Waiting for processes to exit. May 25 04:43:02 oleg113-client systemd-logind[1020]: Removed session 331. May 25 04:43:03 oleg113-client sshd[66395]: Accepted publickey for root from 192.168.201.13 port 44712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:03 oleg113-client systemd-logind[1020]: New session 332 of user root. May 25 04:43:03 oleg113-client systemd[1]: Started Session 332 of user root. May 25 04:43:03 oleg113-client sshd[66395]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:04 oleg113-client sshd[66408]: Received disconnect from 192.168.201.13 port 44712:11: disconnected by user May 25 04:43:04 oleg113-client sshd[66408]: Disconnected from user root 192.168.201.13 port 44712 May 25 04:43:04 oleg113-client sshd[66395]: pam_unix(sshd:session): session closed for user root May 25 04:43:04 oleg113-client systemd[1]: session-332.scope: Succeeded. May 25 04:43:04 oleg113-client systemd-logind[1020]: Session 332 logged out. Waiting for processes to exit. May 25 04:43:04 oleg113-client systemd-logind[1020]: Removed session 332. May 25 04:43:06 oleg113-client sshd[66551]: Accepted publickey for root from 192.168.201.13 port 44726 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:43:06 oleg113-client systemd[1]: Started Session 333 of user root. May 25 04:43:06 oleg113-client systemd-logind[1020]: New session 333 of user root. May 25 04:43:06 oleg113-client sshd[66551]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:43:06 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 04:43:04 (1779698584) May 25 04:43:06 oleg113-client sshd[66564]: Received disconnect from 192.168.201.13 port 44726:11: disconnected by user May 25 04:43:07 oleg113-client sshd[66564]: Disconnected from user root 192.168.201.13 port 44726 May 25 04:43:07 oleg113-client sshd[66551]: pam_unix(sshd:session): session closed for user root May 25 04:43:07 oleg113-client systemd[1]: session-333.scope: Succeeded. May 25 04:43:07 oleg113-client systemd-logind[1020]: Session 333 logged out. Waiting for processes to exit. May 25 04:43:07 oleg113-client systemd-logind[1020]: Removed session 333. May 25 04:44:16 oleg113-client sshd[66902]: Accepted publickey for root from 192.168.201.13 port 56674 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:16 oleg113-client systemd[1]: Started Session 334 of user root. May 25 04:44:16 oleg113-client systemd-logind[1020]: New session 334 of user root. May 25 04:44:16 oleg113-client sshd[66902]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:17 oleg113-client sshd[66915]: Received disconnect from 192.168.201.13 port 56674:11: disconnected by user May 25 04:44:17 oleg113-client sshd[66915]: Disconnected from user root 192.168.201.13 port 56674 May 25 04:44:17 oleg113-client sshd[66902]: pam_unix(sshd:session): session closed for user root May 25 04:44:17 oleg113-client systemd-logind[1020]: Session 334 logged out. Waiting for processes to exit. May 25 04:44:17 oleg113-client systemd[1]: session-334.scope: Succeeded. May 25 04:44:17 oleg113-client systemd-logind[1020]: Removed session 334. May 25 04:44:23 oleg113-client sshd[67139]: Accepted publickey for root from 192.168.201.13 port 41758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:23 oleg113-client systemd-logind[1020]: New session 335 of user root. May 25 04:44:23 oleg113-client systemd[1]: Started Session 335 of user root. May 25 04:44:23 oleg113-client sshd[67139]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:24 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:44:24 oleg113-client sshd[67152]: Received disconnect from 192.168.201.13 port 41758:11: disconnected by user May 25 04:44:24 oleg113-client sshd[67152]: Disconnected from user root 192.168.201.13 port 41758 May 25 04:44:24 oleg113-client sshd[67139]: pam_unix(sshd:session): session closed for user root May 25 04:44:25 oleg113-client systemd[1]: session-335.scope: Succeeded. May 25 04:44:25 oleg113-client systemd-logind[1020]: Session 335 logged out. Waiting for processes to exit. May 25 04:44:25 oleg113-client systemd-logind[1020]: Removed session 335. May 25 04:44:27 oleg113-client sshd[67296]: Accepted publickey for root from 192.168.201.13 port 41764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:27 oleg113-client systemd-logind[1020]: New session 336 of user root. May 25 04:44:27 oleg113-client systemd[1]: Started Session 336 of user root. May 25 04:44:27 oleg113-client sshd[67296]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:27 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:44:27 oleg113-client sshd[67309]: Received disconnect from 192.168.201.13 port 41764:11: disconnected by user May 25 04:44:27 oleg113-client sshd[67309]: Disconnected from user root 192.168.201.13 port 41764 May 25 04:44:27 oleg113-client sshd[67296]: pam_unix(sshd:session): session closed for user root May 25 04:44:28 oleg113-client systemd-logind[1020]: Session 336 logged out. Waiting for processes to exit. May 25 04:44:28 oleg113-client systemd[1]: session-336.scope: Succeeded. May 25 04:44:28 oleg113-client systemd-logind[1020]: Removed session 336. May 25 04:44:30 oleg113-client sshd[67350]: Accepted publickey for root from 192.168.201.13 port 42568 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:30 oleg113-client systemd-logind[1020]: New session 337 of user root. May 25 04:44:30 oleg113-client systemd[1]: Started Session 337 of user root. May 25 04:44:30 oleg113-client sshd[67350]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:31 oleg113-client sshd[67363]: Received disconnect from 192.168.201.13 port 42568:11: disconnected by user May 25 04:44:31 oleg113-client sshd[67363]: Disconnected from user root 192.168.201.13 port 42568 May 25 04:44:31 oleg113-client sshd[67350]: pam_unix(sshd:session): session closed for user root May 25 04:44:31 oleg113-client systemd[1]: session-337.scope: Succeeded. May 25 04:44:31 oleg113-client systemd-logind[1020]: Session 337 logged out. Waiting for processes to exit. May 25 04:44:31 oleg113-client systemd-logind[1020]: Removed session 337. May 25 04:44:32 oleg113-client sshd[67483]: Accepted publickey for root from 192.168.201.13 port 42580 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:33 oleg113-client systemd-logind[1020]: New session 338 of user root. May 25 04:44:33 oleg113-client systemd[1]: Started Session 338 of user root. May 25 04:44:33 oleg113-client sshd[67483]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:33 oleg113-client sshd[67496]: Received disconnect from 192.168.201.13 port 42580:11: disconnected by user May 25 04:44:33 oleg113-client sshd[67496]: Disconnected from user root 192.168.201.13 port 42580 May 25 04:44:33 oleg113-client sshd[67483]: pam_unix(sshd:session): session closed for user root May 25 04:44:34 oleg113-client systemd-logind[1020]: Session 338 logged out. Waiting for processes to exit. May 25 04:44:34 oleg113-client systemd[1]: session-338.scope: Succeeded. May 25 04:44:34 oleg113-client systemd-logind[1020]: Removed session 338. May 25 04:44:35 oleg113-client sshd[67622]: Accepted publickey for root from 192.168.201.13 port 42590 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:35 oleg113-client systemd[1]: Started Session 339 of user root. May 25 04:44:35 oleg113-client systemd-logind[1020]: New session 339 of user root. May 25 04:44:35 oleg113-client sshd[67622]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:35 oleg113-client sshd[67635]: Received disconnect from 192.168.201.13 port 42590:11: disconnected by user May 25 04:44:36 oleg113-client sshd[67635]: Disconnected from user root 192.168.201.13 port 42590 May 25 04:44:36 oleg113-client sshd[67622]: pam_unix(sshd:session): session closed for user root May 25 04:44:36 oleg113-client systemd[1]: session-339.scope: Succeeded. May 25 04:44:36 oleg113-client systemd-logind[1020]: Session 339 logged out. Waiting for processes to exit. May 25 04:44:36 oleg113-client systemd-logind[1020]: Removed session 339. May 25 04:44:38 oleg113-client sshd[67768]: Accepted publickey for root from 192.168.201.13 port 42596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:38 oleg113-client systemd-logind[1020]: New session 340 of user root. May 25 04:44:38 oleg113-client systemd[1]: Started Session 340 of user root. May 25 04:44:38 oleg113-client sshd[67768]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:38 oleg113-client sshd[67781]: Received disconnect from 192.168.201.13 port 42596:11: disconnected by user May 25 04:44:38 oleg113-client sshd[67781]: Disconnected from user root 192.168.201.13 port 42596 May 25 04:44:38 oleg113-client sshd[67768]: pam_unix(sshd:session): session closed for user root May 25 04:44:39 oleg113-client systemd-logind[1020]: Session 340 logged out. Waiting for processes to exit. May 25 04:44:39 oleg113-client systemd[1]: session-340.scope: Succeeded. May 25 04:44:39 oleg113-client systemd-logind[1020]: Removed session 340. May 25 04:44:40 oleg113-client sshd[67925]: Accepted publickey for root from 192.168.201.13 port 53972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:44:41 oleg113-client systemd-logind[1020]: New session 341 of user root. May 25 04:44:41 oleg113-client systemd[1]: Started Session 341 of user root. May 25 04:44:41 oleg113-client sshd[67925]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:44:41 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 04:44:39 (1779698679) May 25 04:44:41 oleg113-client sshd[67938]: Received disconnect from 192.168.201.13 port 53972:11: disconnected by user May 25 04:44:41 oleg113-client sshd[67938]: Disconnected from user root 192.168.201.13 port 53972 May 25 04:44:41 oleg113-client sshd[67925]: pam_unix(sshd:session): session closed for user root May 25 04:44:42 oleg113-client systemd[1]: session-341.scope: Succeeded. May 25 04:44:42 oleg113-client systemd-logind[1020]: Session 341 logged out. Waiting for processes to exit. May 25 04:44:42 oleg113-client systemd-logind[1020]: Removed session 341. May 25 04:45:20 oleg113-client sshd[68259]: Accepted publickey for root from 192.168.201.13 port 49308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:20 oleg113-client systemd-logind[1020]: New session 342 of user root. May 25 04:45:20 oleg113-client systemd[1]: Started Session 342 of user root. May 25 04:45:20 oleg113-client sshd[68259]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:21 oleg113-client sshd[68272]: Received disconnect from 192.168.201.13 port 49308:11: disconnected by user May 25 04:45:21 oleg113-client sshd[68272]: Disconnected from user root 192.168.201.13 port 49308 May 25 04:45:21 oleg113-client sshd[68259]: pam_unix(sshd:session): session closed for user root May 25 04:45:21 oleg113-client systemd-logind[1020]: Session 342 logged out. Waiting for processes to exit. May 25 04:45:21 oleg113-client systemd[1]: session-342.scope: Succeeded. May 25 04:45:21 oleg113-client systemd-logind[1020]: Removed session 342. May 25 04:45:26 oleg113-client sshd[68495]: Accepted publickey for root from 192.168.201.13 port 49318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:26 oleg113-client systemd-logind[1020]: New session 343 of user root. May 25 04:45:26 oleg113-client systemd[1]: Started Session 343 of user root. May 25 04:45:26 oleg113-client sshd[68495]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:27 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:45:27 oleg113-client sshd[68509]: Received disconnect from 192.168.201.13 port 49318:11: disconnected by user May 25 04:45:27 oleg113-client sshd[68509]: Disconnected from user root 192.168.201.13 port 49318 May 25 04:45:27 oleg113-client sshd[68495]: pam_unix(sshd:session): session closed for user root May 25 04:45:27 oleg113-client systemd-logind[1020]: Session 343 logged out. Waiting for processes to exit. May 25 04:45:27 oleg113-client systemd[1]: session-343.scope: Succeeded. May 25 04:45:27 oleg113-client systemd-logind[1020]: Removed session 343. May 25 04:45:29 oleg113-client sshd[68652]: Accepted publickey for root from 192.168.201.13 port 38918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:29 oleg113-client systemd-logind[1020]: New session 344 of user root. May 25 04:45:29 oleg113-client systemd[1]: Started Session 344 of user root. May 25 04:45:29 oleg113-client sshd[68652]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:30 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 04:45:30 oleg113-client sshd[68665]: Received disconnect from 192.168.201.13 port 38918:11: disconnected by user May 25 04:45:30 oleg113-client sshd[68665]: Disconnected from user root 192.168.201.13 port 38918 May 25 04:45:30 oleg113-client sshd[68652]: pam_unix(sshd:session): session closed for user root May 25 04:45:30 oleg113-client systemd[1]: session-344.scope: Succeeded. May 25 04:45:30 oleg113-client systemd-logind[1020]: Session 344 logged out. Waiting for processes to exit. May 25 04:45:30 oleg113-client systemd-logind[1020]: Removed session 344. May 25 04:45:32 oleg113-client sshd[68706]: Accepted publickey for root from 192.168.201.13 port 38924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:45:32 oleg113-client systemd-logind[1020]: New session 345 of user root. May 25 04:45:32 oleg113-client systemd[1]: Started Session 345 of user root. May 25 04:45:32 oleg113-client sshd[68706]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:45:32 oleg113-client sshd[68719]: Received disconnect from 192.168.201.13 port 38924:11: disconnected by user May 25 04:45:33 oleg113-client sshd[68719]: Disconnected from user root 192.168.201.13 port 38924 May 25 04:45:33 oleg113-client sshd[68706]: pam_unix(sshd:session): session closed for user root May 25 04:45:33 oleg113-client systemd-logind[1020]: Session 345 logged out. Waiting for processes to exit. May 25 04:45:33 oleg113-client systemd[1]: session-345.scope: Succeeded. May 25 04:45:33 oleg113-client systemd-logind[1020]: Removed session 345. May 25 04:45:37 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 04:45:37 oleg113-client kernel: LustreError: 68810:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15d1fcd800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:45:37 oleg113-client kernel: LustreError: 68810:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:45:37 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:46:30 oleg113-client sshd[69281]: Accepted publickey for root from 192.168.201.13 port 37586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:31 oleg113-client systemd-logind[1020]: New session 346 of user root. May 25 04:46:31 oleg113-client systemd[1]: Started Session 346 of user root. May 25 04:46:31 oleg113-client sshd[69281]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:31 oleg113-client sshd[69294]: Received disconnect from 192.168.201.13 port 37586:11: disconnected by user May 25 04:46:31 oleg113-client sshd[69294]: Disconnected from user root 192.168.201.13 port 37586 May 25 04:46:31 oleg113-client sshd[69281]: pam_unix(sshd:session): session closed for user root May 25 04:46:31 oleg113-client systemd-logind[1020]: Session 346 logged out. Waiting for processes to exit. May 25 04:46:31 oleg113-client systemd[1]: session-346.scope: Succeeded. May 25 04:46:31 oleg113-client systemd-logind[1020]: Removed session 346. May 25 04:46:36 oleg113-client sshd[69518]: Accepted publickey for root from 192.168.201.13 port 37596 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:36 oleg113-client systemd-logind[1020]: New session 347 of user root. May 25 04:46:36 oleg113-client systemd[1]: Started Session 347 of user root. May 25 04:46:36 oleg113-client sshd[69518]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:36 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 04:46:36 oleg113-client sshd[69531]: Received disconnect from 192.168.201.13 port 37596:11: disconnected by user May 25 04:46:36 oleg113-client sshd[69531]: Disconnected from user root 192.168.201.13 port 37596 May 25 04:46:36 oleg113-client sshd[69518]: pam_unix(sshd:session): session closed for user root May 25 04:46:37 oleg113-client systemd[1]: session-347.scope: Succeeded. May 25 04:46:37 oleg113-client systemd-logind[1020]: Session 347 logged out. Waiting for processes to exit. May 25 04:46:37 oleg113-client systemd-logind[1020]: Removed session 347. May 25 04:46:38 oleg113-client sshd[69580]: Accepted publickey for root from 192.168.201.13 port 37612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:38 oleg113-client systemd-logind[1020]: New session 348 of user root. May 25 04:46:38 oleg113-client systemd[1]: Started Session 348 of user root. May 25 04:46:38 oleg113-client sshd[69580]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:39 oleg113-client sshd[69593]: Received disconnect from 192.168.201.13 port 37612:11: disconnected by user May 25 04:46:39 oleg113-client sshd[69593]: Disconnected from user root 192.168.201.13 port 37612 May 25 04:46:39 oleg113-client sshd[69580]: pam_unix(sshd:session): session closed for user root May 25 04:46:39 oleg113-client systemd-logind[1020]: Session 348 logged out. Waiting for processes to exit. May 25 04:46:39 oleg113-client systemd[1]: session-348.scope: Succeeded. May 25 04:46:39 oleg113-client systemd-logind[1020]: Removed session 348. May 25 04:46:40 oleg113-client systemd-udevd[69663]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:46:40 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:46:42 oleg113-client sshd[69781]: Accepted publickey for root from 192.168.201.13 port 36458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:42 oleg113-client systemd-logind[1020]: New session 349 of user root. May 25 04:46:42 oleg113-client systemd[1]: Started Session 349 of user root. May 25 04:46:42 oleg113-client sshd[69781]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:43 oleg113-client sshd[69794]: Received disconnect from 192.168.201.13 port 36458:11: disconnected by user May 25 04:46:43 oleg113-client sshd[69794]: Disconnected from user root 192.168.201.13 port 36458 May 25 04:46:43 oleg113-client sshd[69781]: pam_unix(sshd:session): session closed for user root May 25 04:46:43 oleg113-client systemd-logind[1020]: Session 349 logged out. Waiting for processes to exit. May 25 04:46:43 oleg113-client systemd[1]: session-349.scope: Succeeded. May 25 04:46:43 oleg113-client systemd-logind[1020]: Removed session 349. May 25 04:46:45 oleg113-client sshd[69921]: Accepted publickey for root from 192.168.201.13 port 36472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:45 oleg113-client systemd-logind[1020]: New session 350 of user root. May 25 04:46:45 oleg113-client systemd[1]: Started Session 350 of user root. May 25 04:46:45 oleg113-client sshd[69921]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:46 oleg113-client sshd[69934]: Received disconnect from 192.168.201.13 port 36472:11: disconnected by user May 25 04:46:46 oleg113-client sshd[69934]: Disconnected from user root 192.168.201.13 port 36472 May 25 04:46:46 oleg113-client sshd[69921]: pam_unix(sshd:session): session closed for user root May 25 04:46:46 oleg113-client systemd[1]: session-350.scope: Succeeded. May 25 04:46:46 oleg113-client systemd-logind[1020]: Session 350 logged out. Waiting for processes to exit. May 25 04:46:46 oleg113-client systemd-logind[1020]: Removed session 350. May 25 04:46:48 oleg113-client sshd[70069]: Accepted publickey for root from 192.168.201.13 port 36484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:48 oleg113-client systemd-logind[1020]: New session 351 of user root. May 25 04:46:48 oleg113-client systemd[1]: Started Session 351 of user root. May 25 04:46:48 oleg113-client sshd[70069]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:48 oleg113-client sshd[70082]: Received disconnect from 192.168.201.13 port 36484:11: disconnected by user May 25 04:46:48 oleg113-client sshd[70082]: Disconnected from user root 192.168.201.13 port 36484 May 25 04:46:49 oleg113-client sshd[70069]: pam_unix(sshd:session): session closed for user root May 25 04:46:49 oleg113-client systemd[1]: session-351.scope: Succeeded. May 25 04:46:49 oleg113-client systemd-logind[1020]: Session 351 logged out. Waiting for processes to exit. May 25 04:46:49 oleg113-client systemd-logind[1020]: Removed session 351. May 25 04:46:51 oleg113-client sshd[70224]: Accepted publickey for root from 192.168.201.13 port 43244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:51 oleg113-client systemd-logind[1020]: New session 352 of user root. May 25 04:46:51 oleg113-client systemd[1]: Started Session 352 of user root. May 25 04:46:51 oleg113-client sshd[70224]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:52 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 04:46:49 (1779698809) May 25 04:46:52 oleg113-client sshd[70238]: Received disconnect from 192.168.201.13 port 43244:11: disconnected by user May 25 04:46:52 oleg113-client sshd[70238]: Disconnected from user root 192.168.201.13 port 43244 May 25 04:46:52 oleg113-client sshd[70224]: pam_unix(sshd:session): session closed for user root May 25 04:46:52 oleg113-client systemd[1]: session-352.scope: Succeeded. May 25 04:46:52 oleg113-client systemd-logind[1020]: Session 352 logged out. Waiting for processes to exit. May 25 04:46:52 oleg113-client systemd-logind[1020]: Removed session 352. May 25 04:46:54 oleg113-client sshd[70387]: Accepted publickey for root from 192.168.201.13 port 43258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:54 oleg113-client systemd-logind[1020]: New session 353 of user root. May 25 04:46:54 oleg113-client systemd[1]: Started Session 353 of user root. May 25 04:46:55 oleg113-client sshd[70387]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:55 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds May 25 04:46:55 oleg113-client sshd[70400]: Received disconnect from 192.168.201.13 port 43258:11: disconnected by user May 25 04:46:55 oleg113-client sshd[70400]: Disconnected from user root 192.168.201.13 port 43258 May 25 04:46:55 oleg113-client sshd[70387]: pam_unix(sshd:session): session closed for user root May 25 04:46:55 oleg113-client systemd[1]: session-353.scope: Succeeded. May 25 04:46:55 oleg113-client systemd-logind[1020]: Session 353 logged out. Waiting for processes to exit. May 25 04:46:55 oleg113-client systemd-logind[1020]: Removed session 353. May 25 04:46:57 oleg113-client sshd[70542]: Accepted publickey for root from 192.168.201.13 port 43274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:46:57 oleg113-client systemd-logind[1020]: New session 354 of user root. May 25 04:46:57 oleg113-client systemd[1]: Started Session 354 of user root. May 25 04:46:57 oleg113-client sshd[70542]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:46:57 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 04:46:55 (1779698815) May 25 04:46:57 oleg113-client sshd[70555]: Received disconnect from 192.168.201.13 port 43274:11: disconnected by user May 25 04:46:57 oleg113-client sshd[70555]: Disconnected from user root 192.168.201.13 port 43274 May 25 04:46:57 oleg113-client sshd[70542]: pam_unix(sshd:session): session closed for user root May 25 04:46:57 oleg113-client systemd[1]: session-354.scope: Succeeded. May 25 04:46:58 oleg113-client systemd-logind[1020]: Session 354 logged out. Waiting for processes to exit. May 25 04:46:58 oleg113-client systemd-logind[1020]: Removed session 354. May 25 04:47:28 oleg113-client sshd[70841]: Accepted publickey for root from 192.168.201.13 port 49564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:28 oleg113-client systemd-logind[1020]: New session 355 of user root. May 25 04:47:28 oleg113-client systemd[1]: Started Session 355 of user root. May 25 04:47:28 oleg113-client sshd[70841]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:28 oleg113-client sshd[70854]: Received disconnect from 192.168.201.13 port 49564:11: disconnected by user May 25 04:47:29 oleg113-client sshd[70854]: Disconnected from user root 192.168.201.13 port 49564 May 25 04:47:29 oleg113-client sshd[70841]: pam_unix(sshd:session): session closed for user root May 25 04:47:29 oleg113-client systemd-logind[1020]: Session 355 logged out. Waiting for processes to exit. May 25 04:47:29 oleg113-client systemd[1]: session-355.scope: Succeeded. May 25 04:47:29 oleg113-client systemd-logind[1020]: Removed session 355. May 25 04:47:33 oleg113-client sshd[70993]: Accepted publickey for root from 192.168.201.13 port 36066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:33 oleg113-client systemd[1]: Started Session 356 of user root. May 25 04:47:33 oleg113-client systemd-logind[1020]: New session 356 of user root. May 25 04:47:33 oleg113-client sshd[70993]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:34 oleg113-client sshd[71006]: Received disconnect from 192.168.201.13 port 36066:11: disconnected by user May 25 04:47:34 oleg113-client sshd[71006]: Disconnected from user root 192.168.201.13 port 36066 May 25 04:47:34 oleg113-client sshd[70993]: pam_unix(sshd:session): session closed for user root May 25 04:47:34 oleg113-client systemd[1]: session-356.scope: Succeeded. May 25 04:47:34 oleg113-client systemd-logind[1020]: Session 356 logged out. Waiting for processes to exit. May 25 04:47:34 oleg113-client systemd-logind[1020]: Removed session 356. May 25 04:47:35 oleg113-client sshd[71132]: Accepted publickey for root from 192.168.201.13 port 36074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:35 oleg113-client systemd-logind[1020]: New session 357 of user root. May 25 04:47:35 oleg113-client systemd[1]: Started Session 357 of user root. May 25 04:47:36 oleg113-client sshd[71132]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:36 oleg113-client sshd[71145]: Received disconnect from 192.168.201.13 port 36074:11: disconnected by user May 25 04:47:36 oleg113-client sshd[71145]: Disconnected from user root 192.168.201.13 port 36074 May 25 04:47:36 oleg113-client sshd[71132]: pam_unix(sshd:session): session closed for user root May 25 04:47:36 oleg113-client systemd[1]: session-357.scope: Succeeded. May 25 04:47:36 oleg113-client systemd-logind[1020]: Session 357 logged out. Waiting for processes to exit. May 25 04:47:36 oleg113-client systemd-logind[1020]: Removed session 357. May 25 04:47:38 oleg113-client sshd[71279]: Accepted publickey for root from 192.168.201.13 port 36084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:38 oleg113-client systemd-logind[1020]: New session 358 of user root. May 25 04:47:38 oleg113-client systemd[1]: Started Session 358 of user root. May 25 04:47:38 oleg113-client sshd[71279]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:39 oleg113-client sshd[71292]: Received disconnect from 192.168.201.13 port 36084:11: disconnected by user May 25 04:47:39 oleg113-client sshd[71292]: Disconnected from user root 192.168.201.13 port 36084 May 25 04:47:39 oleg113-client sshd[71279]: pam_unix(sshd:session): session closed for user root May 25 04:47:39 oleg113-client systemd[1]: session-358.scope: Succeeded. May 25 04:47:39 oleg113-client systemd-logind[1020]: Session 358 logged out. Waiting for processes to exit. May 25 04:47:39 oleg113-client systemd-logind[1020]: Removed session 358. May 25 04:47:41 oleg113-client sshd[71434]: Accepted publickey for root from 192.168.201.13 port 40548 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:41 oleg113-client systemd-logind[1020]: New session 359 of user root. May 25 04:47:41 oleg113-client systemd[1]: Started Session 359 of user root. May 25 04:47:41 oleg113-client sshd[71434]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:41 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 04:47:39 (1779698859) May 25 04:47:41 oleg113-client sshd[71447]: Received disconnect from 192.168.201.13 port 40548:11: disconnected by user May 25 04:47:41 oleg113-client sshd[71447]: Disconnected from user root 192.168.201.13 port 40548 May 25 04:47:41 oleg113-client sshd[71434]: pam_unix(sshd:session): session closed for user root May 25 04:47:42 oleg113-client systemd[1]: session-359.scope: Succeeded. May 25 04:47:42 oleg113-client systemd-logind[1020]: Session 359 logged out. Waiting for processes to exit. May 25 04:47:42 oleg113-client systemd-logind[1020]: Removed session 359. May 25 04:47:43 oleg113-client sshd[71572]: Accepted publickey for root from 192.168.201.13 port 40550 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:43 oleg113-client systemd-logind[1020]: New session 360 of user root. May 25 04:47:43 oleg113-client systemd[1]: Started Session 360 of user root. May 25 04:47:43 oleg113-client sshd[71572]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:44 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients May 25 04:47:44 oleg113-client sshd[71585]: Received disconnect from 192.168.201.13 port 40550:11: disconnected by user May 25 04:47:44 oleg113-client sshd[71585]: Disconnected from user root 192.168.201.13 port 40550 May 25 04:47:44 oleg113-client sshd[71572]: pam_unix(sshd:session): session closed for user root May 25 04:47:44 oleg113-client systemd-logind[1020]: Session 360 logged out. Waiting for processes to exit. May 25 04:47:44 oleg113-client systemd[1]: session-360.scope: Succeeded. May 25 04:47:44 oleg113-client systemd-logind[1020]: Removed session 360. May 25 04:47:46 oleg113-client sshd[71727]: Accepted publickey for root from 192.168.201.13 port 40554 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:47:46 oleg113-client systemd[1]: Started Session 361 of user root. May 25 04:47:46 oleg113-client systemd-logind[1020]: New session 361 of user root. May 25 04:47:46 oleg113-client sshd[71727]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:47:46 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 04:47:44 (1779698864) May 25 04:47:47 oleg113-client sshd[71740]: Received disconnect from 192.168.201.13 port 40554:11: disconnected by user May 25 04:47:47 oleg113-client sshd[71740]: Disconnected from user root 192.168.201.13 port 40554 May 25 04:47:47 oleg113-client sshd[71727]: pam_unix(sshd:session): session closed for user root May 25 04:47:47 oleg113-client systemd[1]: session-361.scope: Succeeded. May 25 04:47:47 oleg113-client systemd-logind[1020]: Session 361 logged out. Waiting for processes to exit. May 25 04:47:47 oleg113-client systemd-logind[1020]: Removed session 361. May 25 04:47:48 oleg113-client kernel: Lustre: *** cfs_fail_loc=805, val=0*** May 25 04:47:49 oleg113-client systemd-udevd[71808]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:47:49 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:48:02 oleg113-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 04:48:26 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:48:36 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b4158b9e to 0x58062bb2b4158fe9 May 25 04:48:45 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 04:48:45 oleg113-client kernel: LustreError: 72255:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15d1cf4800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:48:45 oleg113-client kernel: LustreError: 72255:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:48:45 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:48:50 oleg113-client sshd[72406]: Accepted publickey for root from 192.168.201.13 port 49814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:48:50 oleg113-client systemd-logind[1020]: New session 362 of user root. May 25 04:48:50 oleg113-client systemd[1]: Started Session 362 of user root. May 25 04:48:50 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:48:50 oleg113-client sshd[72406]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:48:51 oleg113-client sshd[72421]: Received disconnect from 192.168.201.13 port 49814:11: disconnected by user May 25 04:48:51 oleg113-client sshd[72421]: Disconnected from user root 192.168.201.13 port 49814 May 25 04:48:51 oleg113-client sshd[72406]: pam_unix(sshd:session): session closed for user root May 25 04:48:51 oleg113-client systemd-logind[1020]: Session 362 logged out. Waiting for processes to exit. May 25 04:48:51 oleg113-client systemd[1]: session-362.scope: Succeeded. May 25 04:48:51 oleg113-client systemd-logind[1020]: Removed session 362. May 25 04:48:52 oleg113-client sshd[72547]: Accepted publickey for root from 192.168.201.13 port 49828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:48:52 oleg113-client systemd-logind[1020]: New session 363 of user root. May 25 04:48:52 oleg113-client systemd[1]: Started Session 363 of user root. May 25 04:48:52 oleg113-client sshd[72547]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:48:53 oleg113-client sshd[72560]: Received disconnect from 192.168.201.13 port 49828:11: disconnected by user May 25 04:48:53 oleg113-client sshd[72560]: Disconnected from user root 192.168.201.13 port 49828 May 25 04:48:53 oleg113-client sshd[72547]: pam_unix(sshd:session): session closed for user root May 25 04:48:53 oleg113-client systemd-logind[1020]: Session 363 logged out. Waiting for processes to exit. May 25 04:48:53 oleg113-client systemd[1]: session-363.scope: Succeeded. May 25 04:48:53 oleg113-client systemd-logind[1020]: Removed session 363. May 25 04:48:54 oleg113-client sshd[72693]: Accepted publickey for root from 192.168.201.13 port 49832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:48:54 oleg113-client systemd-logind[1020]: New session 364 of user root. May 25 04:48:55 oleg113-client systemd[1]: Started Session 364 of user root. May 25 04:48:55 oleg113-client sshd[72693]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:48:55 oleg113-client sshd[72706]: Received disconnect from 192.168.201.13 port 49832:11: disconnected by user May 25 04:48:55 oleg113-client sshd[72706]: Disconnected from user root 192.168.201.13 port 49832 May 25 04:48:55 oleg113-client sshd[72693]: pam_unix(sshd:session): session closed for user root May 25 04:48:55 oleg113-client systemd[1]: session-364.scope: Succeeded. May 25 04:48:55 oleg113-client systemd-logind[1020]: Session 364 logged out. Waiting for processes to exit. May 25 04:48:55 oleg113-client systemd-logind[1020]: Removed session 364. May 25 04:48:58 oleg113-client sshd[72849]: Accepted publickey for root from 192.168.201.13 port 49846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:48:58 oleg113-client systemd-logind[1020]: New session 365 of user root. May 25 04:48:58 oleg113-client systemd[1]: Started Session 365 of user root. May 25 04:48:58 oleg113-client sshd[72849]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:48:59 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 107: drop reint reply, then restart MDT ========================================================== 04:48:56 (1779698936) May 25 04:48:59 oleg113-client sshd[72862]: Received disconnect from 192.168.201.13 port 49846:11: disconnected by user May 25 04:48:59 oleg113-client sshd[72862]: Disconnected from user root 192.168.201.13 port 49846 May 25 04:48:59 oleg113-client sshd[72849]: pam_unix(sshd:session): session closed for user root May 25 04:48:59 oleg113-client systemd-logind[1020]: Session 365 logged out. Waiting for processes to exit. May 25 04:48:59 oleg113-client systemd[1]: session-365.scope: Succeeded. May 25 04:48:59 oleg113-client systemd-logind[1020]: Removed session 365. May 25 04:49:07 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c64bf800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 04:49:07 oleg113-client kernel: Lustre: Skipped 11 previous similar messages May 25 04:49:16 oleg113-client kernel: Lustre: 72907:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779698940/real 1779698940] req@ffff9b15c7869c00 x1866143510614016/t0(0) o36->lustre-MDT0000-mdc-ffff9b15c64bf800@192.168.201.113@tcp:12/10 lens 552/576 e 0 to 1 dl 1779698956 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:4294967295 May 25 04:49:16 oleg113-client kernel: Lustre: 72907:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 3 previous similar messages May 25 04:49:32 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 04:49:32 oleg113-client kernel: Lustre: Skipped 11 previous similar messages May 25 04:49:34 oleg113-client kernel: Lustre: 69654:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 04:49:36 oleg113-client kernel: LustreError: 2418:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff9b15c7878000 x1866143510613760/t94489280516(94489280516) o101->lustre-MDT0000-mdc-ffff9b15c64bf800@192.168.201.113@tcp:12/10 lens 520/664 e 0 to 0 dl 1779698991 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0 May 25 04:49:45 oleg113-client sshd[73187]: Accepted publickey for root from 192.168.201.13 port 49370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:49:45 oleg113-client systemd-logind[1020]: New session 366 of user root. May 25 04:49:45 oleg113-client systemd[1]: Started Session 366 of user root. May 25 04:49:45 oleg113-client sshd[73187]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:49:46 oleg113-client sshd[73200]: Received disconnect from 192.168.201.13 port 49370:11: disconnected by user May 25 04:49:46 oleg113-client sshd[73200]: Disconnected from user root 192.168.201.13 port 49370 May 25 04:49:46 oleg113-client sshd[73187]: pam_unix(sshd:session): session closed for user root May 25 04:49:46 oleg113-client systemd[1]: session-366.scope: Succeeded. May 25 04:49:46 oleg113-client systemd-logind[1020]: Session 366 logged out. Waiting for processes to exit. May 25 04:49:46 oleg113-client systemd-logind[1020]: Removed session 366. May 25 04:49:51 oleg113-client sshd[73423]: Accepted publickey for root from 192.168.201.13 port 38704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:49:51 oleg113-client systemd-logind[1020]: New session 367 of user root. May 25 04:49:51 oleg113-client systemd[1]: Started Session 367 of user root. May 25 04:49:51 oleg113-client sshd[73423]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:49:51 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 04:49:51 oleg113-client sshd[73436]: Received disconnect from 192.168.201.13 port 38704:11: disconnected by user May 25 04:49:51 oleg113-client sshd[73436]: Disconnected from user root 192.168.201.13 port 38704 May 25 04:49:51 oleg113-client sshd[73423]: pam_unix(sshd:session): session closed for user root May 25 04:49:52 oleg113-client systemd[1]: session-367.scope: Succeeded. May 25 04:49:52 oleg113-client systemd-logind[1020]: Session 367 logged out. Waiting for processes to exit. May 25 04:49:52 oleg113-client systemd-logind[1020]: Removed session 367. May 25 04:49:53 oleg113-client sshd[73580]: Accepted publickey for root from 192.168.201.13 port 38718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:49:53 oleg113-client systemd[1]: Started Session 368 of user root. May 25 04:49:53 oleg113-client systemd-logind[1020]: New session 368 of user root. May 25 04:49:53 oleg113-client sshd[73580]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:49:54 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 04:49:54 oleg113-client sshd[73593]: Received disconnect from 192.168.201.13 port 38718:11: disconnected by user May 25 04:49:54 oleg113-client sshd[73593]: Disconnected from user root 192.168.201.13 port 38718 May 25 04:49:54 oleg113-client sshd[73580]: pam_unix(sshd:session): session closed for user root May 25 04:49:54 oleg113-client systemd-logind[1020]: Session 368 logged out. Waiting for processes to exit. May 25 04:49:54 oleg113-client systemd[1]: session-368.scope: Succeeded. May 25 04:49:54 oleg113-client systemd-logind[1020]: Removed session 368. May 25 04:49:56 oleg113-client sshd[73634]: Accepted publickey for root from 192.168.201.13 port 38732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:49:56 oleg113-client systemd-logind[1020]: New session 369 of user root. May 25 04:49:56 oleg113-client systemd[1]: Started Session 369 of user root. May 25 04:49:56 oleg113-client sshd[73634]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:49:56 oleg113-client sshd[73647]: Received disconnect from 192.168.201.13 port 38732:11: disconnected by user May 25 04:49:56 oleg113-client sshd[73647]: Disconnected from user root 192.168.201.13 port 38732 May 25 04:49:56 oleg113-client sshd[73634]: pam_unix(sshd:session): session closed for user root May 25 04:49:57 oleg113-client systemd-logind[1020]: Session 369 logged out. Waiting for processes to exit. May 25 04:49:57 oleg113-client systemd[1]: session-369.scope: Succeeded. May 25 04:49:57 oleg113-client systemd-logind[1020]: Removed session 369. May 25 04:49:58 oleg113-client sshd[73767]: Accepted publickey for root from 192.168.201.13 port 38742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:49:58 oleg113-client systemd-logind[1020]: New session 370 of user root. May 25 04:49:58 oleg113-client systemd[1]: Started Session 370 of user root. May 25 04:49:58 oleg113-client sshd[73767]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:49:59 oleg113-client sshd[73781]: Received disconnect from 192.168.201.13 port 38742:11: disconnected by user May 25 04:49:59 oleg113-client sshd[73781]: Disconnected from user root 192.168.201.13 port 38742 May 25 04:49:59 oleg113-client sshd[73767]: pam_unix(sshd:session): session closed for user root May 25 04:49:59 oleg113-client systemd[1]: session-370.scope: Succeeded. May 25 04:49:59 oleg113-client systemd-logind[1020]: Session 370 logged out. Waiting for processes to exit. May 25 04:49:59 oleg113-client systemd-logind[1020]: Removed session 370. May 25 04:50:00 oleg113-client sshd[73907]: Accepted publickey for root from 192.168.201.13 port 33238 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:00 oleg113-client systemd[1]: Started Session 371 of user root. May 25 04:50:00 oleg113-client systemd-logind[1020]: New session 371 of user root. May 25 04:50:00 oleg113-client sshd[73907]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:01 oleg113-client sshd[73920]: Received disconnect from 192.168.201.13 port 33238:11: disconnected by user May 25 04:50:01 oleg113-client sshd[73920]: Disconnected from user root 192.168.201.13 port 33238 May 25 04:50:01 oleg113-client sshd[73907]: pam_unix(sshd:session): session closed for user root May 25 04:50:01 oleg113-client systemd[1]: session-371.scope: Succeeded. May 25 04:50:01 oleg113-client systemd-logind[1020]: Session 371 logged out. Waiting for processes to exit. May 25 04:50:01 oleg113-client systemd-logind[1020]: Removed session 371. May 25 04:50:03 oleg113-client sshd[74053]: Accepted publickey for root from 192.168.201.13 port 33240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:03 oleg113-client systemd-logind[1020]: New session 372 of user root. May 25 04:50:03 oleg113-client systemd[1]: Started Session 372 of user root. May 25 04:50:03 oleg113-client sshd[74053]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:03 oleg113-client sshd[74066]: Received disconnect from 192.168.201.13 port 33240:11: disconnected by user May 25 04:50:03 oleg113-client sshd[74066]: Disconnected from user root 192.168.201.13 port 33240 May 25 04:50:03 oleg113-client sshd[74053]: pam_unix(sshd:session): session closed for user root May 25 04:50:04 oleg113-client systemd[1]: session-372.scope: Succeeded. May 25 04:50:04 oleg113-client systemd-logind[1020]: Session 372 logged out. Waiting for processes to exit. May 25 04:50:04 oleg113-client systemd-logind[1020]: Removed session 372. May 25 04:50:05 oleg113-client sshd[74208]: Accepted publickey for root from 192.168.201.13 port 33250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:05 oleg113-client systemd-logind[1020]: New session 373 of user root. May 25 04:50:05 oleg113-client systemd[1]: Started Session 373 of user root. May 25 04:50:05 oleg113-client sshd[74208]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:06 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 108: client eviction don't crash == 04:50:04 (1779699004) May 25 04:50:06 oleg113-client sshd[74222]: Received disconnect from 192.168.201.13 port 33250:11: disconnected by user May 25 04:50:06 oleg113-client sshd[74222]: Disconnected from user root 192.168.201.13 port 33250 May 25 04:50:06 oleg113-client sshd[74208]: pam_unix(sshd:session): session closed for user root May 25 04:50:06 oleg113-client systemd-logind[1020]: Session 373 logged out. Waiting for processes to exit. May 25 04:50:06 oleg113-client systemd[1]: session-373.scope: Succeeded. May 25 04:50:06 oleg113-client systemd-logind[1020]: Removed session 373. May 25 04:50:11 oleg113-client kernel: LustreError: 2418:0:(osc_request.c:1024:osc_init_grant()) lustre-OST0000-osc-ffff9b15c64bf800: granted 8437760 but already consumed 12632064 May 25 04:50:11 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c64bf800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 04:50:11 oleg113-client kernel: Lustre: 2420:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.113@tcp:/lustre/fid: [0x20000a042:0x6:0x0]// may get corrupted (rc -5) May 25 04:50:11 oleg113-client kernel: LustreError: 74273:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffff9b15c64bf800: namespace resource [0x280000401:0x2a02:0x0].0x0 (ffff9b15c45dd900) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 04:50:13 oleg113-client sshd[74280]: Accepted publickey for root from 192.168.201.13 port 38896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:13 oleg113-client systemd-logind[1020]: New session 374 of user root. May 25 04:50:13 oleg113-client systemd[1]: Started Session 374 of user root. May 25 04:50:13 oleg113-client sshd[74280]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:14 oleg113-client sshd[74293]: Received disconnect from 192.168.201.13 port 38896:11: disconnected by user May 25 04:50:14 oleg113-client sshd[74293]: Disconnected from user root 192.168.201.13 port 38896 May 25 04:50:14 oleg113-client sshd[74280]: pam_unix(sshd:session): session closed for user root May 25 04:50:14 oleg113-client systemd[1]: session-374.scope: Succeeded. May 25 04:50:14 oleg113-client systemd-logind[1020]: Session 374 logged out. Waiting for processes to exit. May 25 04:50:14 oleg113-client systemd-logind[1020]: Removed session 374. May 25 04:50:15 oleg113-client sshd[74413]: Accepted publickey for root from 192.168.201.13 port 38910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:15 oleg113-client systemd-logind[1020]: New session 375 of user root. May 25 04:50:15 oleg113-client systemd[1]: Started Session 375 of user root. May 25 04:50:15 oleg113-client sshd[74413]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:16 oleg113-client sshd[74426]: Received disconnect from 192.168.201.13 port 38910:11: disconnected by user May 25 04:50:16 oleg113-client sshd[74426]: Disconnected from user root 192.168.201.13 port 38910 May 25 04:50:16 oleg113-client sshd[74413]: pam_unix(sshd:session): session closed for user root May 25 04:50:16 oleg113-client systemd[1]: session-375.scope: Succeeded. May 25 04:50:16 oleg113-client systemd-logind[1020]: Session 375 logged out. Waiting for processes to exit. May 25 04:50:16 oleg113-client systemd-logind[1020]: Removed session 375. May 25 04:50:18 oleg113-client sshd[74552]: Accepted publickey for root from 192.168.201.13 port 38912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:18 oleg113-client systemd-logind[1020]: New session 376 of user root. May 25 04:50:18 oleg113-client systemd[1]: Started Session 376 of user root. May 25 04:50:18 oleg113-client sshd[74552]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:18 oleg113-client sshd[74565]: Received disconnect from 192.168.201.13 port 38912:11: disconnected by user May 25 04:50:18 oleg113-client sshd[74565]: Disconnected from user root 192.168.201.13 port 38912 May 25 04:50:18 oleg113-client sshd[74552]: pam_unix(sshd:session): session closed for user root May 25 04:50:19 oleg113-client systemd[1]: session-376.scope: Succeeded. May 25 04:50:19 oleg113-client systemd-logind[1020]: Session 376 logged out. Waiting for processes to exit. May 25 04:50:19 oleg113-client systemd-logind[1020]: Removed session 376. May 25 04:50:20 oleg113-client sshd[74699]: Accepted publickey for root from 192.168.201.13 port 41902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:20 oleg113-client systemd[1]: Started Session 377 of user root. May 25 04:50:20 oleg113-client systemd-logind[1020]: New session 377 of user root. May 25 04:50:20 oleg113-client sshd[74699]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:21 oleg113-client sshd[74712]: Received disconnect from 192.168.201.13 port 41902:11: disconnected by user May 25 04:50:21 oleg113-client sshd[74712]: Disconnected from user root 192.168.201.13 port 41902 May 25 04:50:21 oleg113-client sshd[74699]: pam_unix(sshd:session): session closed for user root May 25 04:50:21 oleg113-client systemd[1]: session-377.scope: Succeeded. May 25 04:50:21 oleg113-client systemd-logind[1020]: Session 377 logged out. Waiting for processes to exit. May 25 04:50:21 oleg113-client systemd-logind[1020]: Removed session 377. May 25 04:50:23 oleg113-client sshd[74854]: Accepted publickey for root from 192.168.201.13 port 41904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:23 oleg113-client systemd-logind[1020]: New session 378 of user root. May 25 04:50:23 oleg113-client systemd[1]: Started Session 378 of user root. May 25 04:50:23 oleg113-client sshd[74854]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:24 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110a: create remote directory: drop client req ========================================================== 04:50:22 (1779699022) May 25 04:50:24 oleg113-client sshd[74867]: Received disconnect from 192.168.201.13 port 41904:11: disconnected by user May 25 04:50:24 oleg113-client sshd[74867]: Disconnected from user root 192.168.201.13 port 41904 May 25 04:50:24 oleg113-client sshd[74854]: pam_unix(sshd:session): session closed for user root May 25 04:50:24 oleg113-client systemd[1]: session-378.scope: Succeeded. May 25 04:50:24 oleg113-client systemd-logind[1020]: Session 378 logged out. Waiting for processes to exit. May 25 04:50:24 oleg113-client systemd-logind[1020]: Removed session 378. May 25 04:50:48 oleg113-client sshd[75037]: Accepted publickey for root from 192.168.201.13 port 48834 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:48 oleg113-client systemd-logind[1020]: New session 379 of user root. May 25 04:50:48 oleg113-client systemd[1]: Started Session 379 of user root. May 25 04:50:48 oleg113-client sshd[75037]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:48 oleg113-client sshd[75050]: Received disconnect from 192.168.201.13 port 48834:11: disconnected by user May 25 04:50:48 oleg113-client sshd[75050]: Disconnected from user root 192.168.201.13 port 48834 May 25 04:50:48 oleg113-client sshd[75037]: pam_unix(sshd:session): session closed for user root May 25 04:50:49 oleg113-client systemd[1]: session-379.scope: Succeeded. May 25 04:50:49 oleg113-client systemd-logind[1020]: Session 379 logged out. Waiting for processes to exit. May 25 04:50:49 oleg113-client systemd-logind[1020]: Removed session 379. May 25 04:50:50 oleg113-client sshd[75176]: Accepted publickey for root from 192.168.201.13 port 52786 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:50 oleg113-client systemd[1]: Started Session 380 of user root. May 25 04:50:50 oleg113-client systemd-logind[1020]: New session 380 of user root. May 25 04:50:50 oleg113-client sshd[75176]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:51 oleg113-client sshd[75189]: Received disconnect from 192.168.201.13 port 52786:11: disconnected by user May 25 04:50:51 oleg113-client sshd[75189]: Disconnected from user root 192.168.201.13 port 52786 May 25 04:50:51 oleg113-client sshd[75176]: pam_unix(sshd:session): session closed for user root May 25 04:50:51 oleg113-client systemd[1]: session-380.scope: Succeeded. May 25 04:50:51 oleg113-client systemd-logind[1020]: Session 380 logged out. Waiting for processes to exit. May 25 04:50:51 oleg113-client systemd-logind[1020]: Removed session 380. May 25 04:50:52 oleg113-client sshd[75322]: Accepted publickey for root from 192.168.201.13 port 52798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:52 oleg113-client systemd-logind[1020]: New session 381 of user root. May 25 04:50:52 oleg113-client systemd[1]: Started Session 381 of user root. May 25 04:50:52 oleg113-client sshd[75322]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:53 oleg113-client sshd[75336]: Received disconnect from 192.168.201.13 port 52798:11: disconnected by user May 25 04:50:53 oleg113-client sshd[75336]: Disconnected from user root 192.168.201.13 port 52798 May 25 04:50:53 oleg113-client sshd[75322]: pam_unix(sshd:session): session closed for user root May 25 04:50:53 oleg113-client systemd-logind[1020]: Session 381 logged out. Waiting for processes to exit. May 25 04:50:53 oleg113-client systemd[1]: session-381.scope: Succeeded. May 25 04:50:53 oleg113-client systemd-logind[1020]: Removed session 381. May 25 04:50:54 oleg113-client sshd[75478]: Accepted publickey for root from 192.168.201.13 port 52812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:50:54 oleg113-client systemd[1]: Started Session 382 of user root. May 25 04:50:54 oleg113-client systemd-logind[1020]: New session 382 of user root. May 25 04:50:54 oleg113-client sshd[75478]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:50:55 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110b: create remote directory: drop Master rep ========================================================== 04:50:53 (1779699053) May 25 04:50:55 oleg113-client sshd[75491]: Received disconnect from 192.168.201.13 port 52812:11: disconnected by user May 25 04:50:55 oleg113-client sshd[75491]: Disconnected from user root 192.168.201.13 port 52812 May 25 04:50:55 oleg113-client sshd[75478]: pam_unix(sshd:session): session closed for user root May 25 04:50:55 oleg113-client systemd[1]: session-382.scope: Succeeded. May 25 04:50:55 oleg113-client systemd-logind[1020]: Session 382 logged out. Waiting for processes to exit. May 25 04:50:55 oleg113-client systemd-logind[1020]: Removed session 382. May 25 04:51:16 oleg113-client sshd[75638]: Accepted publickey for root from 192.168.201.13 port 39732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:16 oleg113-client systemd-logind[1020]: New session 383 of user root. May 25 04:51:16 oleg113-client systemd[1]: Started Session 383 of user root. May 25 04:51:16 oleg113-client sshd[75638]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:17 oleg113-client sshd[75651]: Received disconnect from 192.168.201.13 port 39732:11: disconnected by user May 25 04:51:17 oleg113-client sshd[75651]: Disconnected from user root 192.168.201.13 port 39732 May 25 04:51:17 oleg113-client sshd[75638]: pam_unix(sshd:session): session closed for user root May 25 04:51:17 oleg113-client systemd[1]: session-383.scope: Succeeded. May 25 04:51:17 oleg113-client systemd-logind[1020]: Session 383 logged out. Waiting for processes to exit. May 25 04:51:17 oleg113-client systemd-logind[1020]: Removed session 383. May 25 04:51:18 oleg113-client sshd[75777]: Accepted publickey for root from 192.168.201.13 port 39738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:18 oleg113-client systemd-logind[1020]: New session 384 of user root. May 25 04:51:18 oleg113-client systemd[1]: Started Session 384 of user root. May 25 04:51:18 oleg113-client sshd[75777]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:19 oleg113-client sshd[75790]: Received disconnect from 192.168.201.13 port 39738:11: disconnected by user May 25 04:51:19 oleg113-client sshd[75790]: Disconnected from user root 192.168.201.13 port 39738 May 25 04:51:19 oleg113-client sshd[75777]: pam_unix(sshd:session): session closed for user root May 25 04:51:19 oleg113-client systemd-logind[1020]: Session 384 logged out. Waiting for processes to exit. May 25 04:51:19 oleg113-client systemd[1]: session-384.scope: Succeeded. May 25 04:51:19 oleg113-client systemd-logind[1020]: Removed session 384. May 25 04:51:20 oleg113-client sshd[75923]: Accepted publickey for root from 192.168.201.13 port 57210 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:21 oleg113-client systemd-logind[1020]: New session 385 of user root. May 25 04:51:21 oleg113-client systemd[1]: Started Session 385 of user root. May 25 04:51:21 oleg113-client sshd[75923]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:21 oleg113-client sshd[75936]: Received disconnect from 192.168.201.13 port 57210:11: disconnected by user May 25 04:51:21 oleg113-client sshd[75936]: Disconnected from user root 192.168.201.13 port 57210 May 25 04:51:21 oleg113-client sshd[75923]: pam_unix(sshd:session): session closed for user root May 25 04:51:21 oleg113-client systemd[1]: session-385.scope: Succeeded. May 25 04:51:21 oleg113-client systemd-logind[1020]: Session 385 logged out. Waiting for processes to exit. May 25 04:51:21 oleg113-client systemd-logind[1020]: Removed session 385. May 25 04:51:23 oleg113-client sshd[76079]: Accepted publickey for root from 192.168.201.13 port 57216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:23 oleg113-client systemd-logind[1020]: New session 386 of user root. May 25 04:51:23 oleg113-client systemd[1]: Started Session 386 of user root. May 25 04:51:23 oleg113-client sshd[76079]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:24 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110c: create remote directory: drop update rep on slave MDT ========================================================== 04:51:22 (1779699082) May 25 04:51:24 oleg113-client sshd[76092]: Received disconnect from 192.168.201.13 port 57216:11: disconnected by user May 25 04:51:24 oleg113-client sshd[76092]: Disconnected from user root 192.168.201.13 port 57216 May 25 04:51:24 oleg113-client sshd[76079]: pam_unix(sshd:session): session closed for user root May 25 04:51:24 oleg113-client systemd[1]: session-386.scope: Succeeded. May 25 04:51:24 oleg113-client systemd-logind[1020]: Session 386 logged out. Waiting for processes to exit. May 25 04:51:24 oleg113-client systemd-logind[1020]: Removed session 386. May 25 04:51:45 oleg113-client sshd[76243]: Accepted publickey for root from 192.168.201.13 port 40474 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:45 oleg113-client systemd-logind[1020]: New session 387 of user root. May 25 04:51:45 oleg113-client systemd[1]: Started Session 387 of user root. May 25 04:51:45 oleg113-client sshd[76243]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:45 oleg113-client sshd[76256]: Received disconnect from 192.168.201.13 port 40474:11: disconnected by user May 25 04:51:45 oleg113-client sshd[76256]: Disconnected from user root 192.168.201.13 port 40474 May 25 04:51:45 oleg113-client sshd[76243]: pam_unix(sshd:session): session closed for user root May 25 04:51:46 oleg113-client systemd[1]: session-387.scope: Succeeded. May 25 04:51:46 oleg113-client systemd-logind[1020]: Session 387 logged out. Waiting for processes to exit. May 25 04:51:46 oleg113-client systemd-logind[1020]: Removed session 387. May 25 04:51:46 oleg113-client sshd[76382]: Accepted publickey for root from 192.168.201.13 port 40476 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:46 oleg113-client systemd[1]: Started Session 388 of user root. May 25 04:51:46 oleg113-client systemd-logind[1020]: New session 388 of user root. May 25 04:51:46 oleg113-client sshd[76382]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:47 oleg113-client sshd[76395]: Received disconnect from 192.168.201.13 port 40476:11: disconnected by user May 25 04:51:47 oleg113-client sshd[76395]: Disconnected from user root 192.168.201.13 port 40476 May 25 04:51:47 oleg113-client sshd[76382]: pam_unix(sshd:session): session closed for user root May 25 04:51:47 oleg113-client systemd-logind[1020]: Session 388 logged out. Waiting for processes to exit. May 25 04:51:47 oleg113-client systemd[1]: session-388.scope: Succeeded. May 25 04:51:47 oleg113-client systemd-logind[1020]: Removed session 388. May 25 04:51:48 oleg113-client sshd[76528]: Accepted publickey for root from 192.168.201.13 port 40486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:48 oleg113-client systemd-logind[1020]: New session 389 of user root. May 25 04:51:49 oleg113-client systemd[1]: Started Session 389 of user root. May 25 04:51:49 oleg113-client sshd[76528]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:49 oleg113-client sshd[76541]: Received disconnect from 192.168.201.13 port 40486:11: disconnected by user May 25 04:51:49 oleg113-client sshd[76541]: Disconnected from user root 192.168.201.13 port 40486 May 25 04:51:49 oleg113-client sshd[76528]: pam_unix(sshd:session): session closed for user root May 25 04:51:49 oleg113-client systemd-logind[1020]: Session 389 logged out. Waiting for processes to exit. May 25 04:51:49 oleg113-client systemd[1]: session-389.scope: Succeeded. May 25 04:51:49 oleg113-client systemd-logind[1020]: Removed session 389. May 25 04:51:51 oleg113-client sshd[76685]: Accepted publickey for root from 192.168.201.13 port 37062 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:51 oleg113-client systemd[1]: Started Session 390 of user root. May 25 04:51:51 oleg113-client systemd-logind[1020]: New session 390 of user root. May 25 04:51:51 oleg113-client sshd[76685]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:51 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110d: remove remote directory: drop client req ========================================================== 04:51:49 (1779699109) May 25 04:51:51 oleg113-client sshd[76698]: Received disconnect from 192.168.201.13 port 37062:11: disconnected by user May 25 04:51:51 oleg113-client sshd[76698]: Disconnected from user root 192.168.201.13 port 37062 May 25 04:51:51 oleg113-client sshd[76685]: pam_unix(sshd:session): session closed for user root May 25 04:51:51 oleg113-client systemd-logind[1020]: Session 390 logged out. Waiting for processes to exit. May 25 04:51:51 oleg113-client systemd[1]: session-390.scope: Succeeded. May 25 04:51:51 oleg113-client systemd-logind[1020]: Removed session 390. May 25 04:51:56 oleg113-client sshd[76844]: Accepted publickey for root from 192.168.201.13 port 37068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:56 oleg113-client systemd[1]: Started Session 391 of user root. May 25 04:51:56 oleg113-client systemd-logind[1020]: New session 391 of user root. May 25 04:51:56 oleg113-client sshd[76844]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:57 oleg113-client sshd[76858]: Received disconnect from 192.168.201.13 port 37068:11: disconnected by user May 25 04:51:57 oleg113-client sshd[76858]: Disconnected from user root 192.168.201.13 port 37068 May 25 04:51:57 oleg113-client sshd[76844]: pam_unix(sshd:session): session closed for user root May 25 04:51:57 oleg113-client systemd[1]: session-391.scope: Succeeded. May 25 04:51:57 oleg113-client systemd-logind[1020]: Session 391 logged out. Waiting for processes to exit. May 25 04:51:57 oleg113-client systemd-logind[1020]: Removed session 391. May 25 04:51:58 oleg113-client sshd[76985]: Accepted publickey for root from 192.168.201.13 port 37080 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:51:58 oleg113-client systemd-logind[1020]: New session 392 of user root. May 25 04:51:58 oleg113-client systemd[1]: Started Session 392 of user root. May 25 04:51:58 oleg113-client sshd[76985]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:51:59 oleg113-client sshd[76998]: Received disconnect from 192.168.201.13 port 37080:11: disconnected by user May 25 04:51:59 oleg113-client sshd[76998]: Disconnected from user root 192.168.201.13 port 37080 May 25 04:51:59 oleg113-client sshd[76985]: pam_unix(sshd:session): session closed for user root May 25 04:51:59 oleg113-client systemd[1]: session-392.scope: Succeeded. May 25 04:51:59 oleg113-client systemd-logind[1020]: Session 392 logged out. Waiting for processes to exit. May 25 04:51:59 oleg113-client systemd-logind[1020]: Removed session 392. May 25 04:52:00 oleg113-client sshd[77131]: Accepted publickey for root from 192.168.201.13 port 43112 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:00 oleg113-client systemd-logind[1020]: New session 393 of user root. May 25 04:52:00 oleg113-client systemd[1]: Started Session 393 of user root. May 25 04:52:00 oleg113-client sshd[77131]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:01 oleg113-client sshd[77144]: Received disconnect from 192.168.201.13 port 43112:11: disconnected by user May 25 04:52:01 oleg113-client sshd[77144]: Disconnected from user root 192.168.201.13 port 43112 May 25 04:52:01 oleg113-client sshd[77131]: pam_unix(sshd:session): session closed for user root May 25 04:52:01 oleg113-client systemd[1]: session-393.scope: Succeeded. May 25 04:52:01 oleg113-client systemd-logind[1020]: Session 393 logged out. Waiting for processes to exit. May 25 04:52:01 oleg113-client systemd-logind[1020]: Removed session 393. May 25 04:52:01 oleg113-client anacron[44145]: Job `cron.monthly' started May 25 04:52:02 oleg113-client anacron[44145]: Job `cron.monthly' terminated May 25 04:52:02 oleg113-client anacron[44145]: Normal exit (3 jobs run) May 25 04:52:03 oleg113-client sshd[77288]: Accepted publickey for root from 192.168.201.13 port 43124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:52:03 oleg113-client systemd-logind[1020]: New session 394 of user root. May 25 04:52:03 oleg113-client systemd[1]: Started Session 394 of user root. May 25 04:52:03 oleg113-client sshd[77288]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:52:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110e: remove remote directory: drop master rep ========================================================== 04:52:02 (1779699122) May 25 04:52:04 oleg113-client sshd[77301]: Received disconnect from 192.168.201.13 port 43124:11: disconnected by user May 25 04:52:04 oleg113-client sshd[77301]: Disconnected from user root 192.168.201.13 port 43124 May 25 04:52:04 oleg113-client sshd[77288]: pam_unix(sshd:session): session closed for user root May 25 04:52:04 oleg113-client systemd[1]: session-394.scope: Succeeded. May 25 04:52:04 oleg113-client systemd-logind[1020]: Session 394 logged out. Waiting for processes to exit. May 25 04:52:04 oleg113-client systemd-logind[1020]: Removed session 394. May 25 04:53:04 oleg113-client sshd[77452]: Accepted publickey for root from 192.168.201.13 port 60900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:04 oleg113-client systemd[1]: Started Session 395 of user root. May 25 04:53:04 oleg113-client systemd-logind[1020]: New session 395 of user root. May 25 04:53:04 oleg113-client sshd[77452]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:05 oleg113-client sshd[77465]: Received disconnect from 192.168.201.13 port 60900:11: disconnected by user May 25 04:53:05 oleg113-client sshd[77465]: Disconnected from user root 192.168.201.13 port 60900 May 25 04:53:05 oleg113-client sshd[77452]: pam_unix(sshd:session): session closed for user root May 25 04:53:05 oleg113-client systemd[1]: session-395.scope: Succeeded. May 25 04:53:05 oleg113-client systemd-logind[1020]: Session 395 logged out. Waiting for processes to exit. May 25 04:53:05 oleg113-client systemd-logind[1020]: Removed session 395. May 25 04:53:06 oleg113-client sshd[77592]: Accepted publickey for root from 192.168.201.13 port 60916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:07 oleg113-client systemd-logind[1020]: New session 396 of user root. May 25 04:53:07 oleg113-client systemd[1]: Started Session 396 of user root. May 25 04:53:07 oleg113-client sshd[77592]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:07 oleg113-client sshd[77605]: Received disconnect from 192.168.201.13 port 60916:11: disconnected by user May 25 04:53:07 oleg113-client sshd[77605]: Disconnected from user root 192.168.201.13 port 60916 May 25 04:53:07 oleg113-client sshd[77592]: pam_unix(sshd:session): session closed for user root May 25 04:53:08 oleg113-client systemd[1]: session-396.scope: Succeeded. May 25 04:53:08 oleg113-client systemd-logind[1020]: Session 396 logged out. Waiting for processes to exit. May 25 04:53:08 oleg113-client systemd-logind[1020]: Removed session 396. May 25 04:53:09 oleg113-client sshd[77738]: Accepted publickey for root from 192.168.201.13 port 48934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:09 oleg113-client systemd-logind[1020]: New session 397 of user root. May 25 04:53:09 oleg113-client systemd[1]: Started Session 397 of user root. May 25 04:53:09 oleg113-client sshd[77738]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:10 oleg113-client sshd[77751]: Received disconnect from 192.168.201.13 port 48934:11: disconnected by user May 25 04:53:10 oleg113-client sshd[77751]: Disconnected from user root 192.168.201.13 port 48934 May 25 04:53:10 oleg113-client sshd[77738]: pam_unix(sshd:session): session closed for user root May 25 04:53:10 oleg113-client systemd[1]: session-397.scope: Succeeded. May 25 04:53:10 oleg113-client systemd-logind[1020]: Session 397 logged out. Waiting for processes to exit. May 25 04:53:10 oleg113-client systemd-logind[1020]: Removed session 397. May 25 04:53:12 oleg113-client sshd[77893]: Accepted publickey for root from 192.168.201.13 port 48940 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:12 oleg113-client systemd-logind[1020]: New session 398 of user root. May 25 04:53:12 oleg113-client systemd[1]: Started Session 398 of user root. May 25 04:53:12 oleg113-client sshd[77893]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:12 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110f: remove remote directory: drop slave rep ========================================================== 04:53:10 (1779699190) May 25 04:53:12 oleg113-client sshd[77906]: Received disconnect from 192.168.201.13 port 48940:11: disconnected by user May 25 04:53:12 oleg113-client sshd[77906]: Disconnected from user root 192.168.201.13 port 48940 May 25 04:53:12 oleg113-client sshd[77893]: pam_unix(sshd:session): session closed for user root May 25 04:53:12 oleg113-client systemd[1]: session-398.scope: Succeeded. May 25 04:53:12 oleg113-client systemd-logind[1020]: Session 398 logged out. Waiting for processes to exit. May 25 04:53:12 oleg113-client systemd-logind[1020]: Removed session 398. May 25 04:53:34 oleg113-client sshd[78057]: Accepted publickey for root from 192.168.201.13 port 55094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:34 oleg113-client systemd-logind[1020]: New session 399 of user root. May 25 04:53:34 oleg113-client systemd[1]: Started Session 399 of user root. May 25 04:53:34 oleg113-client sshd[78057]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:34 oleg113-client sshd[78070]: Received disconnect from 192.168.201.13 port 55094:11: disconnected by user May 25 04:53:34 oleg113-client sshd[78070]: Disconnected from user root 192.168.201.13 port 55094 May 25 04:53:34 oleg113-client sshd[78057]: pam_unix(sshd:session): session closed for user root May 25 04:53:34 oleg113-client systemd-logind[1020]: Session 399 logged out. Waiting for processes to exit. May 25 04:53:34 oleg113-client systemd[1]: session-399.scope: Succeeded. May 25 04:53:34 oleg113-client systemd-logind[1020]: Removed session 399. May 25 04:53:36 oleg113-client sshd[78196]: Accepted publickey for root from 192.168.201.13 port 55098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:36 oleg113-client systemd-logind[1020]: New session 400 of user root. May 25 04:53:36 oleg113-client systemd[1]: Started Session 400 of user root. May 25 04:53:36 oleg113-client sshd[78196]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:36 oleg113-client sshd[78209]: Received disconnect from 192.168.201.13 port 55098:11: disconnected by user May 25 04:53:36 oleg113-client sshd[78209]: Disconnected from user root 192.168.201.13 port 55098 May 25 04:53:37 oleg113-client sshd[78196]: pam_unix(sshd:session): session closed for user root May 25 04:53:37 oleg113-client systemd-logind[1020]: Session 400 logged out. Waiting for processes to exit. May 25 04:53:37 oleg113-client systemd[1]: session-400.scope: Succeeded. May 25 04:53:37 oleg113-client systemd-logind[1020]: Removed session 400. May 25 04:53:38 oleg113-client sshd[78342]: Accepted publickey for root from 192.168.201.13 port 55110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:38 oleg113-client systemd[1]: Started Session 401 of user root. May 25 04:53:38 oleg113-client systemd-logind[1020]: New session 401 of user root. May 25 04:53:38 oleg113-client sshd[78342]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:39 oleg113-client sshd[78355]: Received disconnect from 192.168.201.13 port 55110:11: disconnected by user May 25 04:53:39 oleg113-client sshd[78355]: Disconnected from user root 192.168.201.13 port 55110 May 25 04:53:39 oleg113-client sshd[78342]: pam_unix(sshd:session): session closed for user root May 25 04:53:39 oleg113-client systemd[1]: session-401.scope: Succeeded. May 25 04:53:39 oleg113-client systemd-logind[1020]: Session 401 logged out. Waiting for processes to exit. May 25 04:53:39 oleg113-client systemd-logind[1020]: Removed session 401. May 25 04:53:41 oleg113-client sshd[78498]: Accepted publickey for root from 192.168.201.13 port 37240 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:53:41 oleg113-client systemd-logind[1020]: New session 402 of user root. May 25 04:53:41 oleg113-client systemd[1]: Started Session 402 of user root. May 25 04:53:41 oleg113-client sshd[78498]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:53:41 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110g: drop reply during migration ========================================================== 04:53:40 (1779699220) May 25 04:53:41 oleg113-client sshd[78511]: Received disconnect from 192.168.201.13 port 37240:11: disconnected by user May 25 04:53:42 oleg113-client sshd[78511]: Disconnected from user root 192.168.201.13 port 37240 May 25 04:53:42 oleg113-client sshd[78498]: pam_unix(sshd:session): session closed for user root May 25 04:53:42 oleg113-client systemd[1]: session-402.scope: Succeeded. May 25 04:53:42 oleg113-client systemd-logind[1020]: Session 402 logged out. Waiting for processes to exit. May 25 04:53:42 oleg113-client systemd-logind[1020]: Removed session 402. May 25 04:54:41 oleg113-client sshd[78667]: Accepted publickey for root from 192.168.201.13 port 54136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:41 oleg113-client systemd[1]: Started Session 403 of user root. May 25 04:54:41 oleg113-client systemd-logind[1020]: New session 403 of user root. May 25 04:54:41 oleg113-client sshd[78667]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:42 oleg113-client sshd[78680]: Received disconnect from 192.168.201.13 port 54136:11: disconnected by user May 25 04:54:42 oleg113-client sshd[78680]: Disconnected from user root 192.168.201.13 port 54136 May 25 04:54:42 oleg113-client sshd[78667]: pam_unix(sshd:session): session closed for user root May 25 04:54:42 oleg113-client systemd-logind[1020]: Session 403 logged out. Waiting for processes to exit. May 25 04:54:42 oleg113-client systemd[1]: session-403.scope: Succeeded. May 25 04:54:42 oleg113-client systemd-logind[1020]: Removed session 403. May 25 04:54:44 oleg113-client sshd[78806]: Accepted publickey for root from 192.168.201.13 port 54146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:44 oleg113-client systemd[1]: Started Session 404 of user root. May 25 04:54:44 oleg113-client systemd-logind[1020]: New session 404 of user root. May 25 04:54:44 oleg113-client sshd[78806]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:45 oleg113-client sshd[78820]: Received disconnect from 192.168.201.13 port 54146:11: disconnected by user May 25 04:54:45 oleg113-client sshd[78820]: Disconnected from user root 192.168.201.13 port 54146 May 25 04:54:45 oleg113-client sshd[78806]: pam_unix(sshd:session): session closed for user root May 25 04:54:45 oleg113-client systemd-logind[1020]: Session 404 logged out. Waiting for processes to exit. May 25 04:54:45 oleg113-client systemd[1]: session-404.scope: Succeeded. May 25 04:54:45 oleg113-client systemd-logind[1020]: Removed session 404. May 25 04:54:46 oleg113-client sshd[78953]: Accepted publickey for root from 192.168.201.13 port 54154 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:46 oleg113-client systemd-logind[1020]: New session 405 of user root. May 25 04:54:46 oleg113-client systemd[1]: Started Session 405 of user root. May 25 04:54:46 oleg113-client sshd[78953]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:46 oleg113-client sshd[78966]: Received disconnect from 192.168.201.13 port 54154:11: disconnected by user May 25 04:54:46 oleg113-client sshd[78966]: Disconnected from user root 192.168.201.13 port 54154 May 25 04:54:46 oleg113-client sshd[78953]: pam_unix(sshd:session): session closed for user root May 25 04:54:47 oleg113-client systemd[1]: session-405.scope: Succeeded. May 25 04:54:47 oleg113-client systemd-logind[1020]: Session 405 logged out. Waiting for processes to exit. May 25 04:54:47 oleg113-client systemd-logind[1020]: Removed session 405. May 25 04:54:48 oleg113-client sshd[79109]: Accepted publickey for root from 192.168.201.13 port 54158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:54:48 oleg113-client systemd[1]: Started Session 406 of user root. May 25 04:54:48 oleg113-client systemd-logind[1020]: New session 406 of user root. May 25 04:54:48 oleg113-client sshd[79109]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:54:49 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110h: drop update reply during cross-MDT file rename ========================================================== 04:54:47 (1779699287) May 25 04:54:49 oleg113-client sshd[79122]: Received disconnect from 192.168.201.13 port 54158:11: disconnected by user May 25 04:54:49 oleg113-client sshd[79122]: Disconnected from user root 192.168.201.13 port 54158 May 25 04:54:49 oleg113-client sshd[79109]: pam_unix(sshd:session): session closed for user root May 25 04:54:49 oleg113-client systemd-logind[1020]: Session 406 logged out. Waiting for processes to exit. May 25 04:54:49 oleg113-client systemd[1]: session-406.scope: Succeeded. May 25 04:54:49 oleg113-client systemd-logind[1020]: Removed session 406. May 25 04:55:10 oleg113-client sshd[79277]: Accepted publickey for root from 192.168.201.13 port 43480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:10 oleg113-client systemd[1]: Started Session 407 of user root. May 25 04:55:10 oleg113-client systemd-logind[1020]: New session 407 of user root. May 25 04:55:10 oleg113-client sshd[79277]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:11 oleg113-client sshd[79290]: Received disconnect from 192.168.201.13 port 43480:11: disconnected by user May 25 04:55:11 oleg113-client sshd[79290]: Disconnected from user root 192.168.201.13 port 43480 May 25 04:55:11 oleg113-client sshd[79277]: pam_unix(sshd:session): session closed for user root May 25 04:55:11 oleg113-client systemd[1]: session-407.scope: Succeeded. May 25 04:55:11 oleg113-client systemd-logind[1020]: Session 407 logged out. Waiting for processes to exit. May 25 04:55:11 oleg113-client systemd-logind[1020]: Removed session 407. May 25 04:55:12 oleg113-client sshd[79417]: Accepted publickey for root from 192.168.201.13 port 43482 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:12 oleg113-client systemd-logind[1020]: New session 408 of user root. May 25 04:55:12 oleg113-client systemd[1]: Started Session 408 of user root. May 25 04:55:12 oleg113-client sshd[79417]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:13 oleg113-client sshd[79430]: Received disconnect from 192.168.201.13 port 43482:11: disconnected by user May 25 04:55:13 oleg113-client sshd[79430]: Disconnected from user root 192.168.201.13 port 43482 May 25 04:55:13 oleg113-client sshd[79417]: pam_unix(sshd:session): session closed for user root May 25 04:55:13 oleg113-client systemd[1]: session-408.scope: Succeeded. May 25 04:55:13 oleg113-client systemd-logind[1020]: Session 408 logged out. Waiting for processes to exit. May 25 04:55:13 oleg113-client systemd-logind[1020]: Removed session 408. May 25 04:55:14 oleg113-client sshd[79564]: Accepted publickey for root from 192.168.201.13 port 43496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:15 oleg113-client systemd-logind[1020]: New session 409 of user root. May 25 04:55:15 oleg113-client systemd[1]: Started Session 409 of user root. May 25 04:55:15 oleg113-client sshd[79564]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:15 oleg113-client sshd[79577]: Received disconnect from 192.168.201.13 port 43496:11: disconnected by user May 25 04:55:15 oleg113-client sshd[79577]: Disconnected from user root 192.168.201.13 port 43496 May 25 04:55:15 oleg113-client sshd[79564]: pam_unix(sshd:session): session closed for user root May 25 04:55:15 oleg113-client systemd[1]: session-409.scope: Succeeded. May 25 04:55:15 oleg113-client systemd-logind[1020]: Session 409 logged out. Waiting for processes to exit. May 25 04:55:15 oleg113-client systemd-logind[1020]: Removed session 409. May 25 04:55:17 oleg113-client sshd[79719]: Accepted publickey for root from 192.168.201.13 port 43506 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:17 oleg113-client systemd-logind[1020]: New session 410 of user root. May 25 04:55:17 oleg113-client systemd[1]: Started Session 410 of user root. May 25 04:55:17 oleg113-client sshd[79719]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:18 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110i: drop update reply during cross-MDT dir rename ========================================================== 04:55:16 (1779699316) May 25 04:55:18 oleg113-client sshd[79732]: Received disconnect from 192.168.201.13 port 43506:11: disconnected by user May 25 04:55:18 oleg113-client sshd[79732]: Disconnected from user root 192.168.201.13 port 43506 May 25 04:55:18 oleg113-client sshd[79719]: pam_unix(sshd:session): session closed for user root May 25 04:55:18 oleg113-client systemd[1]: session-410.scope: Succeeded. May 25 04:55:18 oleg113-client systemd-logind[1020]: Session 410 logged out. Waiting for processes to exit. May 25 04:55:18 oleg113-client systemd-logind[1020]: Removed session 410. May 25 04:55:40 oleg113-client sshd[79890]: Accepted publickey for root from 192.168.201.13 port 52380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:40 oleg113-client systemd-logind[1020]: New session 411 of user root. May 25 04:55:40 oleg113-client systemd[1]: Started Session 411 of user root. May 25 04:55:40 oleg113-client sshd[79890]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:41 oleg113-client sshd[79903]: Received disconnect from 192.168.201.13 port 52380:11: disconnected by user May 25 04:55:41 oleg113-client sshd[79903]: Disconnected from user root 192.168.201.13 port 52380 May 25 04:55:41 oleg113-client sshd[79890]: pam_unix(sshd:session): session closed for user root May 25 04:55:41 oleg113-client systemd-logind[1020]: Session 411 logged out. Waiting for processes to exit. May 25 04:55:41 oleg113-client systemd[1]: session-411.scope: Succeeded. May 25 04:55:41 oleg113-client systemd-logind[1020]: Removed session 411. May 25 04:55:43 oleg113-client sshd[80029]: Accepted publickey for root from 192.168.201.13 port 52394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:43 oleg113-client systemd-logind[1020]: New session 412 of user root. May 25 04:55:43 oleg113-client systemd[1]: Started Session 412 of user root. May 25 04:55:43 oleg113-client sshd[80029]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:44 oleg113-client sshd[80042]: Received disconnect from 192.168.201.13 port 52394:11: disconnected by user May 25 04:55:44 oleg113-client sshd[80042]: Disconnected from user root 192.168.201.13 port 52394 May 25 04:55:44 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 04:55:44 oleg113-client sshd[80029]: pam_unix(sshd:session): session closed for user root May 25 04:55:44 oleg113-client systemd-logind[1020]: Session 412 logged out. Waiting for processes to exit. May 25 04:55:44 oleg113-client systemd[1]: session-412.scope: Succeeded. May 25 04:55:44 oleg113-client systemd-logind[1020]: Removed session 412. May 25 04:55:45 oleg113-client sshd[80176]: Accepted publickey for root from 192.168.201.13 port 52398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:45 oleg113-client systemd[1]: Started Session 413 of user root. May 25 04:55:45 oleg113-client systemd-logind[1020]: New session 413 of user root. May 25 04:55:45 oleg113-client sshd[80176]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:46 oleg113-client sshd[80189]: Received disconnect from 192.168.201.13 port 52398:11: disconnected by user May 25 04:55:46 oleg113-client sshd[80189]: Disconnected from user root 192.168.201.13 port 52398 May 25 04:55:46 oleg113-client sshd[80176]: pam_unix(sshd:session): session closed for user root May 25 04:55:46 oleg113-client systemd[1]: session-413.scope: Succeeded. May 25 04:55:46 oleg113-client systemd-logind[1020]: Session 413 logged out. Waiting for processes to exit. May 25 04:55:46 oleg113-client systemd-logind[1020]: Removed session 413. May 25 04:55:47 oleg113-client sshd[80332]: Accepted publickey for root from 192.168.201.13 port 52406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:55:48 oleg113-client systemd-logind[1020]: New session 414 of user root. May 25 04:55:48 oleg113-client systemd[1]: Started Session 414 of user root. May 25 04:55:48 oleg113-client sshd[80332]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:55:48 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110j: drop update reply during cross-MDT ln ========================================================== 04:55:46 (1779699346) May 25 04:55:48 oleg113-client sshd[80345]: Received disconnect from 192.168.201.13 port 52406:11: disconnected by user May 25 04:55:48 oleg113-client sshd[80345]: Disconnected from user root 192.168.201.13 port 52406 May 25 04:55:48 oleg113-client sshd[80332]: pam_unix(sshd:session): session closed for user root May 25 04:55:48 oleg113-client systemd-logind[1020]: Session 414 logged out. Waiting for processes to exit. May 25 04:55:48 oleg113-client systemd[1]: session-414.scope: Succeeded. May 25 04:55:48 oleg113-client systemd-logind[1020]: Removed session 414. May 25 04:56:10 oleg113-client sshd[80499]: Accepted publickey for root from 192.168.201.13 port 54166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:10 oleg113-client systemd[1]: Started Session 415 of user root. May 25 04:56:10 oleg113-client systemd-logind[1020]: New session 415 of user root. May 25 04:56:10 oleg113-client sshd[80499]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:11 oleg113-client sshd[80512]: Received disconnect from 192.168.201.13 port 54166:11: disconnected by user May 25 04:56:11 oleg113-client sshd[80512]: Disconnected from user root 192.168.201.13 port 54166 May 25 04:56:11 oleg113-client sshd[80499]: pam_unix(sshd:session): session closed for user root May 25 04:56:11 oleg113-client systemd[1]: session-415.scope: Succeeded. May 25 04:56:11 oleg113-client systemd-logind[1020]: Session 415 logged out. Waiting for processes to exit. May 25 04:56:11 oleg113-client systemd-logind[1020]: Removed session 415. May 25 04:56:13 oleg113-client sshd[80638]: Accepted publickey for root from 192.168.201.13 port 54176 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:13 oleg113-client systemd[1]: Started Session 416 of user root. May 25 04:56:13 oleg113-client systemd-logind[1020]: New session 416 of user root. May 25 04:56:13 oleg113-client sshd[80638]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:13 oleg113-client sshd[80651]: Received disconnect from 192.168.201.13 port 54176:11: disconnected by user May 25 04:56:13 oleg113-client sshd[80651]: Disconnected from user root 192.168.201.13 port 54176 May 25 04:56:13 oleg113-client sshd[80638]: pam_unix(sshd:session): session closed for user root May 25 04:56:13 oleg113-client systemd[1]: session-416.scope: Succeeded. May 25 04:56:13 oleg113-client systemd-logind[1020]: Session 416 logged out. Waiting for processes to exit. May 25 04:56:13 oleg113-client systemd-logind[1020]: Removed session 416. May 25 04:56:15 oleg113-client sshd[80785]: Accepted publickey for root from 192.168.201.13 port 54178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:15 oleg113-client systemd-logind[1020]: New session 417 of user root. May 25 04:56:15 oleg113-client systemd[1]: Started Session 417 of user root. May 25 04:56:15 oleg113-client sshd[80785]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:16 oleg113-client sshd[80798]: Received disconnect from 192.168.201.13 port 54178:11: disconnected by user May 25 04:56:16 oleg113-client sshd[80798]: Disconnected from user root 192.168.201.13 port 54178 May 25 04:56:16 oleg113-client sshd[80785]: pam_unix(sshd:session): session closed for user root May 25 04:56:16 oleg113-client systemd[1]: session-417.scope: Succeeded. May 25 04:56:16 oleg113-client systemd-logind[1020]: Session 417 logged out. Waiting for processes to exit. May 25 04:56:16 oleg113-client systemd-logind[1020]: Removed session 417. May 25 04:56:17 oleg113-client sshd[80940]: Accepted publickey for root from 192.168.201.13 port 54186 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:56:17 oleg113-client systemd[1]: Started Session 418 of user root. May 25 04:56:17 oleg113-client systemd-logind[1020]: New session 418 of user root. May 25 04:56:17 oleg113-client sshd[80940]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:56:18 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110k: FID_QUERY failed during recovery ========================================================== 04:56:16 (1779699376) May 25 04:56:18 oleg113-client sshd[80953]: Received disconnect from 192.168.201.13 port 54186:11: disconnected by user May 25 04:56:18 oleg113-client sshd[80953]: Disconnected from user root 192.168.201.13 port 54186 May 25 04:56:18 oleg113-client sshd[80940]: pam_unix(sshd:session): session closed for user root May 25 04:56:18 oleg113-client systemd[1]: session-418.scope: Succeeded. May 25 04:56:18 oleg113-client systemd-logind[1020]: Session 418 logged out. Waiting for processes to exit. May 25 04:56:18 oleg113-client systemd-logind[1020]: Removed session 418. May 25 04:56:18 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 04:56:18 oleg113-client kernel: LustreError: 80991:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c64bf800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 04:56:18 oleg113-client kernel: LustreError: 80991:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 04:56:18 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 04:57:22 oleg113-client systemd-udevd[81498]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 04:57:22 oleg113-client kernel: Lustre: Mounted lustre-client May 25 04:57:24 oleg113-client sshd[81520]: Accepted publickey for root from 192.168.201.13 port 49984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:24 oleg113-client systemd-logind[1020]: New session 419 of user root. May 25 04:57:24 oleg113-client systemd[1]: Started Session 419 of user root. May 25 04:57:24 oleg113-client sshd[81520]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:24 oleg113-client sshd[81533]: Received disconnect from 192.168.201.13 port 49984:11: disconnected by user May 25 04:57:24 oleg113-client sshd[81533]: Disconnected from user root 192.168.201.13 port 49984 May 25 04:57:25 oleg113-client sshd[81520]: pam_unix(sshd:session): session closed for user root May 25 04:57:25 oleg113-client systemd[1]: session-419.scope: Succeeded. May 25 04:57:25 oleg113-client systemd-logind[1020]: Session 419 logged out. Waiting for processes to exit. May 25 04:57:25 oleg113-client systemd-logind[1020]: Removed session 419. May 25 04:57:36 oleg113-client sshd[81764]: Accepted publickey for root from 192.168.201.13 port 38974 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:36 oleg113-client systemd-logind[1020]: New session 420 of user root. May 25 04:57:36 oleg113-client systemd[1]: Started Session 420 of user root. May 25 04:57:36 oleg113-client sshd[81764]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:37 oleg113-client sshd[81777]: Received disconnect from 192.168.201.13 port 38974:11: disconnected by user May 25 04:57:37 oleg113-client sshd[81777]: Disconnected from user root 192.168.201.13 port 38974 May 25 04:57:37 oleg113-client sshd[81764]: pam_unix(sshd:session): session closed for user root May 25 04:57:37 oleg113-client systemd[1]: session-420.scope: Succeeded. May 25 04:57:37 oleg113-client systemd-logind[1020]: Session 420 logged out. Waiting for processes to exit. May 25 04:57:37 oleg113-client systemd-logind[1020]: Removed session 420. May 25 04:57:38 oleg113-client sshd[81903]: Accepted publickey for root from 192.168.201.13 port 38990 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:38 oleg113-client systemd[1]: Started Session 421 of user root. May 25 04:57:38 oleg113-client systemd-logind[1020]: New session 421 of user root. May 25 04:57:38 oleg113-client sshd[81903]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:39 oleg113-client sshd[81916]: Received disconnect from 192.168.201.13 port 38990:11: disconnected by user May 25 04:57:39 oleg113-client sshd[81916]: Disconnected from user root 192.168.201.13 port 38990 May 25 04:57:39 oleg113-client sshd[81903]: pam_unix(sshd:session): session closed for user root May 25 04:57:39 oleg113-client systemd[1]: session-421.scope: Succeeded. May 25 04:57:39 oleg113-client systemd-logind[1020]: Session 421 logged out. Waiting for processes to exit. May 25 04:57:39 oleg113-client systemd-logind[1020]: Removed session 421. May 25 04:57:40 oleg113-client sshd[82049]: Accepted publickey for root from 192.168.201.13 port 43304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:40 oleg113-client systemd-logind[1020]: New session 422 of user root. May 25 04:57:40 oleg113-client systemd[1]: Started Session 422 of user root. May 25 04:57:40 oleg113-client sshd[82049]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:41 oleg113-client sshd[82063]: Received disconnect from 192.168.201.13 port 43304:11: disconnected by user May 25 04:57:41 oleg113-client sshd[82063]: Disconnected from user root 192.168.201.13 port 43304 May 25 04:57:41 oleg113-client sshd[82049]: pam_unix(sshd:session): session closed for user root May 25 04:57:41 oleg113-client systemd[1]: session-422.scope: Succeeded. May 25 04:57:41 oleg113-client systemd-logind[1020]: Session 422 logged out. Waiting for processes to exit. May 25 04:57:41 oleg113-client systemd-logind[1020]: Removed session 422. May 25 04:57:43 oleg113-client sshd[82205]: Accepted publickey for root from 192.168.201.13 port 43316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:43 oleg113-client systemd[1]: Started Session 423 of user root. May 25 04:57:43 oleg113-client systemd-logind[1020]: New session 423 of user root. May 25 04:57:43 oleg113-client sshd[82205]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:43 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110m: update resent vs original RPC race ========================================================== 04:57:41 (1779699461) May 25 04:57:43 oleg113-client sshd[82218]: Received disconnect from 192.168.201.13 port 43316:11: disconnected by user May 25 04:57:43 oleg113-client sshd[82218]: Disconnected from user root 192.168.201.13 port 43316 May 25 04:57:43 oleg113-client sshd[82205]: pam_unix(sshd:session): session closed for user root May 25 04:57:43 oleg113-client systemd[1]: session-423.scope: Succeeded. May 25 04:57:43 oleg113-client systemd-logind[1020]: Session 423 logged out. Waiting for processes to exit. May 25 04:57:43 oleg113-client systemd-logind[1020]: Removed session 423. May 25 04:57:55 oleg113-client sshd[82408]: Accepted publickey for root from 192.168.201.13 port 37002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:55 oleg113-client systemd-logind[1020]: New session 424 of user root. May 25 04:57:55 oleg113-client systemd[1]: Started Session 424 of user root. May 25 04:57:55 oleg113-client sshd[82408]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:56 oleg113-client sshd[82421]: Received disconnect from 192.168.201.13 port 37002:11: disconnected by user May 25 04:57:56 oleg113-client sshd[82421]: Disconnected from user root 192.168.201.13 port 37002 May 25 04:57:56 oleg113-client sshd[82408]: pam_unix(sshd:session): session closed for user root May 25 04:57:56 oleg113-client systemd-logind[1020]: Session 424 logged out. Waiting for processes to exit. May 25 04:57:56 oleg113-client systemd[1]: session-424.scope: Succeeded. May 25 04:57:56 oleg113-client systemd-logind[1020]: Removed session 424. May 25 04:57:57 oleg113-client sshd[82548]: Accepted publickey for root from 192.168.201.13 port 37016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:57 oleg113-client systemd-logind[1020]: New session 425 of user root. May 25 04:57:57 oleg113-client systemd[1]: Started Session 425 of user root. May 25 04:57:57 oleg113-client sshd[82548]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:57:58 oleg113-client sshd[82561]: Received disconnect from 192.168.201.13 port 37016:11: disconnected by user May 25 04:57:58 oleg113-client sshd[82561]: Disconnected from user root 192.168.201.13 port 37016 May 25 04:57:58 oleg113-client sshd[82548]: pam_unix(sshd:session): session closed for user root May 25 04:57:58 oleg113-client systemd-logind[1020]: Session 425 logged out. Waiting for processes to exit. May 25 04:57:58 oleg113-client systemd[1]: session-425.scope: Succeeded. May 25 04:57:58 oleg113-client systemd-logind[1020]: Removed session 425. May 25 04:57:59 oleg113-client sshd[82695]: Accepted publickey for root from 192.168.201.13 port 41160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:57:59 oleg113-client systemd[1]: Started Session 426 of user root. May 25 04:57:59 oleg113-client systemd-logind[1020]: New session 426 of user root. May 25 04:57:59 oleg113-client sshd[82695]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:00 oleg113-client sshd[82708]: Received disconnect from 192.168.201.13 port 41160:11: disconnected by user May 25 04:58:00 oleg113-client sshd[82708]: Disconnected from user root 192.168.201.13 port 41160 May 25 04:58:00 oleg113-client sshd[82695]: pam_unix(sshd:session): session closed for user root May 25 04:58:00 oleg113-client systemd[1]: session-426.scope: Succeeded. May 25 04:58:00 oleg113-client systemd-logind[1020]: Session 426 logged out. Waiting for processes to exit. May 25 04:58:00 oleg113-client systemd-logind[1020]: Removed session 426. May 25 04:58:01 oleg113-client sshd[82850]: Accepted publickey for root from 192.168.201.13 port 41164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:01 oleg113-client systemd-logind[1020]: New session 427 of user root. May 25 04:58:01 oleg113-client systemd[1]: Started Session 427 of user root. May 25 04:58:01 oleg113-client sshd[82850]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:02 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 111: mdd setup fail should not cause umount oops ========================================================== 04:58:00 (1779699480) May 25 04:58:02 oleg113-client sshd[82863]: Received disconnect from 192.168.201.13 port 41164:11: disconnected by user May 25 04:58:02 oleg113-client sshd[82863]: Disconnected from user root 192.168.201.13 port 41164 May 25 04:58:02 oleg113-client sshd[82850]: pam_unix(sshd:session): session closed for user root May 25 04:58:02 oleg113-client systemd[1]: session-427.scope: Succeeded. May 25 04:58:02 oleg113-client systemd-logind[1020]: Session 427 logged out. Waiting for processes to exit. May 25 04:58:02 oleg113-client systemd-logind[1020]: Removed session 427. May 25 04:58:18 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 04:58:18 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 04:58:19 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b415b209 to 0x58062bb2b415b551 May 25 04:58:19 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 04:58:34 oleg113-client kernel: Lustre: 81486:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -5 May 25 04:58:40 oleg113-client sshd[83321]: Accepted publickey for root from 192.168.201.13 port 57700 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:41 oleg113-client systemd-logind[1020]: New session 428 of user root. May 25 04:58:41 oleg113-client systemd[1]: Started Session 428 of user root. May 25 04:58:41 oleg113-client sshd[83321]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:41 oleg113-client sshd[83335]: Received disconnect from 192.168.201.13 port 57700:11: disconnected by user May 25 04:58:41 oleg113-client sshd[83335]: Disconnected from user root 192.168.201.13 port 57700 May 25 04:58:41 oleg113-client sshd[83321]: pam_unix(sshd:session): session closed for user root May 25 04:58:41 oleg113-client systemd[1]: session-428.scope: Succeeded. May 25 04:58:41 oleg113-client systemd-logind[1020]: Session 428 logged out. Waiting for processes to exit. May 25 04:58:41 oleg113-client systemd-logind[1020]: Removed session 428. May 25 04:58:42 oleg113-client sshd[83461]: Accepted publickey for root from 192.168.201.13 port 57706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:43 oleg113-client systemd-logind[1020]: New session 429 of user root. May 25 04:58:43 oleg113-client systemd[1]: Started Session 429 of user root. May 25 04:58:43 oleg113-client sshd[83461]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:43 oleg113-client sshd[83474]: Received disconnect from 192.168.201.13 port 57706:11: disconnected by user May 25 04:58:43 oleg113-client sshd[83474]: Disconnected from user root 192.168.201.13 port 57706 May 25 04:58:43 oleg113-client sshd[83461]: pam_unix(sshd:session): session closed for user root May 25 04:58:43 oleg113-client systemd[1]: session-429.scope: Succeeded. May 25 04:58:43 oleg113-client systemd-logind[1020]: Session 429 logged out. Waiting for processes to exit. May 25 04:58:43 oleg113-client systemd-logind[1020]: Removed session 429. May 25 04:58:45 oleg113-client sshd[83607]: Accepted publickey for root from 192.168.201.13 port 57712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:45 oleg113-client systemd[1]: Started Session 430 of user root. May 25 04:58:45 oleg113-client systemd-logind[1020]: New session 430 of user root. May 25 04:58:45 oleg113-client sshd[83607]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:45 oleg113-client sshd[83620]: Received disconnect from 192.168.201.13 port 57712:11: disconnected by user May 25 04:58:45 oleg113-client sshd[83620]: Disconnected from user root 192.168.201.13 port 57712 May 25 04:58:45 oleg113-client sshd[83607]: pam_unix(sshd:session): session closed for user root May 25 04:58:45 oleg113-client systemd[1]: session-430.scope: Succeeded. May 25 04:58:45 oleg113-client systemd-logind[1020]: Session 430 logged out. Waiting for processes to exit. May 25 04:58:45 oleg113-client systemd-logind[1020]: Removed session 430. May 25 04:58:48 oleg113-client sshd[83763]: Accepted publickey for root from 192.168.201.13 port 57724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:58:48 oleg113-client systemd-logind[1020]: New session 431 of user root. May 25 04:58:48 oleg113-client systemd[1]: Started Session 431 of user root. May 25 04:58:48 oleg113-client sshd[83763]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:58:49 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 112a: bulk resend while orignal request is in progress ========================================================== 04:58:46 (1779699526) May 25 04:58:49 oleg113-client sshd[83776]: Received disconnect from 192.168.201.13 port 57724:11: disconnected by user May 25 04:58:49 oleg113-client sshd[83776]: Disconnected from user root 192.168.201.13 port 57724 May 25 04:58:49 oleg113-client sshd[83763]: pam_unix(sshd:session): session closed for user root May 25 04:58:49 oleg113-client systemd-logind[1020]: Session 431 logged out. Waiting for processes to exit. May 25 04:58:49 oleg113-client systemd[1]: session-431.scope: Succeeded. May 25 04:58:49 oleg113-client systemd-logind[1020]: Removed session 431. May 25 04:59:16 oleg113-client sshd[83971]: Accepted publickey for root from 192.168.201.13 port 46312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:16 oleg113-client systemd-logind[1020]: New session 432 of user root. May 25 04:59:16 oleg113-client systemd[1]: Started Session 432 of user root. May 25 04:59:16 oleg113-client sshd[83971]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:17 oleg113-client sshd[83984]: Received disconnect from 192.168.201.13 port 46312:11: disconnected by user May 25 04:59:17 oleg113-client sshd[83984]: Disconnected from user root 192.168.201.13 port 46312 May 25 04:59:17 oleg113-client sshd[83971]: pam_unix(sshd:session): session closed for user root May 25 04:59:17 oleg113-client systemd-logind[1020]: Session 432 logged out. Waiting for processes to exit. May 25 04:59:17 oleg113-client systemd[1]: session-432.scope: Succeeded. May 25 04:59:17 oleg113-client systemd-logind[1020]: Removed session 432. May 25 04:59:19 oleg113-client sshd[84111]: Accepted publickey for root from 192.168.201.13 port 46316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:19 oleg113-client systemd-logind[1020]: New session 433 of user root. May 25 04:59:19 oleg113-client systemd[1]: Started Session 433 of user root. May 25 04:59:19 oleg113-client sshd[84111]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:19 oleg113-client sshd[84124]: Received disconnect from 192.168.201.13 port 46316:11: disconnected by user May 25 04:59:19 oleg113-client sshd[84124]: Disconnected from user root 192.168.201.13 port 46316 May 25 04:59:19 oleg113-client sshd[84111]: pam_unix(sshd:session): session closed for user root May 25 04:59:20 oleg113-client systemd[1]: session-433.scope: Succeeded. May 25 04:59:20 oleg113-client systemd-logind[1020]: Session 433 logged out. Waiting for processes to exit. May 25 04:59:20 oleg113-client systemd-logind[1020]: Removed session 433. May 25 04:59:21 oleg113-client sshd[84258]: Accepted publickey for root from 192.168.201.13 port 33940 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:22 oleg113-client systemd-logind[1020]: New session 434 of user root. May 25 04:59:22 oleg113-client systemd[1]: Started Session 434 of user root. May 25 04:59:22 oleg113-client sshd[84258]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:22 oleg113-client sshd[84271]: Received disconnect from 192.168.201.13 port 33940:11: disconnected by user May 25 04:59:22 oleg113-client sshd[84271]: Disconnected from user root 192.168.201.13 port 33940 May 25 04:59:22 oleg113-client sshd[84258]: pam_unix(sshd:session): session closed for user root May 25 04:59:23 oleg113-client systemd[1]: session-434.scope: Succeeded. May 25 04:59:23 oleg113-client systemd-logind[1020]: Session 434 logged out. Waiting for processes to exit. May 25 04:59:23 oleg113-client systemd-logind[1020]: Removed session 434. May 25 04:59:24 oleg113-client sshd[84414]: Accepted publickey for root from 192.168.201.13 port 33954 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:24 oleg113-client systemd-logind[1020]: New session 435 of user root. May 25 04:59:25 oleg113-client systemd[1]: Started Session 435 of user root. May 25 04:59:25 oleg113-client sshd[84414]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:25 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115a: read: late REQ MDunlink and no bulk ========================================================== 04:59:23 (1779699563) May 25 04:59:25 oleg113-client sshd[84427]: Received disconnect from 192.168.201.13 port 33954:11: disconnected by user May 25 04:59:25 oleg113-client sshd[84427]: Disconnected from user root 192.168.201.13 port 33954 May 25 04:59:25 oleg113-client sshd[84414]: pam_unix(sshd:session): session closed for user root May 25 04:59:25 oleg113-client systemd[1]: session-435.scope: Succeeded. May 25 04:59:25 oleg113-client systemd-logind[1020]: Session 435 logged out. Waiting for processes to exit. May 25 04:59:25 oleg113-client systemd-logind[1020]: Removed session 435. May 25 04:59:25 oleg113-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** May 25 04:59:31 oleg113-client sshd[84630]: Accepted publickey for root from 192.168.201.13 port 50572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:31 oleg113-client systemd-logind[1020]: New session 436 of user root. May 25 04:59:31 oleg113-client systemd[1]: Started Session 436 of user root. May 25 04:59:31 oleg113-client sshd[84630]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:32 oleg113-client sshd[84643]: Received disconnect from 192.168.201.13 port 50572:11: disconnected by user May 25 04:59:32 oleg113-client sshd[84643]: Disconnected from user root 192.168.201.13 port 50572 May 25 04:59:32 oleg113-client sshd[84630]: pam_unix(sshd:session): session closed for user root May 25 04:59:32 oleg113-client systemd[1]: session-436.scope: Succeeded. May 25 04:59:32 oleg113-client systemd-logind[1020]: Session 436 logged out. Waiting for processes to exit. May 25 04:59:32 oleg113-client systemd-logind[1020]: Removed session 436. May 25 04:59:33 oleg113-client sshd[84770]: Accepted publickey for root from 192.168.201.13 port 50576 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:33 oleg113-client systemd[1]: Started Session 437 of user root. May 25 04:59:33 oleg113-client systemd-logind[1020]: New session 437 of user root. May 25 04:59:33 oleg113-client sshd[84770]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:34 oleg113-client sshd[84783]: Received disconnect from 192.168.201.13 port 50576:11: disconnected by user May 25 04:59:34 oleg113-client sshd[84783]: Disconnected from user root 192.168.201.13 port 50576 May 25 04:59:34 oleg113-client sshd[84770]: pam_unix(sshd:session): session closed for user root May 25 04:59:34 oleg113-client systemd[1]: session-437.scope: Succeeded. May 25 04:59:34 oleg113-client systemd-logind[1020]: Session 437 logged out. Waiting for processes to exit. May 25 04:59:34 oleg113-client systemd-logind[1020]: Removed session 437. May 25 04:59:36 oleg113-client sshd[84917]: Accepted publickey for root from 192.168.201.13 port 50588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:36 oleg113-client systemd[1]: Started Session 438 of user root. May 25 04:59:36 oleg113-client systemd-logind[1020]: New session 438 of user root. May 25 04:59:36 oleg113-client sshd[84917]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:36 oleg113-client sshd[84930]: Received disconnect from 192.168.201.13 port 50588:11: disconnected by user May 25 04:59:36 oleg113-client sshd[84930]: Disconnected from user root 192.168.201.13 port 50588 May 25 04:59:36 oleg113-client sshd[84917]: pam_unix(sshd:session): session closed for user root May 25 04:59:36 oleg113-client systemd[1]: session-438.scope: Succeeded. May 25 04:59:36 oleg113-client systemd-logind[1020]: Session 438 logged out. Waiting for processes to exit. May 25 04:59:36 oleg113-client systemd-logind[1020]: Removed session 438. May 25 04:59:39 oleg113-client sshd[85072]: Accepted publickey for root from 192.168.201.13 port 50600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:39 oleg113-client systemd-logind[1020]: New session 439 of user root. May 25 04:59:39 oleg113-client systemd[1]: Started Session 439 of user root. May 25 04:59:39 oleg113-client sshd[85072]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:39 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115b: write: late REQ MDunlink and no bulk ========================================================== 04:59:37 (1779699577) May 25 04:59:39 oleg113-client sshd[85085]: Received disconnect from 192.168.201.13 port 50600:11: disconnected by user May 25 04:59:39 oleg113-client sshd[85085]: Disconnected from user root 192.168.201.13 port 50600 May 25 04:59:39 oleg113-client sshd[85072]: pam_unix(sshd:session): session closed for user root May 25 04:59:39 oleg113-client systemd[1]: session-439.scope: Succeeded. May 25 04:59:39 oleg113-client systemd-logind[1020]: Session 439 logged out. Waiting for processes to exit. May 25 04:59:40 oleg113-client systemd-logind[1020]: Removed session 439. May 25 04:59:40 oleg113-client kernel: Lustre: *** cfs_fail_loc=51b, val=4*** May 25 04:59:47 oleg113-client sshd[85285]: Accepted publickey for root from 192.168.201.13 port 47354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:47 oleg113-client systemd-logind[1020]: New session 440 of user root. May 25 04:59:47 oleg113-client systemd[1]: Started Session 440 of user root. May 25 04:59:47 oleg113-client sshd[85285]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:47 oleg113-client sshd[85298]: Received disconnect from 192.168.201.13 port 47354:11: disconnected by user May 25 04:59:48 oleg113-client sshd[85298]: Disconnected from user root 192.168.201.13 port 47354 May 25 04:59:48 oleg113-client sshd[85285]: pam_unix(sshd:session): session closed for user root May 25 04:59:48 oleg113-client systemd[1]: session-440.scope: Succeeded. May 25 04:59:48 oleg113-client systemd-logind[1020]: Session 440 logged out. Waiting for processes to exit. May 25 04:59:48 oleg113-client systemd-logind[1020]: Removed session 440. May 25 04:59:50 oleg113-client sshd[85424]: Accepted publickey for root from 192.168.201.13 port 45286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:50 oleg113-client systemd-logind[1020]: New session 441 of user root. May 25 04:59:50 oleg113-client systemd[1]: Started Session 441 of user root. May 25 04:59:50 oleg113-client sshd[85424]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:51 oleg113-client sshd[85438]: Received disconnect from 192.168.201.13 port 45286:11: disconnected by user May 25 04:59:51 oleg113-client sshd[85438]: Disconnected from user root 192.168.201.13 port 45286 May 25 04:59:51 oleg113-client sshd[85424]: pam_unix(sshd:session): session closed for user root May 25 04:59:51 oleg113-client systemd[1]: session-441.scope: Succeeded. May 25 04:59:51 oleg113-client systemd-logind[1020]: Session 441 logged out. Waiting for processes to exit. May 25 04:59:51 oleg113-client systemd-logind[1020]: Removed session 441. May 25 04:59:53 oleg113-client sshd[85571]: Accepted publickey for root from 192.168.201.13 port 45300 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:53 oleg113-client systemd-logind[1020]: New session 442 of user root. May 25 04:59:53 oleg113-client systemd[1]: Started Session 442 of user root. May 25 04:59:53 oleg113-client sshd[85571]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:54 oleg113-client sshd[85584]: Received disconnect from 192.168.201.13 port 45300:11: disconnected by user May 25 04:59:54 oleg113-client sshd[85584]: Disconnected from user root 192.168.201.13 port 45300 May 25 04:59:54 oleg113-client sshd[85571]: pam_unix(sshd:session): session closed for user root May 25 04:59:55 oleg113-client systemd-logind[1020]: Session 442 logged out. Waiting for processes to exit. May 25 04:59:55 oleg113-client systemd[1]: session-442.scope: Succeeded. May 25 04:59:55 oleg113-client systemd-logind[1020]: Removed session 442. May 25 04:59:57 oleg113-client sshd[85727]: Accepted publickey for root from 192.168.201.13 port 45312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 04:59:57 oleg113-client systemd-logind[1020]: New session 443 of user root. May 25 04:59:57 oleg113-client systemd[1]: Started Session 443 of user root. May 25 04:59:57 oleg113-client sshd[85727]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 04:59:57 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115c: read: late Reply MDunlink and no bulk ========================================================== 04:59:55 (1779699595) May 25 04:59:57 oleg113-client sshd[85740]: Received disconnect from 192.168.201.13 port 45312:11: disconnected by user May 25 04:59:57 oleg113-client sshd[85740]: Disconnected from user root 192.168.201.13 port 45312 May 25 04:59:57 oleg113-client sshd[85727]: pam_unix(sshd:session): session closed for user root May 25 04:59:57 oleg113-client systemd-logind[1020]: Session 443 logged out. Waiting for processes to exit. May 25 04:59:57 oleg113-client systemd[1]: session-443.scope: Succeeded. May 25 04:59:57 oleg113-client systemd-logind[1020]: Removed session 443. May 25 04:59:58 oleg113-client kernel: Lustre: *** cfs_fail_loc=50f, val=3*** May 25 05:00:03 oleg113-client sshd[85944]: Accepted publickey for root from 192.168.201.13 port 53132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:03 oleg113-client systemd-logind[1020]: New session 444 of user root. May 25 05:00:03 oleg113-client systemd[1]: Started Session 444 of user root. May 25 05:00:03 oleg113-client sshd[85944]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:04 oleg113-client sshd[85957]: Received disconnect from 192.168.201.13 port 53132:11: disconnected by user May 25 05:00:04 oleg113-client sshd[85957]: Disconnected from user root 192.168.201.13 port 53132 May 25 05:00:04 oleg113-client sshd[85944]: pam_unix(sshd:session): session closed for user root May 25 05:00:04 oleg113-client systemd[1]: session-444.scope: Succeeded. May 25 05:00:04 oleg113-client systemd-logind[1020]: Session 444 logged out. Waiting for processes to exit. May 25 05:00:04 oleg113-client systemd-logind[1020]: Removed session 444. May 25 05:00:05 oleg113-client sshd[86083]: Accepted publickey for root from 192.168.201.13 port 53142 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:06 oleg113-client systemd-logind[1020]: New session 445 of user root. May 25 05:00:06 oleg113-client systemd[1]: Started Session 445 of user root. May 25 05:00:06 oleg113-client sshd[86083]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:06 oleg113-client sshd[86096]: Received disconnect from 192.168.201.13 port 53142:11: disconnected by user May 25 05:00:06 oleg113-client sshd[86096]: Disconnected from user root 192.168.201.13 port 53142 May 25 05:00:06 oleg113-client sshd[86083]: pam_unix(sshd:session): session closed for user root May 25 05:00:06 oleg113-client systemd[1]: session-445.scope: Succeeded. May 25 05:00:06 oleg113-client systemd-logind[1020]: Session 445 logged out. Waiting for processes to exit. May 25 05:00:06 oleg113-client systemd-logind[1020]: Removed session 445. May 25 05:00:08 oleg113-client sshd[86229]: Accepted publickey for root from 192.168.201.13 port 53146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:08 oleg113-client systemd-logind[1020]: New session 446 of user root. May 25 05:00:08 oleg113-client systemd[1]: Started Session 446 of user root. May 25 05:00:08 oleg113-client sshd[86229]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:09 oleg113-client sshd[86242]: Received disconnect from 192.168.201.13 port 53146:11: disconnected by user May 25 05:00:09 oleg113-client sshd[86242]: Disconnected from user root 192.168.201.13 port 53146 May 25 05:00:09 oleg113-client sshd[86229]: pam_unix(sshd:session): session closed for user root May 25 05:00:09 oleg113-client systemd[1]: session-446.scope: Succeeded. May 25 05:00:09 oleg113-client systemd-logind[1020]: Session 446 logged out. Waiting for processes to exit. May 25 05:00:09 oleg113-client systemd-logind[1020]: Removed session 446. May 25 05:00:11 oleg113-client sshd[86385]: Accepted publickey for root from 192.168.201.13 port 58060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:11 oleg113-client systemd-logind[1020]: New session 447 of user root. May 25 05:00:11 oleg113-client systemd[1]: Started Session 447 of user root. May 25 05:00:11 oleg113-client sshd[86385]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:12 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115d: write: late Reply MDunlink and no bulk ========================================================== 05:00:09 (1779699609) May 25 05:00:12 oleg113-client sshd[86398]: Received disconnect from 192.168.201.13 port 58060:11: disconnected by user May 25 05:00:12 oleg113-client sshd[86398]: Disconnected from user root 192.168.201.13 port 58060 May 25 05:00:12 oleg113-client sshd[86385]: pam_unix(sshd:session): session closed for user root May 25 05:00:12 oleg113-client systemd[1]: session-447.scope: Succeeded. May 25 05:00:12 oleg113-client systemd-logind[1020]: Session 447 logged out. Waiting for processes to exit. May 25 05:00:12 oleg113-client systemd-logind[1020]: Removed session 447. May 25 05:00:12 oleg113-client kernel: Lustre: *** cfs_fail_loc=50f, val=4*** May 25 05:00:17 oleg113-client sshd[86597]: Accepted publickey for root from 192.168.201.13 port 58068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:17 oleg113-client systemd-logind[1020]: New session 448 of user root. May 25 05:00:17 oleg113-client systemd[1]: Started Session 448 of user root. May 25 05:00:17 oleg113-client sshd[86597]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:18 oleg113-client sshd[86610]: Received disconnect from 192.168.201.13 port 58068:11: disconnected by user May 25 05:00:18 oleg113-client sshd[86610]: Disconnected from user root 192.168.201.13 port 58068 May 25 05:00:18 oleg113-client sshd[86597]: pam_unix(sshd:session): session closed for user root May 25 05:00:18 oleg113-client systemd-logind[1020]: Session 448 logged out. Waiting for processes to exit. May 25 05:00:18 oleg113-client systemd[1]: session-448.scope: Succeeded. May 25 05:00:18 oleg113-client systemd-logind[1020]: Removed session 448. May 25 05:00:20 oleg113-client sshd[86736]: Accepted publickey for root from 192.168.201.13 port 35764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:20 oleg113-client systemd-logind[1020]: New session 449 of user root. May 25 05:00:20 oleg113-client systemd[1]: Started Session 449 of user root. May 25 05:00:20 oleg113-client sshd[86736]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:20 oleg113-client sshd[86749]: Received disconnect from 192.168.201.13 port 35764:11: disconnected by user May 25 05:00:20 oleg113-client sshd[86749]: Disconnected from user root 192.168.201.13 port 35764 May 25 05:00:20 oleg113-client sshd[86736]: pam_unix(sshd:session): session closed for user root May 25 05:00:20 oleg113-client systemd-logind[1020]: Session 449 logged out. Waiting for processes to exit. May 25 05:00:20 oleg113-client systemd[1]: session-449.scope: Succeeded. May 25 05:00:20 oleg113-client systemd-logind[1020]: Removed session 449. May 25 05:00:23 oleg113-client sshd[86883]: Accepted publickey for root from 192.168.201.13 port 35772 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:23 oleg113-client systemd-logind[1020]: New session 450 of user root. May 25 05:00:23 oleg113-client systemd[1]: Started Session 450 of user root. May 25 05:00:23 oleg113-client sshd[86883]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:24 oleg113-client sshd[86896]: Received disconnect from 192.168.201.13 port 35772:11: disconnected by user May 25 05:00:24 oleg113-client sshd[86896]: Disconnected from user root 192.168.201.13 port 35772 May 25 05:00:24 oleg113-client sshd[86883]: pam_unix(sshd:session): session closed for user root May 25 05:00:24 oleg113-client systemd[1]: session-450.scope: Succeeded. May 25 05:00:24 oleg113-client systemd-logind[1020]: Session 450 logged out. Waiting for processes to exit. May 25 05:00:24 oleg113-client systemd-logind[1020]: Removed session 450. May 25 05:00:27 oleg113-client sshd[87039]: Accepted publickey for root from 192.168.201.13 port 35780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:28 oleg113-client systemd-logind[1020]: New session 451 of user root. May 25 05:00:28 oleg113-client systemd[1]: Started Session 451 of user root. May 25 05:00:28 oleg113-client sshd[87039]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:28 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115e: read: late Bulk MDunlink and no reply ========================================================== 05:00:25 (1779699625) May 25 05:00:28 oleg113-client sshd[87052]: Received disconnect from 192.168.201.13 port 35780:11: disconnected by user May 25 05:00:28 oleg113-client sshd[87052]: Disconnected from user root 192.168.201.13 port 35780 May 25 05:00:28 oleg113-client sshd[87039]: pam_unix(sshd:session): session closed for user root May 25 05:00:29 oleg113-client systemd[1]: session-451.scope: Succeeded. May 25 05:00:29 oleg113-client systemd-logind[1020]: Session 451 logged out. Waiting for processes to exit. May 25 05:00:29 oleg113-client systemd-logind[1020]: Removed session 451. May 25 05:00:29 oleg113-client kernel: Lustre: *** cfs_fail_loc=510, val=3*** May 25 05:00:35 oleg113-client sshd[87255]: Accepted publickey for root from 192.168.201.13 port 39758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:35 oleg113-client systemd[1]: Started Session 452 of user root. May 25 05:00:35 oleg113-client systemd-logind[1020]: New session 452 of user root. May 25 05:00:35 oleg113-client sshd[87255]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:36 oleg113-client sshd[87268]: Received disconnect from 192.168.201.13 port 39758:11: disconnected by user May 25 05:00:36 oleg113-client sshd[87268]: Disconnected from user root 192.168.201.13 port 39758 May 25 05:00:36 oleg113-client sshd[87255]: pam_unix(sshd:session): session closed for user root May 25 05:00:36 oleg113-client systemd-logind[1020]: Session 452 logged out. Waiting for processes to exit. May 25 05:00:36 oleg113-client systemd[1]: session-452.scope: Succeeded. May 25 05:00:36 oleg113-client systemd-logind[1020]: Removed session 452. May 25 05:00:39 oleg113-client sshd[87394]: Accepted publickey for root from 192.168.201.13 port 39764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:39 oleg113-client systemd-logind[1020]: New session 453 of user root. May 25 05:00:39 oleg113-client systemd[1]: Started Session 453 of user root. May 25 05:00:39 oleg113-client sshd[87394]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:40 oleg113-client sshd[87408]: Received disconnect from 192.168.201.13 port 39764:11: disconnected by user May 25 05:00:40 oleg113-client sshd[87408]: Disconnected from user root 192.168.201.13 port 39764 May 25 05:00:40 oleg113-client sshd[87394]: pam_unix(sshd:session): session closed for user root May 25 05:00:40 oleg113-client systemd[1]: session-453.scope: Succeeded. May 25 05:00:40 oleg113-client systemd-logind[1020]: Session 453 logged out. Waiting for processes to exit. May 25 05:00:40 oleg113-client systemd-logind[1020]: Removed session 453. May 25 05:00:42 oleg113-client sshd[87541]: Accepted publickey for root from 192.168.201.13 port 54704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:42 oleg113-client systemd-logind[1020]: New session 454 of user root. May 25 05:00:42 oleg113-client systemd[1]: Started Session 454 of user root. May 25 05:00:42 oleg113-client sshd[87541]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:43 oleg113-client sshd[87554]: Received disconnect from 192.168.201.13 port 54704:11: disconnected by user May 25 05:00:43 oleg113-client sshd[87554]: Disconnected from user root 192.168.201.13 port 54704 May 25 05:00:43 oleg113-client sshd[87541]: pam_unix(sshd:session): session closed for user root May 25 05:00:44 oleg113-client systemd-logind[1020]: Session 454 logged out. Waiting for processes to exit. May 25 05:00:44 oleg113-client systemd[1]: session-454.scope: Succeeded. May 25 05:00:44 oleg113-client systemd-logind[1020]: Removed session 454. May 25 05:00:46 oleg113-client sshd[87696]: Accepted publickey for root from 192.168.201.13 port 54720 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:00:46 oleg113-client systemd[1]: Started Session 455 of user root. May 25 05:00:46 oleg113-client systemd-logind[1020]: New session 455 of user root. May 25 05:00:46 oleg113-client sshd[87696]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:00:47 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115f: read: late REQ MDunlink and no reply ========================================================== 05:00:44 (1779699644) May 25 05:00:47 oleg113-client sshd[87709]: Received disconnect from 192.168.201.13 port 54720:11: disconnected by user May 25 05:00:47 oleg113-client sshd[87709]: Disconnected from user root 192.168.201.13 port 54720 May 25 05:00:47 oleg113-client sshd[87696]: pam_unix(sshd:session): session closed for user root May 25 05:00:47 oleg113-client systemd[1]: session-455.scope: Succeeded. May 25 05:00:47 oleg113-client systemd-logind[1020]: Session 455 logged out. Waiting for processes to exit. May 25 05:00:47 oleg113-client systemd-logind[1020]: Removed session 455. May 25 05:00:47 oleg113-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** May 25 05:01:01 oleg113-client CROND[87829]: (root) CMD (run-parts /etc/cron.hourly) May 25 05:01:01 oleg113-client run-parts[87829]: (/etc/cron.hourly) starting 0anacron May 25 05:01:01 oleg113-client run-parts[87829]: (/etc/cron.hourly) finished 0anacron May 25 05:01:46 oleg113-client kernel: Lustre: 2419:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779699651/real 1779699651] req@ffff9b15c69d0700 x1866143510780800/t0(0) o3->lustre-OST0001-osc-ffff9b15c7c5d000@192.168.201.113@tcp:6/4 lens 488/4536 e 0 to 1 dl 1779699706 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 May 25 05:01:46 oleg113-client kernel: Lustre: 2419:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 6 previous similar messages May 25 05:01:46 oleg113-client kernel: Lustre: lustre-OST0001-osc-ffff9b15c7c5d000: Connection to lustre-OST0001 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:01:46 oleg113-client kernel: Lustre: Skipped 6 previous similar messages May 25 05:01:48 oleg113-client sshd[87932]: Accepted publickey for root from 192.168.201.13 port 48256 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:01:48 oleg113-client systemd-logind[1020]: New session 456 of user root. May 25 05:01:48 oleg113-client systemd[1]: Started Session 456 of user root. May 25 05:01:48 oleg113-client sshd[87932]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:01:48 oleg113-client sshd[87945]: Received disconnect from 192.168.201.13 port 48256:11: disconnected by user May 25 05:01:48 oleg113-client sshd[87945]: Disconnected from user root 192.168.201.13 port 48256 May 25 05:01:48 oleg113-client sshd[87932]: pam_unix(sshd:session): session closed for user root May 25 05:01:48 oleg113-client systemd-logind[1020]: Session 456 logged out. Waiting for processes to exit. May 25 05:01:48 oleg113-client systemd[1]: session-456.scope: Succeeded. May 25 05:01:48 oleg113-client systemd-logind[1020]: Removed session 456. May 25 05:01:52 oleg113-client sshd[88071]: Accepted publickey for root from 192.168.201.13 port 59738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:01:52 oleg113-client systemd[1]: Started Session 457 of user root. May 25 05:01:52 oleg113-client systemd-logind[1020]: New session 457 of user root. May 25 05:01:52 oleg113-client sshd[88071]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:01:52 oleg113-client sshd[88084]: Received disconnect from 192.168.201.13 port 59738:11: disconnected by user May 25 05:01:52 oleg113-client sshd[88084]: Disconnected from user root 192.168.201.13 port 59738 May 25 05:01:52 oleg113-client sshd[88071]: pam_unix(sshd:session): session closed for user root May 25 05:01:52 oleg113-client systemd[1]: session-457.scope: Succeeded. May 25 05:01:52 oleg113-client systemd-logind[1020]: Session 457 logged out. Waiting for processes to exit. May 25 05:01:52 oleg113-client systemd-logind[1020]: Removed session 457. May 25 05:01:54 oleg113-client sshd[88218]: Accepted publickey for root from 192.168.201.13 port 59742 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:01:54 oleg113-client systemd-logind[1020]: New session 458 of user root. May 25 05:01:54 oleg113-client systemd[1]: Started Session 458 of user root. May 25 05:01:54 oleg113-client sshd[88218]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:01:54 oleg113-client sshd[88231]: Received disconnect from 192.168.201.13 port 59742:11: disconnected by user May 25 05:01:54 oleg113-client sshd[88231]: Disconnected from user root 192.168.201.13 port 59742 May 25 05:01:54 oleg113-client sshd[88218]: pam_unix(sshd:session): session closed for user root May 25 05:01:55 oleg113-client systemd[1]: session-458.scope: Succeeded. May 25 05:01:55 oleg113-client systemd-logind[1020]: Session 458 logged out. Waiting for processes to exit. May 25 05:01:55 oleg113-client systemd-logind[1020]: Removed session 458. May 25 05:01:57 oleg113-client sshd[88373]: Accepted publickey for root from 192.168.201.13 port 59744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:01:57 oleg113-client systemd-logind[1020]: New session 459 of user root. May 25 05:01:57 oleg113-client systemd[1]: Started Session 459 of user root. May 25 05:01:57 oleg113-client sshd[88373]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:01:57 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115g: read: late REQ MDunlink and Reply MDunlink ========================================================== 05:01:55 (1779699715) May 25 05:01:57 oleg113-client sshd[88386]: Received disconnect from 192.168.201.13 port 59744:11: disconnected by user May 25 05:01:57 oleg113-client sshd[88386]: Disconnected from user root 192.168.201.13 port 59744 May 25 05:01:57 oleg113-client sshd[88373]: pam_unix(sshd:session): session closed for user root May 25 05:01:58 oleg113-client systemd[1]: session-459.scope: Succeeded. May 25 05:01:58 oleg113-client systemd-logind[1020]: Session 459 logged out. Waiting for processes to exit. May 25 05:01:58 oleg113-client systemd-logind[1020]: Removed session 459. May 25 05:01:58 oleg113-client kernel: Lustre: *** cfs_fail_loc=51c, val=3*** May 25 05:03:00 oleg113-client sshd[88598]: Accepted publickey for root from 192.168.201.13 port 37420 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:00 oleg113-client systemd-logind[1020]: New session 460 of user root. May 25 05:03:00 oleg113-client systemd[1]: Started Session 460 of user root. May 25 05:03:00 oleg113-client sshd[88598]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:01 oleg113-client sshd[88612]: Received disconnect from 192.168.201.13 port 37420:11: disconnected by user May 25 05:03:01 oleg113-client sshd[88612]: Disconnected from user root 192.168.201.13 port 37420 May 25 05:03:01 oleg113-client sshd[88598]: pam_unix(sshd:session): session closed for user root May 25 05:03:01 oleg113-client systemd[1]: session-460.scope: Succeeded. May 25 05:03:01 oleg113-client systemd-logind[1020]: Session 460 logged out. Waiting for processes to exit. May 25 05:03:01 oleg113-client systemd-logind[1020]: Removed session 460. May 25 05:03:03 oleg113-client sshd[88738]: Accepted publickey for root from 192.168.201.13 port 37434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:04 oleg113-client systemd-logind[1020]: New session 461 of user root. May 25 05:03:04 oleg113-client systemd[1]: Started Session 461 of user root. May 25 05:03:04 oleg113-client sshd[88738]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:04 oleg113-client sshd[88751]: Received disconnect from 192.168.201.13 port 37434:11: disconnected by user May 25 05:03:04 oleg113-client sshd[88751]: Disconnected from user root 192.168.201.13 port 37434 May 25 05:03:04 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:03:04 oleg113-client sshd[88738]: pam_unix(sshd:session): session closed for user root May 25 05:03:04 oleg113-client systemd[1]: session-461.scope: Succeeded. May 25 05:03:04 oleg113-client systemd-logind[1020]: Session 461 logged out. Waiting for processes to exit. May 25 05:03:04 oleg113-client systemd-logind[1020]: Removed session 461. May 25 05:03:06 oleg113-client sshd[88885]: Accepted publickey for root from 192.168.201.13 port 37442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:07 oleg113-client systemd[1]: Started Session 462 of user root. May 25 05:03:07 oleg113-client systemd-logind[1020]: New session 462 of user root. May 25 05:03:07 oleg113-client sshd[88885]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:07 oleg113-client sshd[88898]: Received disconnect from 192.168.201.13 port 37442:11: disconnected by user May 25 05:03:07 oleg113-client sshd[88898]: Disconnected from user root 192.168.201.13 port 37442 May 25 05:03:07 oleg113-client sshd[88885]: pam_unix(sshd:session): session closed for user root May 25 05:03:08 oleg113-client systemd[1]: session-462.scope: Succeeded. May 25 05:03:08 oleg113-client systemd-logind[1020]: Session 462 logged out. Waiting for processes to exit. May 25 05:03:08 oleg113-client systemd-logind[1020]: Removed session 462. May 25 05:03:09 oleg113-client sshd[89041]: Accepted publickey for root from 192.168.201.13 port 34556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:03:10 oleg113-client systemd[1]: Started Session 463 of user root. May 25 05:03:10 oleg113-client systemd-logind[1020]: New session 463 of user root. May 25 05:03:10 oleg113-client sshd[89041]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:03:10 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 120: flock race: completion vs. evict ========================================================== 05:03:08 (1779699788) May 25 05:03:10 oleg113-client sshd[89054]: Received disconnect from 192.168.201.13 port 34556:11: disconnected by user May 25 05:03:10 oleg113-client sshd[89054]: Disconnected from user root 192.168.201.13 port 34556 May 25 05:03:10 oleg113-client sshd[89041]: pam_unix(sshd:session): session closed for user root May 25 05:03:10 oleg113-client systemd[1]: session-463.scope: Succeeded. May 25 05:03:10 oleg113-client systemd-logind[1020]: Session 463 logged out. Waiting for processes to exit. May 25 05:03:10 oleg113-client systemd-logind[1020]: Removed session 463. May 25 05:03:10 oleg113-client kernel: LustreError: 89095:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 05:03:14 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 05:03:14 oleg113-client kernel: LustreError: Skipped 2 previous similar messages May 25 05:03:14 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:14 oleg113-client kernel: LustreError: 89110:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9b15c7c5d000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9b15c45dde00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:03:14 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c7c5d000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 05:03:14 oleg113-client kernel: Lustre: Skipped 8 previous similar messages May 25 05:03:14 oleg113-client kernel: LustreError: 89095:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 05:03:17 oleg113-client kernel: LustreError: 89125:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 05:03:20 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:20 oleg113-client kernel: LustreError: 89140:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9b15c7c5d000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9b15c45dd200) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:03:20 oleg113-client kernel: LustreError: 89140:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 05:03:21 oleg113-client kernel: LustreError: 89125:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 05:03:28 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:28 oleg113-client kernel: LustreError: 89181:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms May 25 05:03:32 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 05:03:32 oleg113-client kernel: LustreError: Skipped 2 previous similar messages May 25 05:03:32 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:32 oleg113-client kernel: LustreError: 89201:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 05:03:32 oleg113-client kernel: LustreError: 89201:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 14 previous similar messages May 25 05:03:32 oleg113-client kernel: LustreError: 89181:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake May 25 05:03:32 oleg113-client kernel: LustreError: 89181:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffff9b15c7c5d000: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 May 25 05:03:33 oleg113-client kernel: LustreError: 89207:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 05:03:33 oleg113-client kernel: LustreError: 89207:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 5 previous similar messages May 25 05:03:35 oleg113-client kernel: LustreError: 89230:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 05:03:35 oleg113-client kernel: LustreError: 89230:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 13 previous similar messages May 25 05:03:38 oleg113-client kernel: LustreError: 89245:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms May 25 05:03:42 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:42 oleg113-client kernel: LustreError: 89260:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9b15c7c5d000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9b15c44d8c00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:03:42 oleg113-client kernel: LustreError: 89260:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 05:03:42 oleg113-client kernel: LustreError: 89245:0:(ldlm_flock.c:809:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake May 25 05:03:50 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:51 oleg113-client kernel: LustreError: 89302:0:(ldlm_flock.c:858:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 sleeping for 4000ms May 25 05:03:54 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:55 oleg113-client kernel: LustreError: 89316:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9b15c7c5d000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9b15c46a2000) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:03:55 oleg113-client kernel: LustreError: 89316:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 05:03:55 oleg113-client kernel: LustreError: 89302:0:(ldlm_flock.c:858:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 awake May 25 05:03:59 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:03:59 oleg113-client kernel: LustreError: 89349:0:(file.c:6098:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 May 25 05:03:59 oleg113-client kernel: LustreError: 89349:0:(file.c:6098:ll_inode_revalidate_fini()) Skipped 1 previous similar message May 25 05:03:59 oleg113-client kernel: LustreError: 89329:0:(file.c:252:ll_close_inode_openhandle()) lustre-clilmv-ffff9b15c7c5d000: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 May 25 05:04:08 oleg113-client kernel: LustreError: 89401:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms May 25 05:04:08 oleg113-client kernel: LustreError: 89401:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) Skipped 1 previous similar message May 25 05:04:12 oleg113-client kernel: LustreError: 89401:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake May 25 05:04:12 oleg113-client kernel: LustreError: 89401:0:(ldlm_flock.c:804:ldlm_flock_completion_ast()) Skipped 1 previous similar message May 25 05:04:13 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 05:04:13 oleg113-client kernel: LustreError: Skipped 3 previous similar messages May 25 05:04:13 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7c5d000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:04:13 oleg113-client kernel: LustreError: 89419:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9b15c7c5d000: namespace resource [0x200000007:0x1:0x0].0x0 (ffff9b15c44d8c00) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:04:13 oleg113-client kernel: LustreError: 89419:0:(ldlm_resource.c:1180:ldlm_resource_complain()) Skipped 1 previous similar message May 25 05:04:15 oleg113-client sshd[89517]: Accepted publickey for root from 192.168.201.13 port 34324 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:04:15 oleg113-client systemd[1]: Started Session 464 of user root. May 25 05:04:15 oleg113-client systemd-logind[1020]: New session 464 of user root. May 25 05:04:15 oleg113-client sshd[89517]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:04:15 oleg113-client sshd[89530]: Received disconnect from 192.168.201.13 port 34324:11: disconnected by user May 25 05:04:15 oleg113-client sshd[89530]: Disconnected from user root 192.168.201.13 port 34324 May 25 05:04:15 oleg113-client sshd[89517]: pam_unix(sshd:session): session closed for user root May 25 05:04:15 oleg113-client systemd[1]: session-464.scope: Succeeded. May 25 05:04:15 oleg113-client systemd-logind[1020]: Session 464 logged out. Waiting for processes to exit. May 25 05:04:15 oleg113-client systemd-logind[1020]: Removed session 464. May 25 05:04:17 oleg113-client sshd[89656]: Accepted publickey for root from 192.168.201.13 port 34328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:04:17 oleg113-client systemd-logind[1020]: New session 465 of user root. May 25 05:04:17 oleg113-client systemd[1]: Started Session 465 of user root. May 25 05:04:17 oleg113-client sshd[89656]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:04:17 oleg113-client sshd[89670]: Received disconnect from 192.168.201.13 port 34328:11: disconnected by user May 25 05:04:17 oleg113-client sshd[89670]: Disconnected from user root 192.168.201.13 port 34328 May 25 05:04:17 oleg113-client sshd[89656]: pam_unix(sshd:session): session closed for user root May 25 05:04:17 oleg113-client systemd-logind[1020]: Session 465 logged out. Waiting for processes to exit. May 25 05:04:17 oleg113-client systemd[1]: session-465.scope: Succeeded. May 25 05:04:17 oleg113-client systemd-logind[1020]: Removed session 465. May 25 05:04:19 oleg113-client sshd[89803]: Accepted publickey for root from 192.168.201.13 port 34332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:04:19 oleg113-client systemd-logind[1020]: New session 466 of user root. May 25 05:04:19 oleg113-client systemd[1]: Started Session 466 of user root. May 25 05:04:19 oleg113-client sshd[89803]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:04:19 oleg113-client sshd[89816]: Received disconnect from 192.168.201.13 port 34332:11: disconnected by user May 25 05:04:19 oleg113-client sshd[89816]: Disconnected from user root 192.168.201.13 port 34332 May 25 05:04:19 oleg113-client sshd[89803]: pam_unix(sshd:session): session closed for user root May 25 05:04:20 oleg113-client systemd[1]: session-466.scope: Succeeded. May 25 05:04:20 oleg113-client systemd-logind[1020]: Session 466 logged out. Waiting for processes to exit. May 25 05:04:20 oleg113-client systemd-logind[1020]: Removed session 466. May 25 05:04:22 oleg113-client sshd[89958]: Accepted publickey for root from 192.168.201.13 port 55926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:04:22 oleg113-client systemd[1]: Started Session 467 of user root. May 25 05:04:22 oleg113-client systemd-logind[1020]: New session 467 of user root. May 25 05:04:22 oleg113-client sshd[89958]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:04:22 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 113: ldlm enqueue dropped reply should not cause deadlocks ========================================================== 05:04:20 (1779699860) May 25 05:04:22 oleg113-client sshd[89972]: Received disconnect from 192.168.201.13 port 55926:11: disconnected by user May 25 05:04:22 oleg113-client sshd[89972]: Disconnected from user root 192.168.201.13 port 55926 May 25 05:04:22 oleg113-client sshd[89958]: pam_unix(sshd:session): session closed for user root May 25 05:04:22 oleg113-client systemd[1]: session-467.scope: Succeeded. May 25 05:04:22 oleg113-client systemd-logind[1020]: Session 467 logged out. Waiting for processes to exit. May 25 05:04:22 oleg113-client systemd-logind[1020]: Removed session 467. May 25 05:05:22 oleg113-client kernel: LustreError: 81483:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f sleeping for 4000ms May 25 05:05:26 oleg113-client kernel: LustreError: 81483:0:(ldlm_lockd.c:2883:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f awake May 25 05:05:28 oleg113-client sshd[90226]: Accepted publickey for root from 192.168.201.13 port 49812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:28 oleg113-client systemd-logind[1020]: New session 468 of user root. May 25 05:05:28 oleg113-client systemd[1]: Started Session 468 of user root. May 25 05:05:28 oleg113-client sshd[90226]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:29 oleg113-client sshd[90239]: Received disconnect from 192.168.201.13 port 49812:11: disconnected by user May 25 05:05:29 oleg113-client sshd[90239]: Disconnected from user root 192.168.201.13 port 49812 May 25 05:05:29 oleg113-client sshd[90226]: pam_unix(sshd:session): session closed for user root May 25 05:05:29 oleg113-client systemd[1]: session-468.scope: Succeeded. May 25 05:05:29 oleg113-client systemd-logind[1020]: Session 468 logged out. Waiting for processes to exit. May 25 05:05:29 oleg113-client systemd-logind[1020]: Removed session 468. May 25 05:05:30 oleg113-client sshd[90366]: Accepted publickey for root from 192.168.201.13 port 57286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:30 oleg113-client systemd[1]: Started Session 469 of user root. May 25 05:05:30 oleg113-client systemd-logind[1020]: New session 469 of user root. May 25 05:05:30 oleg113-client sshd[90366]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:31 oleg113-client sshd[90379]: Received disconnect from 192.168.201.13 port 57286:11: disconnected by user May 25 05:05:31 oleg113-client sshd[90379]: Disconnected from user root 192.168.201.13 port 57286 May 25 05:05:31 oleg113-client sshd[90366]: pam_unix(sshd:session): session closed for user root May 25 05:05:31 oleg113-client systemd[1]: session-469.scope: Succeeded. May 25 05:05:31 oleg113-client systemd-logind[1020]: Session 469 logged out. Waiting for processes to exit. May 25 05:05:31 oleg113-client systemd-logind[1020]: Removed session 469. May 25 05:05:32 oleg113-client sshd[90512]: Accepted publickey for root from 192.168.201.13 port 57298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:32 oleg113-client systemd-logind[1020]: New session 470 of user root. May 25 05:05:32 oleg113-client systemd[1]: Started Session 470 of user root. May 25 05:05:32 oleg113-client sshd[90512]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:33 oleg113-client sshd[90525]: Received disconnect from 192.168.201.13 port 57298:11: disconnected by user May 25 05:05:33 oleg113-client sshd[90525]: Disconnected from user root 192.168.201.13 port 57298 May 25 05:05:33 oleg113-client sshd[90512]: pam_unix(sshd:session): session closed for user root May 25 05:05:33 oleg113-client systemd[1]: session-470.scope: Succeeded. May 25 05:05:33 oleg113-client systemd-logind[1020]: Session 470 logged out. Waiting for processes to exit. May 25 05:05:33 oleg113-client systemd-logind[1020]: Removed session 470. May 25 05:05:35 oleg113-client sshd[90667]: Accepted publickey for root from 192.168.201.13 port 57304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:05:35 oleg113-client systemd-logind[1020]: New session 471 of user root. May 25 05:05:35 oleg113-client systemd[1]: Started Session 471 of user root. May 25 05:05:35 oleg113-client sshd[90667]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:05:36 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130a: enqueue resend on not existing file ========================================================== 05:05:34 (1779699934) May 25 05:05:36 oleg113-client sshd[90680]: Received disconnect from 192.168.201.13 port 57304:11: disconnected by user May 25 05:05:36 oleg113-client sshd[90680]: Disconnected from user root 192.168.201.13 port 57304 May 25 05:05:36 oleg113-client sshd[90667]: pam_unix(sshd:session): session closed for user root May 25 05:05:36 oleg113-client systemd-logind[1020]: Session 471 logged out. Waiting for processes to exit. May 25 05:05:36 oleg113-client systemd[1]: session-471.scope: Succeeded. May 25 05:05:36 oleg113-client systemd-logind[1020]: Removed session 471. May 25 05:06:36 oleg113-client sshd[90976]: Accepted publickey for root from 192.168.201.13 port 45832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:06:36 oleg113-client systemd-logind[1020]: New session 472 of user root. May 25 05:06:36 oleg113-client systemd[1]: Started Session 472 of user root. May 25 05:06:36 oleg113-client sshd[90976]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:06:36 oleg113-client sshd[90989]: Received disconnect from 192.168.201.13 port 45832:11: disconnected by user May 25 05:06:36 oleg113-client sshd[90989]: Disconnected from user root 192.168.201.13 port 45832 May 25 05:06:36 oleg113-client sshd[90976]: pam_unix(sshd:session): session closed for user root May 25 05:06:36 oleg113-client systemd[1]: session-472.scope: Succeeded. May 25 05:06:36 oleg113-client systemd-logind[1020]: Session 472 logged out. Waiting for processes to exit. May 25 05:06:36 oleg113-client systemd-logind[1020]: Removed session 472. May 25 05:06:38 oleg113-client sshd[91117]: Accepted publickey for root from 192.168.201.13 port 45834 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:06:38 oleg113-client systemd[1]: Started Session 473 of user root. May 25 05:06:38 oleg113-client systemd-logind[1020]: New session 473 of user root. May 25 05:06:38 oleg113-client sshd[91117]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:06:39 oleg113-client sshd[91130]: Received disconnect from 192.168.201.13 port 45834:11: disconnected by user May 25 05:06:39 oleg113-client sshd[91130]: Disconnected from user root 192.168.201.13 port 45834 May 25 05:06:39 oleg113-client sshd[91117]: pam_unix(sshd:session): session closed for user root May 25 05:06:39 oleg113-client systemd[1]: session-473.scope: Succeeded. May 25 05:06:39 oleg113-client systemd-logind[1020]: Session 473 logged out. Waiting for processes to exit. May 25 05:06:39 oleg113-client systemd-logind[1020]: Removed session 473. May 25 05:06:40 oleg113-client sshd[91263]: Accepted publickey for root from 192.168.201.13 port 47678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:06:41 oleg113-client systemd-logind[1020]: New session 474 of user root. May 25 05:06:41 oleg113-client systemd[1]: Started Session 474 of user root. May 25 05:06:41 oleg113-client sshd[91263]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:06:41 oleg113-client sshd[91276]: Received disconnect from 192.168.201.13 port 47678:11: disconnected by user May 25 05:06:41 oleg113-client sshd[91276]: Disconnected from user root 192.168.201.13 port 47678 May 25 05:06:41 oleg113-client sshd[91263]: pam_unix(sshd:session): session closed for user root May 25 05:06:41 oleg113-client systemd[1]: session-474.scope: Succeeded. May 25 05:06:41 oleg113-client systemd-logind[1020]: Session 474 logged out. Waiting for processes to exit. May 25 05:06:41 oleg113-client systemd-logind[1020]: Removed session 474. May 25 05:06:44 oleg113-client sshd[91418]: Accepted publickey for root from 192.168.201.13 port 47684 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:06:44 oleg113-client systemd[1]: Started Session 475 of user root. May 25 05:06:44 oleg113-client systemd-logind[1020]: New session 475 of user root. May 25 05:06:44 oleg113-client sshd[91418]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:06:44 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130b: enqueue resend on a stale inode ========================================================== 05:06:42 (1779700002) May 25 05:06:44 oleg113-client sshd[91431]: Received disconnect from 192.168.201.13 port 47684:11: disconnected by user May 25 05:06:44 oleg113-client sshd[91431]: Disconnected from user root 192.168.201.13 port 47684 May 25 05:06:44 oleg113-client sshd[91418]: pam_unix(sshd:session): session closed for user root May 25 05:06:44 oleg113-client systemd-logind[1020]: Session 475 logged out. Waiting for processes to exit. May 25 05:06:44 oleg113-client systemd[1]: session-475.scope: Succeeded. May 25 05:06:44 oleg113-client systemd-logind[1020]: Removed session 475. May 25 05:07:30 oleg113-client sshd[91794]: Accepted publickey for root from 192.168.201.13 port 33690 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:07:30 oleg113-client systemd[1]: Started Session 476 of user root. May 25 05:07:30 oleg113-client systemd-logind[1020]: New session 476 of user root. May 25 05:07:30 oleg113-client sshd[91794]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:07:31 oleg113-client sshd[91807]: Received disconnect from 192.168.201.13 port 33690:11: disconnected by user May 25 05:07:31 oleg113-client sshd[91807]: Disconnected from user root 192.168.201.13 port 33690 May 25 05:07:31 oleg113-client sshd[91794]: pam_unix(sshd:session): session closed for user root May 25 05:07:31 oleg113-client systemd[1]: session-476.scope: Succeeded. May 25 05:07:31 oleg113-client systemd-logind[1020]: Session 476 logged out. Waiting for processes to exit. May 25 05:07:31 oleg113-client systemd-logind[1020]: Removed session 476. May 25 05:07:34 oleg113-client sshd[91934]: Accepted publickey for root from 192.168.201.13 port 33700 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:07:34 oleg113-client systemd-logind[1020]: New session 477 of user root. May 25 05:07:34 oleg113-client systemd[1]: Started Session 477 of user root. May 25 05:07:34 oleg113-client sshd[91934]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:07:35 oleg113-client sshd[91947]: Received disconnect from 192.168.201.13 port 33700:11: disconnected by user May 25 05:07:35 oleg113-client sshd[91947]: Disconnected from user root 192.168.201.13 port 33700 May 25 05:07:35 oleg113-client sshd[91934]: pam_unix(sshd:session): session closed for user root May 25 05:07:35 oleg113-client systemd[1]: session-477.scope: Succeeded. May 25 05:07:35 oleg113-client systemd-logind[1020]: Session 477 logged out. Waiting for processes to exit. May 25 05:07:35 oleg113-client systemd-logind[1020]: Removed session 477. May 25 05:07:36 oleg113-client sshd[92081]: Accepted publickey for root from 192.168.201.13 port 33706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:07:37 oleg113-client systemd[1]: Started Session 478 of user root. May 25 05:07:37 oleg113-client systemd-logind[1020]: New session 478 of user root. May 25 05:07:37 oleg113-client sshd[92081]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:07:37 oleg113-client sshd[92094]: Received disconnect from 192.168.201.13 port 33706:11: disconnected by user May 25 05:07:37 oleg113-client sshd[92094]: Disconnected from user root 192.168.201.13 port 33706 May 25 05:07:37 oleg113-client sshd[92081]: pam_unix(sshd:session): session closed for user root May 25 05:07:37 oleg113-client systemd[1]: session-478.scope: Succeeded. May 25 05:07:37 oleg113-client systemd-logind[1020]: Session 478 logged out. Waiting for processes to exit. May 25 05:07:37 oleg113-client systemd-logind[1020]: Removed session 478. May 25 05:07:39 oleg113-client sshd[92236]: Accepted publickey for root from 192.168.201.13 port 42754 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:07:39 oleg113-client systemd-logind[1020]: New session 479 of user root. May 25 05:07:39 oleg113-client systemd[1]: Started Session 479 of user root. May 25 05:07:39 oleg113-client sshd[92236]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:07:40 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130c: layout intent resend on a stale inode ========================================================== 05:07:38 (1779700058) May 25 05:07:40 oleg113-client sshd[92249]: Received disconnect from 192.168.201.13 port 42754:11: disconnected by user May 25 05:07:40 oleg113-client sshd[92249]: Disconnected from user root 192.168.201.13 port 42754 May 25 05:07:40 oleg113-client sshd[92236]: pam_unix(sshd:session): session closed for user root May 25 05:07:40 oleg113-client systemd[1]: session-479.scope: Succeeded. May 25 05:07:40 oleg113-client systemd-logind[1020]: Session 479 logged out. Waiting for processes to exit. May 25 05:07:40 oleg113-client systemd-logind[1020]: Removed session 479. May 25 05:08:12 oleg113-client sshd[92570]: Accepted publickey for root from 192.168.201.13 port 37208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:08:12 oleg113-client systemd-logind[1020]: New session 480 of user root. May 25 05:08:12 oleg113-client systemd[1]: Started Session 480 of user root. May 25 05:08:12 oleg113-client sshd[92570]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:08:13 oleg113-client sshd[92583]: Received disconnect from 192.168.201.13 port 37208:11: disconnected by user May 25 05:08:13 oleg113-client sshd[92583]: Disconnected from user root 192.168.201.13 port 37208 May 25 05:08:13 oleg113-client sshd[92570]: pam_unix(sshd:session): session closed for user root May 25 05:08:13 oleg113-client systemd-logind[1020]: Session 480 logged out. Waiting for processes to exit. May 25 05:08:13 oleg113-client systemd[1]: session-480.scope: Succeeded. May 25 05:08:13 oleg113-client systemd-logind[1020]: Removed session 480. May 25 05:08:15 oleg113-client sshd[92709]: Accepted publickey for root from 192.168.201.13 port 37214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:08:15 oleg113-client systemd-logind[1020]: New session 481 of user root. May 25 05:08:15 oleg113-client systemd[1]: Started Session 481 of user root. May 25 05:08:15 oleg113-client sshd[92709]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:08:15 oleg113-client sshd[92722]: Received disconnect from 192.168.201.13 port 37214:11: disconnected by user May 25 05:08:15 oleg113-client sshd[92722]: Disconnected from user root 192.168.201.13 port 37214 May 25 05:08:15 oleg113-client sshd[92709]: pam_unix(sshd:session): session closed for user root May 25 05:08:15 oleg113-client systemd[1]: session-481.scope: Succeeded. May 25 05:08:15 oleg113-client systemd-logind[1020]: Session 481 logged out. Waiting for processes to exit. May 25 05:08:15 oleg113-client systemd-logind[1020]: Removed session 481. May 25 05:08:17 oleg113-client sshd[92856]: Accepted publickey for root from 192.168.201.13 port 37224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:08:17 oleg113-client systemd-logind[1020]: New session 482 of user root. May 25 05:08:17 oleg113-client systemd[1]: Started Session 482 of user root. May 25 05:08:17 oleg113-client sshd[92856]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:08:17 oleg113-client sshd[92869]: Received disconnect from 192.168.201.13 port 37224:11: disconnected by user May 25 05:08:17 oleg113-client sshd[92869]: Disconnected from user root 192.168.201.13 port 37224 May 25 05:08:17 oleg113-client sshd[92856]: pam_unix(sshd:session): session closed for user root May 25 05:08:17 oleg113-client systemd[1]: session-482.scope: Succeeded. May 25 05:08:17 oleg113-client systemd-logind[1020]: Session 482 logged out. Waiting for processes to exit. May 25 05:08:17 oleg113-client systemd-logind[1020]: Removed session 482. May 25 05:08:19 oleg113-client sshd[93011]: Accepted publickey for root from 192.168.201.13 port 50946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:08:19 oleg113-client systemd-logind[1020]: New session 483 of user root. May 25 05:08:19 oleg113-client systemd[1]: Started Session 483 of user root. May 25 05:08:20 oleg113-client sshd[93011]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:08:20 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 132: long punch =================== 05:08:18 (1779700098) May 25 05:08:20 oleg113-client sshd[93024]: Received disconnect from 192.168.201.13 port 50946:11: disconnected by user May 25 05:08:20 oleg113-client sshd[93024]: Disconnected from user root 192.168.201.13 port 50946 May 25 05:08:20 oleg113-client sshd[93011]: pam_unix(sshd:session): session closed for user root May 25 05:08:20 oleg113-client systemd-logind[1020]: Session 483 logged out. Waiting for processes to exit. May 25 05:08:20 oleg113-client systemd[1]: session-483.scope: Succeeded. May 25 05:08:20 oleg113-client systemd-logind[1020]: Removed session 483. May 25 05:08:21 oleg113-client systemd-udevd[93080]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:08:21 oleg113-client kernel: Lustre: Mounted lustre-client May 25 05:10:26 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 05:10:26 oleg113-client kernel: LustreError: 93147:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15d1fcf000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:10:26 oleg113-client kernel: LustreError: 93147:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:10:26 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:10:28 oleg113-client sshd[93244]: Accepted publickey for root from 192.168.201.13 port 33864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:28 oleg113-client systemd-logind[1020]: New session 484 of user root. May 25 05:10:28 oleg113-client systemd[1]: Started Session 484 of user root. May 25 05:10:28 oleg113-client sshd[93244]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:28 oleg113-client sshd[93257]: Received disconnect from 192.168.201.13 port 33864:11: disconnected by user May 25 05:10:28 oleg113-client sshd[93257]: Disconnected from user root 192.168.201.13 port 33864 May 25 05:10:28 oleg113-client sshd[93244]: pam_unix(sshd:session): session closed for user root May 25 05:10:28 oleg113-client systemd-logind[1020]: Session 484 logged out. Waiting for processes to exit. May 25 05:10:28 oleg113-client systemd[1]: session-484.scope: Succeeded. May 25 05:10:28 oleg113-client systemd-logind[1020]: Removed session 484. May 25 05:10:30 oleg113-client sshd[93383]: Accepted publickey for root from 192.168.201.13 port 46040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:30 oleg113-client systemd-logind[1020]: New session 485 of user root. May 25 05:10:30 oleg113-client systemd[1]: Started Session 485 of user root. May 25 05:10:30 oleg113-client sshd[93383]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:31 oleg113-client sshd[93396]: Received disconnect from 192.168.201.13 port 46040:11: disconnected by user May 25 05:10:31 oleg113-client sshd[93396]: Disconnected from user root 192.168.201.13 port 46040 May 25 05:10:31 oleg113-client sshd[93383]: pam_unix(sshd:session): session closed for user root May 25 05:10:31 oleg113-client systemd[1]: session-485.scope: Succeeded. May 25 05:10:31 oleg113-client systemd-logind[1020]: Session 485 logged out. Waiting for processes to exit. May 25 05:10:31 oleg113-client systemd-logind[1020]: Removed session 485. May 25 05:10:33 oleg113-client sshd[93530]: Accepted publickey for root from 192.168.201.13 port 46044 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:33 oleg113-client systemd-logind[1020]: New session 486 of user root. May 25 05:10:33 oleg113-client systemd[1]: Started Session 486 of user root. May 25 05:10:33 oleg113-client sshd[93530]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:33 oleg113-client sshd[93543]: Received disconnect from 192.168.201.13 port 46044:11: disconnected by user May 25 05:10:33 oleg113-client sshd[93543]: Disconnected from user root 192.168.201.13 port 46044 May 25 05:10:33 oleg113-client sshd[93530]: pam_unix(sshd:session): session closed for user root May 25 05:10:33 oleg113-client systemd[1]: session-486.scope: Succeeded. May 25 05:10:33 oleg113-client systemd-logind[1020]: Session 486 logged out. Waiting for processes to exit. May 25 05:10:33 oleg113-client systemd-logind[1020]: Removed session 486. May 25 05:10:35 oleg113-client sshd[93685]: Accepted publickey for root from 192.168.201.13 port 46050 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:35 oleg113-client systemd-logind[1020]: New session 487 of user root. May 25 05:10:35 oleg113-client systemd[1]: Started Session 487 of user root. May 25 05:10:35 oleg113-client sshd[93685]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:36 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 131: IO vs evict results to IO under staled lock ========================================================== 05:10:34 (1779700234) May 25 05:10:36 oleg113-client sshd[93698]: Received disconnect from 192.168.201.13 port 46050:11: disconnected by user May 25 05:10:36 oleg113-client sshd[93698]: Disconnected from user root 192.168.201.13 port 46050 May 25 05:10:36 oleg113-client sshd[93685]: pam_unix(sshd:session): session closed for user root May 25 05:10:36 oleg113-client systemd[1]: session-487.scope: Succeeded. May 25 05:10:36 oleg113-client systemd-logind[1020]: Session 487 logged out. Waiting for processes to exit. May 25 05:10:36 oleg113-client systemd-logind[1020]: Removed session 487. May 25 05:10:37 oleg113-client kernel: LustreError: 93769:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 10000ms May 25 05:10:40 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5d000: operation ost_statfs to node 192.168.201.113@tcp failed: rc = -107 May 25 05:10:40 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5d000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:10:40 oleg113-client kernel: LustreError: 93857:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffff9b15c7c5d000: namespace resource [0x280000401:0x2a2d:0x0].0x0 (ffff9b15c46a2600) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:10:41 oleg113-client kernel: LustreError: 93769:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout interrupted May 25 05:10:41 oleg113-client kernel: Lustre: 2420:0:(llite_lib.c:4187:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.201.113@tcp:/lustre/fid: [0x20000bf89:0x9:0x0]// may get corrupted (rc -108) May 25 05:10:42 oleg113-client sshd[93949]: Accepted publickey for root from 192.168.201.13 port 33830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:42 oleg113-client systemd[1]: Started Session 488 of user root. May 25 05:10:42 oleg113-client systemd-logind[1020]: New session 488 of user root. May 25 05:10:42 oleg113-client sshd[93949]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:42 oleg113-client sshd[93962]: Received disconnect from 192.168.201.13 port 33830:11: disconnected by user May 25 05:10:42 oleg113-client sshd[93962]: Disconnected from user root 192.168.201.13 port 33830 May 25 05:10:42 oleg113-client sshd[93949]: pam_unix(sshd:session): session closed for user root May 25 05:10:43 oleg113-client systemd[1]: session-488.scope: Succeeded. May 25 05:10:43 oleg113-client systemd-logind[1020]: Session 488 logged out. Waiting for processes to exit. May 25 05:10:43 oleg113-client systemd-logind[1020]: Removed session 488. May 25 05:10:44 oleg113-client sshd[94088]: Accepted publickey for root from 192.168.201.13 port 33846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:44 oleg113-client systemd-logind[1020]: New session 489 of user root. May 25 05:10:44 oleg113-client systemd[1]: Started Session 489 of user root. May 25 05:10:45 oleg113-client sshd[94088]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:45 oleg113-client sshd[94101]: Received disconnect from 192.168.201.13 port 33846:11: disconnected by user May 25 05:10:45 oleg113-client sshd[94101]: Disconnected from user root 192.168.201.13 port 33846 May 25 05:10:45 oleg113-client sshd[94088]: pam_unix(sshd:session): session closed for user root May 25 05:10:45 oleg113-client systemd[1]: session-489.scope: Succeeded. May 25 05:10:45 oleg113-client systemd-logind[1020]: Session 489 logged out. Waiting for processes to exit. May 25 05:10:45 oleg113-client systemd-logind[1020]: Removed session 489. May 25 05:10:47 oleg113-client sshd[94235]: Accepted publickey for root from 192.168.201.13 port 33858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:47 oleg113-client systemd[1]: Started Session 490 of user root. May 25 05:10:47 oleg113-client systemd-logind[1020]: New session 490 of user root. May 25 05:10:47 oleg113-client sshd[94235]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:48 oleg113-client sshd[94248]: Received disconnect from 192.168.201.13 port 33858:11: disconnected by user May 25 05:10:48 oleg113-client sshd[94248]: Disconnected from user root 192.168.201.13 port 33858 May 25 05:10:48 oleg113-client sshd[94235]: pam_unix(sshd:session): session closed for user root May 25 05:10:48 oleg113-client systemd[1]: session-490.scope: Succeeded. May 25 05:10:48 oleg113-client systemd-logind[1020]: Session 490 logged out. Waiting for processes to exit. May 25 05:10:48 oleg113-client systemd-logind[1020]: Removed session 490. May 25 05:10:50 oleg113-client sshd[94390]: Accepted publickey for root from 192.168.201.13 port 58894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:10:50 oleg113-client systemd-logind[1020]: New session 491 of user root. May 25 05:10:50 oleg113-client systemd[1]: Started Session 491 of user root. May 25 05:10:50 oleg113-client sshd[94390]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:10:51 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 133: don't fail on flock resend === 05:10:48 (1779700248) May 25 05:10:51 oleg113-client sshd[94403]: Received disconnect from 192.168.201.13 port 58894:11: disconnected by user May 25 05:10:51 oleg113-client sshd[94403]: Disconnected from user root 192.168.201.13 port 58894 May 25 05:10:51 oleg113-client sshd[94390]: pam_unix(sshd:session): session closed for user root May 25 05:10:51 oleg113-client systemd[1]: session-491.scope: Succeeded. May 25 05:10:51 oleg113-client systemd-logind[1020]: Session 491 logged out. Waiting for processes to exit. May 25 05:10:51 oleg113-client systemd-logind[1020]: Removed session 491. May 25 05:11:49 oleg113-client kernel: Lustre: 94445:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779700254/real 1779700254] req@ffff9b15c7869880 x1866143510932480/t0(0) o101->lustre-MDT0000-mdc-ffff9b15c7c5d000@192.168.201.113@tcp:12/10 lens 328/344 e 0 to 1 dl 1779700309 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 May 25 05:11:49 oleg113-client kernel: Lustre: 94445:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 4 previous similar messages May 25 05:11:49 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c7c5d000: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:11:49 oleg113-client kernel: Lustre: Skipped 14 previous similar messages May 25 05:11:51 oleg113-client sshd[94606]: Accepted publickey for root from 192.168.201.13 port 38984 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:51 oleg113-client systemd-logind[1020]: New session 492 of user root. May 25 05:11:51 oleg113-client systemd[1]: Started Session 492 of user root. May 25 05:11:51 oleg113-client sshd[94606]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:51 oleg113-client sshd[94619]: Received disconnect from 192.168.201.13 port 38984:11: disconnected by user May 25 05:11:51 oleg113-client sshd[94619]: Disconnected from user root 192.168.201.13 port 38984 May 25 05:11:51 oleg113-client sshd[94606]: pam_unix(sshd:session): session closed for user root May 25 05:11:52 oleg113-client systemd[1]: session-492.scope: Succeeded. May 25 05:11:52 oleg113-client systemd-logind[1020]: Session 492 logged out. Waiting for processes to exit. May 25 05:11:52 oleg113-client systemd-logind[1020]: Removed session 492. May 25 05:11:54 oleg113-client sshd[94745]: Accepted publickey for root from 192.168.201.13 port 38998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:54 oleg113-client systemd-logind[1020]: New session 493 of user root. May 25 05:11:54 oleg113-client systemd[1]: Started Session 493 of user root. May 25 05:11:54 oleg113-client sshd[94745]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:55 oleg113-client sshd[94758]: Received disconnect from 192.168.201.13 port 38998:11: disconnected by user May 25 05:11:55 oleg113-client sshd[94758]: Disconnected from user root 192.168.201.13 port 38998 May 25 05:11:55 oleg113-client sshd[94745]: pam_unix(sshd:session): session closed for user root May 25 05:11:55 oleg113-client systemd[1]: session-493.scope: Succeeded. May 25 05:11:55 oleg113-client systemd-logind[1020]: Session 493 logged out. Waiting for processes to exit. May 25 05:11:55 oleg113-client systemd-logind[1020]: Removed session 493. May 25 05:11:57 oleg113-client sshd[94892]: Accepted publickey for root from 192.168.201.13 port 39014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:11:57 oleg113-client systemd[1]: Started Session 494 of user root. May 25 05:11:57 oleg113-client systemd-logind[1020]: New session 494 of user root. May 25 05:11:57 oleg113-client sshd[94892]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:11:58 oleg113-client sshd[94905]: Received disconnect from 192.168.201.13 port 39014:11: disconnected by user May 25 05:11:58 oleg113-client sshd[94905]: Disconnected from user root 192.168.201.13 port 39014 May 25 05:11:58 oleg113-client sshd[94892]: pam_unix(sshd:session): session closed for user root May 25 05:11:58 oleg113-client systemd[1]: session-494.scope: Succeeded. May 25 05:11:58 oleg113-client systemd-logind[1020]: Session 494 logged out. Waiting for processes to exit. May 25 05:11:58 oleg113-client systemd-logind[1020]: Removed session 494. May 25 05:12:00 oleg113-client sshd[95048]: Accepted publickey for root from 192.168.201.13 port 57146 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:12:00 oleg113-client systemd-logind[1020]: New session 495 of user root. May 25 05:12:00 oleg113-client systemd[1]: Started Session 495 of user root. May 25 05:12:00 oleg113-client sshd[95048]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:12:01 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 134: race between failover and search for reply data free slot ========================================================== 05:11:58 (1779700318) May 25 05:12:01 oleg113-client sshd[95061]: Received disconnect from 192.168.201.13 port 57146:11: disconnected by user May 25 05:12:01 oleg113-client sshd[95061]: Disconnected from user root 192.168.201.13 port 57146 May 25 05:12:01 oleg113-client sshd[95048]: pam_unix(sshd:session): session closed for user root May 25 05:12:01 oleg113-client systemd[1]: session-495.scope: Succeeded. May 25 05:12:01 oleg113-client systemd-logind[1020]: Session 495 logged out. Waiting for processes to exit. May 25 05:12:01 oleg113-client systemd-logind[1020]: Removed session 495. May 25 05:12:03 oleg113-client sshd[95186]: Accepted publickey for root from 192.168.201.13 port 57152 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:12:03 oleg113-client systemd-logind[1020]: New session 496 of user root. May 25 05:12:03 oleg113-client systemd[1]: Started Session 496 of user root. May 25 05:12:03 oleg113-client sshd[95186]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:12:03 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_134 Need 2+ clients, have 1 May 25 05:12:03 oleg113-client sshd[95199]: Received disconnect from 192.168.201.13 port 57152:11: disconnected by user May 25 05:12:03 oleg113-client sshd[95199]: Disconnected from user root 192.168.201.13 port 57152 May 25 05:12:03 oleg113-client sshd[95186]: pam_unix(sshd:session): session closed for user root May 25 05:12:04 oleg113-client systemd-logind[1020]: Session 496 logged out. Waiting for processes to exit. May 25 05:12:04 oleg113-client systemd[1]: session-496.scope: Succeeded. May 25 05:12:04 oleg113-client systemd-logind[1020]: Removed session 496. May 25 05:12:05 oleg113-client sshd[95341]: Accepted publickey for root from 192.168.201.13 port 57156 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:12:05 oleg113-client systemd-logind[1020]: New session 497 of user root. May 25 05:12:05 oleg113-client systemd[1]: Started Session 497 of user root. May 25 05:12:05 oleg113-client sshd[95341]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:12:05 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 135: DOM: open/create resend to return size ========================================================== 05:12:04 (1779700324) May 25 05:12:05 oleg113-client sshd[95354]: Received disconnect from 192.168.201.13 port 57156:11: disconnected by user May 25 05:12:05 oleg113-client sshd[95354]: Disconnected from user root 192.168.201.13 port 57156 May 25 05:12:05 oleg113-client sshd[95341]: pam_unix(sshd:session): session closed for user root May 25 05:12:06 oleg113-client systemd-logind[1020]: Session 497 logged out. Waiting for processes to exit. May 25 05:12:06 oleg113-client systemd[1]: session-497.scope: Succeeded. May 25 05:12:06 oleg113-client systemd-logind[1020]: Removed session 497. May 25 05:13:06 oleg113-client sshd[95554]: Accepted publickey for root from 192.168.201.13 port 34288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:06 oleg113-client systemd-logind[1020]: New session 498 of user root. May 25 05:13:06 oleg113-client systemd[1]: Started Session 498 of user root. May 25 05:13:06 oleg113-client sshd[95554]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:06 oleg113-client sshd[95567]: Received disconnect from 192.168.201.13 port 34288:11: disconnected by user May 25 05:13:06 oleg113-client sshd[95567]: Disconnected from user root 192.168.201.13 port 34288 May 25 05:13:07 oleg113-client sshd[95554]: pam_unix(sshd:session): session closed for user root May 25 05:13:07 oleg113-client systemd[1]: session-498.scope: Succeeded. May 25 05:13:07 oleg113-client systemd-logind[1020]: Session 498 logged out. Waiting for processes to exit. May 25 05:13:07 oleg113-client systemd-logind[1020]: Removed session 498. May 25 05:13:10 oleg113-client sshd[95693]: Accepted publickey for root from 192.168.201.13 port 43446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:10 oleg113-client systemd-logind[1020]: New session 499 of user root. May 25 05:13:10 oleg113-client systemd[1]: Started Session 499 of user root. May 25 05:13:10 oleg113-client sshd[95693]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:10 oleg113-client sshd[95707]: Received disconnect from 192.168.201.13 port 43446:11: disconnected by user May 25 05:13:10 oleg113-client sshd[95707]: Disconnected from user root 192.168.201.13 port 43446 May 25 05:13:10 oleg113-client sshd[95693]: pam_unix(sshd:session): session closed for user root May 25 05:13:11 oleg113-client systemd[1]: session-499.scope: Succeeded. May 25 05:13:11 oleg113-client systemd-logind[1020]: Session 499 logged out. Waiting for processes to exit. May 25 05:13:11 oleg113-client systemd-logind[1020]: Removed session 499. May 25 05:13:12 oleg113-client sshd[95840]: Accepted publickey for root from 192.168.201.13 port 43450 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:12 oleg113-client systemd[1]: Started Session 500 of user root. May 25 05:13:12 oleg113-client systemd-logind[1020]: New session 500 of user root. May 25 05:13:12 oleg113-client sshd[95840]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:13 oleg113-client sshd[95853]: Received disconnect from 192.168.201.13 port 43450:11: disconnected by user May 25 05:13:13 oleg113-client sshd[95853]: Disconnected from user root 192.168.201.13 port 43450 May 25 05:13:13 oleg113-client sshd[95840]: pam_unix(sshd:session): session closed for user root May 25 05:13:13 oleg113-client systemd-logind[1020]: Session 500 logged out. Waiting for processes to exit. May 25 05:13:13 oleg113-client systemd[1]: session-500.scope: Succeeded. May 25 05:13:13 oleg113-client systemd-logind[1020]: Removed session 500. May 25 05:13:15 oleg113-client sshd[95985]: Accepted publickey for root from 192.168.201.13 port 43462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:15 oleg113-client systemd-logind[1020]: New session 501 of user root. May 25 05:13:15 oleg113-client systemd[1]: Started Session 501 of user root. May 25 05:13:15 oleg113-client sshd[95985]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:16 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_136 skipping excluded test 136 May 25 05:13:16 oleg113-client sshd[95998]: Received disconnect from 192.168.201.13 port 43462:11: disconnected by user May 25 05:13:16 oleg113-client sshd[95998]: Disconnected from user root 192.168.201.13 port 43462 May 25 05:13:16 oleg113-client sshd[95985]: pam_unix(sshd:session): session closed for user root May 25 05:13:16 oleg113-client systemd[1]: session-501.scope: Succeeded. May 25 05:13:16 oleg113-client systemd-logind[1020]: Session 501 logged out. Waiting for processes to exit. May 25 05:13:16 oleg113-client systemd-logind[1020]: Removed session 501. May 25 05:13:18 oleg113-client sshd[96137]: Accepted publickey for root from 192.168.201.13 port 43468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:18 oleg113-client systemd-logind[1020]: New session 502 of user root. May 25 05:13:18 oleg113-client systemd[1]: Started Session 502 of user root. May 25 05:13:19 oleg113-client sshd[96137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:19 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 137: late resend must be skipped if already applied ========================================================== 05:13:16 (1779700396) May 25 05:13:19 oleg113-client sshd[96150]: Received disconnect from 192.168.201.13 port 43468:11: disconnected by user May 25 05:13:19 oleg113-client sshd[96150]: Disconnected from user root 192.168.201.13 port 43468 May 25 05:13:19 oleg113-client sshd[96137]: pam_unix(sshd:session): session closed for user root May 25 05:13:19 oleg113-client systemd-logind[1020]: Session 502 logged out. Waiting for processes to exit. May 25 05:13:19 oleg113-client systemd[1]: session-502.scope: Succeeded. May 25 05:13:20 oleg113-client systemd-logind[1020]: Removed session 502. May 25 05:13:35 oleg113-client sshd[96299]: Accepted publickey for root from 192.168.201.13 port 35250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:35 oleg113-client systemd-logind[1020]: New session 503 of user root. May 25 05:13:35 oleg113-client systemd[1]: Started Session 503 of user root. May 25 05:13:35 oleg113-client sshd[96299]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:36 oleg113-client sshd[96312]: Received disconnect from 192.168.201.13 port 35250:11: disconnected by user May 25 05:13:36 oleg113-client sshd[96312]: Disconnected from user root 192.168.201.13 port 35250 May 25 05:13:36 oleg113-client sshd[96299]: pam_unix(sshd:session): session closed for user root May 25 05:13:36 oleg113-client systemd-logind[1020]: Session 503 logged out. Waiting for processes to exit. May 25 05:13:36 oleg113-client systemd[1]: session-503.scope: Succeeded. May 25 05:13:36 oleg113-client systemd-logind[1020]: Removed session 503. May 25 05:13:38 oleg113-client sshd[96438]: Accepted publickey for root from 192.168.201.13 port 35252 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:38 oleg113-client systemd[1]: Started Session 504 of user root. May 25 05:13:38 oleg113-client systemd-logind[1020]: New session 504 of user root. May 25 05:13:38 oleg113-client sshd[96438]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:39 oleg113-client sshd[96451]: Received disconnect from 192.168.201.13 port 35252:11: disconnected by user May 25 05:13:39 oleg113-client sshd[96451]: Disconnected from user root 192.168.201.13 port 35252 May 25 05:13:39 oleg113-client sshd[96438]: pam_unix(sshd:session): session closed for user root May 25 05:13:39 oleg113-client systemd[1]: session-504.scope: Succeeded. May 25 05:13:39 oleg113-client systemd-logind[1020]: Session 504 logged out. Waiting for processes to exit. May 25 05:13:39 oleg113-client systemd-logind[1020]: Removed session 504. May 25 05:13:41 oleg113-client sshd[96585]: Accepted publickey for root from 192.168.201.13 port 46038 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:13:41 oleg113-client systemd-logind[1020]: New session 505 of user root. May 25 05:13:41 oleg113-client systemd[1]: Started Session 505 of user root. May 25 05:13:41 oleg113-client sshd[96585]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:13:41 oleg113-client sshd[96598]: Received disconnect from 192.168.201.13 port 46038:11: disconnected by user May 25 05:13:41 oleg113-client sshd[96598]: Disconnected from user root 192.168.201.13 port 46038 May 25 05:13:41 oleg113-client sshd[96585]: pam_unix(sshd:session): session closed for user root May 25 05:13:42 oleg113-client systemd[1]: session-505.scope: Succeeded. May 25 05:13:42 oleg113-client systemd-logind[1020]: Session 505 logged out. Waiting for processes to exit. May 25 05:13:42 oleg113-client systemd-logind[1020]: Removed session 505. May 25 05:14:16 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c7c5d000: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 05:14:16 oleg113-client kernel: Lustre: Skipped 14 previous similar messages May 25 05:14:18 oleg113-client sshd[96747]: Accepted publickey for root from 192.168.201.13 port 43482 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:14:18 oleg113-client systemd-logind[1020]: New session 506 of user root. May 25 05:14:18 oleg113-client systemd[1]: Started Session 506 of user root. May 25 05:14:18 oleg113-client sshd[96747]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:14:18 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 138: Umount MDT during recovery === 05:14:16 (1779700456) May 25 05:14:18 oleg113-client sshd[96760]: Received disconnect from 192.168.201.13 port 43482:11: disconnected by user May 25 05:14:18 oleg113-client sshd[96760]: Disconnected from user root 192.168.201.13 port 43482 May 25 05:14:18 oleg113-client sshd[96747]: pam_unix(sshd:session): session closed for user root May 25 05:14:18 oleg113-client systemd[1]: session-506.scope: Succeeded. May 25 05:14:18 oleg113-client systemd-logind[1020]: Session 506 logged out. Waiting for processes to exit. May 25 05:14:18 oleg113-client systemd-logind[1020]: Removed session 506. May 25 05:14:22 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:14:23 oleg113-client kernel: LustreError: 96840:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c7c5d000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:14:23 oleg113-client kernel: LustreError: 96840:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:14:23 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:16:47 oleg113-client systemd-udevd[97381]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:16:47 oleg113-client kernel: Lustre: Mounted lustre-client May 25 05:16:49 oleg113-client sshd[97489]: Accepted publickey for root from 192.168.201.13 port 58126 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:49 oleg113-client systemd-logind[1020]: New session 507 of user root. May 25 05:16:49 oleg113-client systemd[1]: Started Session 507 of user root. May 25 05:16:49 oleg113-client sshd[97489]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:49 oleg113-client sshd[97502]: Received disconnect from 192.168.201.13 port 58126:11: disconnected by user May 25 05:16:49 oleg113-client sshd[97502]: Disconnected from user root 192.168.201.13 port 58126 May 25 05:16:49 oleg113-client sshd[97489]: pam_unix(sshd:session): session closed for user root May 25 05:16:50 oleg113-client systemd[1]: session-507.scope: Succeeded. May 25 05:16:50 oleg113-client systemd-logind[1020]: Session 507 logged out. Waiting for processes to exit. May 25 05:16:50 oleg113-client systemd-logind[1020]: Removed session 507. May 25 05:16:50 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:16:51 oleg113-client sshd[97630]: Accepted publickey for root from 192.168.201.13 port 58870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:51 oleg113-client systemd-logind[1020]: New session 508 of user root. May 25 05:16:51 oleg113-client systemd[1]: Started Session 508 of user root. May 25 05:16:51 oleg113-client sshd[97630]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:51 oleg113-client sshd[97643]: Received disconnect from 192.168.201.13 port 58870:11: disconnected by user May 25 05:16:51 oleg113-client sshd[97643]: Disconnected from user root 192.168.201.13 port 58870 May 25 05:16:51 oleg113-client sshd[97630]: pam_unix(sshd:session): session closed for user root May 25 05:16:51 oleg113-client systemd-logind[1020]: Session 508 logged out. Waiting for processes to exit. May 25 05:16:51 oleg113-client systemd[1]: session-508.scope: Succeeded. May 25 05:16:51 oleg113-client systemd-logind[1020]: Removed session 508. May 25 05:16:53 oleg113-client sshd[97776]: Accepted publickey for root from 192.168.201.13 port 58876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:53 oleg113-client systemd-logind[1020]: New session 509 of user root. May 25 05:16:53 oleg113-client systemd[1]: Started Session 509 of user root. May 25 05:16:53 oleg113-client sshd[97776]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:53 oleg113-client sshd[97789]: Received disconnect from 192.168.201.13 port 58876:11: disconnected by user May 25 05:16:53 oleg113-client sshd[97789]: Disconnected from user root 192.168.201.13 port 58876 May 25 05:16:53 oleg113-client sshd[97776]: pam_unix(sshd:session): session closed for user root May 25 05:16:53 oleg113-client systemd[1]: session-509.scope: Succeeded. May 25 05:16:53 oleg113-client systemd-logind[1020]: Session 509 logged out. Waiting for processes to exit. May 25 05:16:53 oleg113-client systemd-logind[1020]: Removed session 509. May 25 05:16:55 oleg113-client sshd[97933]: Accepted publickey for root from 192.168.201.13 port 58884 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:16:55 oleg113-client systemd-logind[1020]: New session 510 of user root. May 25 05:16:55 oleg113-client systemd[1]: Started Session 510 of user root. May 25 05:16:55 oleg113-client sshd[97933]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:16:56 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 139: corrupted catid won't cause crash ========================================================== 05:16:54 (1779700614) May 25 05:16:56 oleg113-client sshd[97946]: Received disconnect from 192.168.201.13 port 58884:11: disconnected by user May 25 05:16:56 oleg113-client sshd[97946]: Disconnected from user root 192.168.201.13 port 58884 May 25 05:16:56 oleg113-client sshd[97933]: pam_unix(sshd:session): session closed for user root May 25 05:16:56 oleg113-client systemd[1]: session-510.scope: Succeeded. May 25 05:16:56 oleg113-client systemd-logind[1020]: Session 510 logged out. Waiting for processes to exit. May 25 05:16:56 oleg113-client systemd-logind[1020]: Removed session 510. May 25 05:17:13 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:17:13 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 05:17:13 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b415d2ee to 0x58062bb2b415d52c May 25 05:17:13 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 05:17:22 oleg113-client sshd[98294]: Accepted publickey for root from 192.168.201.13 port 49248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:22 oleg113-client systemd-logind[1020]: New session 511 of user root. May 25 05:17:22 oleg113-client systemd[1]: Started Session 511 of user root. May 25 05:17:22 oleg113-client sshd[98294]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:23 oleg113-client sshd[98307]: Received disconnect from 192.168.201.13 port 49248:11: disconnected by user May 25 05:17:23 oleg113-client sshd[98307]: Disconnected from user root 192.168.201.13 port 49248 May 25 05:17:23 oleg113-client sshd[98294]: pam_unix(sshd:session): session closed for user root May 25 05:17:23 oleg113-client systemd[1]: session-511.scope: Succeeded. May 25 05:17:23 oleg113-client systemd-logind[1020]: Session 511 logged out. Waiting for processes to exit. May 25 05:17:23 oleg113-client systemd-logind[1020]: Removed session 511. May 25 05:17:24 oleg113-client sshd[98433]: Accepted publickey for root from 192.168.201.13 port 49258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:24 oleg113-client systemd-logind[1020]: New session 512 of user root. May 25 05:17:24 oleg113-client systemd[1]: Started Session 512 of user root. May 25 05:17:24 oleg113-client sshd[98433]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:25 oleg113-client sshd[98446]: Received disconnect from 192.168.201.13 port 49258:11: disconnected by user May 25 05:17:25 oleg113-client sshd[98446]: Disconnected from user root 192.168.201.13 port 49258 May 25 05:17:25 oleg113-client sshd[98433]: pam_unix(sshd:session): session closed for user root May 25 05:17:25 oleg113-client systemd[1]: session-512.scope: Succeeded. May 25 05:17:25 oleg113-client systemd-logind[1020]: Session 512 logged out. Waiting for processes to exit. May 25 05:17:25 oleg113-client systemd-logind[1020]: Removed session 512. May 25 05:17:27 oleg113-client sshd[98580]: Accepted publickey for root from 192.168.201.13 port 49272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:27 oleg113-client systemd-logind[1020]: New session 513 of user root. May 25 05:17:27 oleg113-client systemd[1]: Started Session 513 of user root. May 25 05:17:27 oleg113-client sshd[98580]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:28 oleg113-client sshd[98593]: Received disconnect from 192.168.201.13 port 49272:11: disconnected by user May 25 05:17:28 oleg113-client sshd[98593]: Disconnected from user root 192.168.201.13 port 49272 May 25 05:17:28 oleg113-client sshd[98580]: pam_unix(sshd:session): session closed for user root May 25 05:17:28 oleg113-client systemd[1]: session-513.scope: Succeeded. May 25 05:17:28 oleg113-client systemd-logind[1020]: Session 513 logged out. Waiting for processes to exit. May 25 05:17:28 oleg113-client systemd-logind[1020]: Removed session 513. May 25 05:17:31 oleg113-client sshd[98735]: Accepted publickey for root from 192.168.201.13 port 43344 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:17:31 oleg113-client systemd-logind[1020]: New session 514 of user root. May 25 05:17:31 oleg113-client systemd[1]: Started Session 514 of user root. May 25 05:17:31 oleg113-client sshd[98735]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:17:31 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140a: local mount is flagged properly ========================================================== 05:17:28 (1779700648) May 25 05:17:31 oleg113-client sshd[98748]: Received disconnect from 192.168.201.13 port 43344:11: disconnected by user May 25 05:17:31 oleg113-client sshd[98748]: Disconnected from user root 192.168.201.13 port 43344 May 25 05:17:31 oleg113-client sshd[98735]: pam_unix(sshd:session): session closed for user root May 25 05:17:32 oleg113-client systemd-logind[1020]: Session 514 logged out. Waiting for processes to exit. May 25 05:17:32 oleg113-client systemd[1]: session-514.scope: Succeeded. May 25 05:17:32 oleg113-client systemd-logind[1020]: Removed session 514. May 25 05:18:17 oleg113-client sshd[99091]: Accepted publickey for root from 192.168.201.13 port 45868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:17 oleg113-client systemd-logind[1020]: New session 515 of user root. May 25 05:18:17 oleg113-client systemd[1]: Started Session 515 of user root. May 25 05:18:17 oleg113-client sshd[99091]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:17 oleg113-client sshd[99104]: Received disconnect from 192.168.201.13 port 45868:11: disconnected by user May 25 05:18:17 oleg113-client sshd[99104]: Disconnected from user root 192.168.201.13 port 45868 May 25 05:18:17 oleg113-client sshd[99091]: pam_unix(sshd:session): session closed for user root May 25 05:18:17 oleg113-client systemd[1]: session-515.scope: Succeeded. May 25 05:18:17 oleg113-client systemd-logind[1020]: Session 515 logged out. Waiting for processes to exit. May 25 05:18:17 oleg113-client systemd-logind[1020]: Removed session 515. May 25 05:18:19 oleg113-client sshd[99231]: Accepted publickey for root from 192.168.201.13 port 48702 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:19 oleg113-client systemd-logind[1020]: New session 516 of user root. May 25 05:18:19 oleg113-client systemd[1]: Started Session 516 of user root. May 25 05:18:19 oleg113-client sshd[99231]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:20 oleg113-client sshd[99244]: Received disconnect from 192.168.201.13 port 48702:11: disconnected by user May 25 05:18:20 oleg113-client sshd[99244]: Disconnected from user root 192.168.201.13 port 48702 May 25 05:18:20 oleg113-client sshd[99231]: pam_unix(sshd:session): session closed for user root May 25 05:18:20 oleg113-client systemd[1]: session-516.scope: Succeeded. May 25 05:18:20 oleg113-client systemd-logind[1020]: Session 516 logged out. Waiting for processes to exit. May 25 05:18:20 oleg113-client systemd-logind[1020]: Removed session 516. May 25 05:18:22 oleg113-client sshd[99377]: Accepted publickey for root from 192.168.201.13 port 48714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:22 oleg113-client systemd-logind[1020]: New session 517 of user root. May 25 05:18:22 oleg113-client systemd[1]: Started Session 517 of user root. May 25 05:18:22 oleg113-client sshd[99377]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:22 oleg113-client sshd[99390]: Received disconnect from 192.168.201.13 port 48714:11: disconnected by user May 25 05:18:22 oleg113-client sshd[99390]: Disconnected from user root 192.168.201.13 port 48714 May 25 05:18:22 oleg113-client sshd[99377]: pam_unix(sshd:session): session closed for user root May 25 05:18:23 oleg113-client systemd[1]: session-517.scope: Succeeded. May 25 05:18:23 oleg113-client systemd-logind[1020]: Session 517 logged out. Waiting for processes to exit. May 25 05:18:23 oleg113-client systemd-logind[1020]: Removed session 517. May 25 05:18:26 oleg113-client sshd[99541]: Accepted publickey for root from 192.168.201.13 port 48718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:18:26 oleg113-client systemd-logind[1020]: New session 518 of user root. May 25 05:18:26 oleg113-client systemd[1]: Started Session 518 of user root. May 25 05:18:26 oleg113-client sshd[99541]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:18:27 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140b: local mount is excluded from recovery ========================================================== 05:18:24 (1779700704) May 25 05:18:27 oleg113-client sshd[99554]: Received disconnect from 192.168.201.13 port 48718:11: disconnected by user May 25 05:18:27 oleg113-client sshd[99554]: Disconnected from user root 192.168.201.13 port 48718 May 25 05:18:27 oleg113-client sshd[99541]: pam_unix(sshd:session): session closed for user root May 25 05:18:27 oleg113-client systemd[1]: session-518.scope: Succeeded. May 25 05:18:27 oleg113-client systemd-logind[1020]: Session 518 logged out. Waiting for processes to exit. May 25 05:18:27 oleg113-client systemd-logind[1020]: Removed session 518. May 25 05:18:49 oleg113-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 05:19:22 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:19:32 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b415d52c to 0x58062bb2b415d9cb May 25 05:19:34 oleg113-client kernel: Lustre: 97370:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 05:19:55 oleg113-client sshd[100092]: Accepted publickey for root from 192.168.201.13 port 47924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:19:56 oleg113-client systemd-logind[1020]: New session 519 of user root. May 25 05:19:56 oleg113-client systemd[1]: Started Session 519 of user root. May 25 05:19:56 oleg113-client sshd[100092]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:19:56 oleg113-client sshd[100106]: Received disconnect from 192.168.201.13 port 47924:11: disconnected by user May 25 05:19:56 oleg113-client sshd[100106]: Disconnected from user root 192.168.201.13 port 47924 May 25 05:19:56 oleg113-client sshd[100092]: pam_unix(sshd:session): session closed for user root May 25 05:19:57 oleg113-client systemd[1]: session-519.scope: Succeeded. May 25 05:19:57 oleg113-client systemd-logind[1020]: Session 519 logged out. Waiting for processes to exit. May 25 05:19:57 oleg113-client systemd-logind[1020]: Removed session 519. May 25 05:20:02 oleg113-client sshd[100329]: Accepted publickey for root from 192.168.201.13 port 56436 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:02 oleg113-client systemd[1]: Started Session 520 of user root. May 25 05:20:02 oleg113-client systemd-logind[1020]: New session 520 of user root. May 25 05:20:02 oleg113-client sshd[100329]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:02 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 05:20:02 oleg113-client sshd[100342]: Received disconnect from 192.168.201.13 port 56436:11: disconnected by user May 25 05:20:02 oleg113-client sshd[100342]: Disconnected from user root 192.168.201.13 port 56436 May 25 05:20:02 oleg113-client sshd[100329]: pam_unix(sshd:session): session closed for user root May 25 05:20:03 oleg113-client systemd[1]: session-520.scope: Succeeded. May 25 05:20:03 oleg113-client systemd-logind[1020]: Session 520 logged out. Waiting for processes to exit. May 25 05:20:03 oleg113-client systemd-logind[1020]: Removed session 520. May 25 05:20:04 oleg113-client sshd[100485]: Accepted publickey for root from 192.168.201.13 port 56450 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:04 oleg113-client systemd-logind[1020]: New session 521 of user root. May 25 05:20:04 oleg113-client systemd[1]: Started Session 521 of user root. May 25 05:20:04 oleg113-client sshd[100485]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:04 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 05:20:04 oleg113-client sshd[100498]: Received disconnect from 192.168.201.13 port 56450:11: disconnected by user May 25 05:20:04 oleg113-client sshd[100498]: Disconnected from user root 192.168.201.13 port 56450 May 25 05:20:04 oleg113-client sshd[100485]: pam_unix(sshd:session): session closed for user root May 25 05:20:04 oleg113-client systemd[1]: session-521.scope: Succeeded. May 25 05:20:04 oleg113-client systemd-logind[1020]: Session 521 logged out. Waiting for processes to exit. May 25 05:20:05 oleg113-client systemd-logind[1020]: Removed session 521. May 25 05:20:06 oleg113-client sshd[100540]: Accepted publickey for root from 192.168.201.13 port 56466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:06 oleg113-client systemd[1]: Started Session 522 of user root. May 25 05:20:06 oleg113-client systemd-logind[1020]: New session 522 of user root. May 25 05:20:06 oleg113-client sshd[100540]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:06 oleg113-client sshd[100554]: Received disconnect from 192.168.201.13 port 56466:11: disconnected by user May 25 05:20:06 oleg113-client sshd[100554]: Disconnected from user root 192.168.201.13 port 56466 May 25 05:20:06 oleg113-client sshd[100540]: pam_unix(sshd:session): session closed for user root May 25 05:20:07 oleg113-client systemd[1]: session-522.scope: Succeeded. May 25 05:20:07 oleg113-client systemd-logind[1020]: Session 522 logged out. Waiting for processes to exit. May 25 05:20:07 oleg113-client systemd-logind[1020]: Removed session 522. May 25 05:20:09 oleg113-client sshd[100687]: Accepted publickey for root from 192.168.201.13 port 54108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:09 oleg113-client systemd-logind[1020]: New session 523 of user root. May 25 05:20:09 oleg113-client systemd[1]: Started Session 523 of user root. May 25 05:20:09 oleg113-client sshd[100687]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:10 oleg113-client sshd[100700]: Received disconnect from 192.168.201.13 port 54108:11: disconnected by user May 25 05:20:10 oleg113-client sshd[100700]: Disconnected from user root 192.168.201.13 port 54108 May 25 05:20:10 oleg113-client sshd[100687]: pam_unix(sshd:session): session closed for user root May 25 05:20:10 oleg113-client systemd[1]: session-523.scope: Succeeded. May 25 05:20:10 oleg113-client systemd-logind[1020]: Session 523 logged out. Waiting for processes to exit. May 25 05:20:10 oleg113-client systemd-logind[1020]: Removed session 523. May 25 05:20:11 oleg113-client sshd[100827]: Accepted publickey for root from 192.168.201.13 port 54114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:11 oleg113-client systemd-logind[1020]: New session 524 of user root. May 25 05:20:11 oleg113-client systemd[1]: Started Session 524 of user root. May 25 05:20:11 oleg113-client sshd[100827]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:12 oleg113-client sshd[100840]: Received disconnect from 192.168.201.13 port 54114:11: disconnected by user May 25 05:20:12 oleg113-client sshd[100840]: Disconnected from user root 192.168.201.13 port 54114 May 25 05:20:12 oleg113-client sshd[100827]: pam_unix(sshd:session): session closed for user root May 25 05:20:12 oleg113-client systemd-logind[1020]: Session 524 logged out. Waiting for processes to exit. May 25 05:20:12 oleg113-client systemd[1]: session-524.scope: Succeeded. May 25 05:20:12 oleg113-client systemd-logind[1020]: Removed session 524. May 25 05:20:14 oleg113-client sshd[100973]: Accepted publickey for root from 192.168.201.13 port 54130 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:14 oleg113-client systemd-logind[1020]: New session 525 of user root. May 25 05:20:14 oleg113-client systemd[1]: Started Session 525 of user root. May 25 05:20:14 oleg113-client sshd[100973]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:15 oleg113-client sshd[100986]: Received disconnect from 192.168.201.13 port 54130:11: disconnected by user May 25 05:20:15 oleg113-client sshd[100986]: Disconnected from user root 192.168.201.13 port 54130 May 25 05:20:15 oleg113-client sshd[100973]: pam_unix(sshd:session): session closed for user root May 25 05:20:15 oleg113-client systemd[1]: session-525.scope: Succeeded. May 25 05:20:15 oleg113-client systemd-logind[1020]: Session 525 logged out. Waiting for processes to exit. May 25 05:20:16 oleg113-client systemd-logind[1020]: Removed session 525. May 25 05:20:19 oleg113-client sshd[101137]: Accepted publickey for root from 192.168.201.13 port 36922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:19 oleg113-client systemd-logind[1020]: New session 526 of user root. May 25 05:20:19 oleg113-client systemd[1]: Started Session 526 of user root. May 25 05:20:19 oleg113-client sshd[101137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:20 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 141: do not lose locks on MGS restart ========================================================== 05:20:17 (1779700817) May 25 05:20:20 oleg113-client sshd[101150]: Received disconnect from 192.168.201.13 port 36922:11: disconnected by user May 25 05:20:20 oleg113-client sshd[101150]: Disconnected from user root 192.168.201.13 port 36922 May 25 05:20:20 oleg113-client sshd[101137]: pam_unix(sshd:session): session closed for user root May 25 05:20:20 oleg113-client systemd[1]: session-526.scope: Succeeded. May 25 05:20:20 oleg113-client systemd-logind[1020]: Session 526 logged out. Waiting for processes to exit. May 25 05:20:20 oleg113-client systemd-logind[1020]: Removed session 526. May 25 05:20:23 oleg113-client sshd[101403]: Accepted publickey for root from 192.168.201.13 port 36932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:24 oleg113-client systemd-logind[1020]: New session 527 of user root. May 25 05:20:24 oleg113-client systemd[1]: Started Session 527 of user root. May 25 05:20:24 oleg113-client sshd[101403]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:24 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_141 cannot run in local mode or from build tree May 25 05:20:24 oleg113-client sshd[101416]: Received disconnect from 192.168.201.13 port 36932:11: disconnected by user May 25 05:20:24 oleg113-client sshd[101416]: Disconnected from user root 192.168.201.13 port 36932 May 25 05:20:24 oleg113-client sshd[101403]: pam_unix(sshd:session): session closed for user root May 25 05:20:24 oleg113-client systemd-logind[1020]: Session 527 logged out. Waiting for processes to exit. May 25 05:20:24 oleg113-client systemd[1]: session-527.scope: Succeeded. May 25 05:20:24 oleg113-client systemd-logind[1020]: Removed session 527. May 25 05:20:26 oleg113-client sshd[101558]: Accepted publickey for root from 192.168.201.13 port 36948 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:20:26 oleg113-client systemd[1]: Started Session 528 of user root. May 25 05:20:26 oleg113-client systemd-logind[1020]: New session 528 of user root. May 25 05:20:26 oleg113-client sshd[101558]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:20:27 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 142: orphan name stub can be cleaned up in startup ========================================================== 05:20:25 (1779700825) May 25 05:20:27 oleg113-client sshd[101571]: Received disconnect from 192.168.201.13 port 36948:11: disconnected by user May 25 05:20:27 oleg113-client sshd[101571]: Disconnected from user root 192.168.201.13 port 36948 May 25 05:20:27 oleg113-client sshd[101558]: pam_unix(sshd:session): session closed for user root May 25 05:20:27 oleg113-client systemd[1]: session-528.scope: Succeeded. May 25 05:20:27 oleg113-client systemd-logind[1020]: Session 528 logged out. Waiting for processes to exit. May 25 05:20:27 oleg113-client systemd-logind[1020]: Removed session 528. May 25 05:21:02 oleg113-client sshd[101929]: Accepted publickey for root from 192.168.201.13 port 42314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:02 oleg113-client systemd-logind[1020]: New session 529 of user root. May 25 05:21:02 oleg113-client systemd[1]: Started Session 529 of user root. May 25 05:21:02 oleg113-client sshd[101929]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:02 oleg113-client sshd[101942]: Received disconnect from 192.168.201.13 port 42314:11: disconnected by user May 25 05:21:02 oleg113-client sshd[101942]: Disconnected from user root 192.168.201.13 port 42314 May 25 05:21:02 oleg113-client sshd[101929]: pam_unix(sshd:session): session closed for user root May 25 05:21:03 oleg113-client systemd[1]: session-529.scope: Succeeded. May 25 05:21:03 oleg113-client systemd-logind[1020]: Session 529 logged out. Waiting for processes to exit. May 25 05:21:03 oleg113-client systemd-logind[1020]: Removed session 529. May 25 05:21:04 oleg113-client sshd[102069]: Accepted publickey for root from 192.168.201.13 port 42318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:04 oleg113-client systemd-logind[1020]: New session 530 of user root. May 25 05:21:04 oleg113-client systemd[1]: Started Session 530 of user root. May 25 05:21:04 oleg113-client sshd[102069]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:05 oleg113-client sshd[102082]: Received disconnect from 192.168.201.13 port 42318:11: disconnected by user May 25 05:21:05 oleg113-client sshd[102082]: Disconnected from user root 192.168.201.13 port 42318 May 25 05:21:05 oleg113-client sshd[102069]: pam_unix(sshd:session): session closed for user root May 25 05:21:05 oleg113-client systemd[1]: session-530.scope: Succeeded. May 25 05:21:05 oleg113-client systemd-logind[1020]: Session 530 logged out. Waiting for processes to exit. May 25 05:21:05 oleg113-client systemd-logind[1020]: Removed session 530. May 25 05:21:06 oleg113-client sshd[102215]: Accepted publickey for root from 192.168.201.13 port 42330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:06 oleg113-client systemd-logind[1020]: New session 531 of user root. May 25 05:21:06 oleg113-client systemd[1]: Started Session 531 of user root. May 25 05:21:06 oleg113-client sshd[102215]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:07 oleg113-client sshd[102228]: Received disconnect from 192.168.201.13 port 42330:11: disconnected by user May 25 05:21:07 oleg113-client sshd[102228]: Disconnected from user root 192.168.201.13 port 42330 May 25 05:21:07 oleg113-client sshd[102215]: pam_unix(sshd:session): session closed for user root May 25 05:21:07 oleg113-client systemd[1]: session-531.scope: Succeeded. May 25 05:21:07 oleg113-client systemd-logind[1020]: Session 531 logged out. Waiting for processes to exit. May 25 05:21:07 oleg113-client systemd-logind[1020]: Removed session 531. May 25 05:21:09 oleg113-client sshd[102371]: Accepted publickey for root from 192.168.201.13 port 50756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:09 oleg113-client systemd-logind[1020]: New session 532 of user root. May 25 05:21:09 oleg113-client systemd[1]: Started Session 532 of user root. May 25 05:21:09 oleg113-client sshd[102371]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:10 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 143: orphan cleanup thread shouldn't be blocked even delete failed ========================================================== 05:21:07 (1779700867) May 25 05:21:10 oleg113-client sshd[102384]: Received disconnect from 192.168.201.13 port 50756:11: disconnected by user May 25 05:21:10 oleg113-client sshd[102384]: Disconnected from user root 192.168.201.13 port 50756 May 25 05:21:10 oleg113-client sshd[102371]: pam_unix(sshd:session): session closed for user root May 25 05:21:10 oleg113-client systemd[1]: session-532.scope: Succeeded. May 25 05:21:10 oleg113-client systemd-logind[1020]: Session 532 logged out. Waiting for processes to exit. May 25 05:21:10 oleg113-client systemd-logind[1020]: Removed session 532. May 25 05:21:30 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:21:30 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 05:21:59 oleg113-client sshd[102862]: Accepted publickey for root from 192.168.201.13 port 51078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:21:59 oleg113-client systemd-logind[1020]: New session 533 of user root. May 25 05:21:59 oleg113-client systemd[1]: Started Session 533 of user root. May 25 05:21:59 oleg113-client sshd[102862]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:21:59 oleg113-client sshd[102875]: Received disconnect from 192.168.201.13 port 51078:11: disconnected by user May 25 05:21:59 oleg113-client sshd[102875]: Disconnected from user root 192.168.201.13 port 51078 May 25 05:21:59 oleg113-client sshd[102862]: pam_unix(sshd:session): session closed for user root May 25 05:22:00 oleg113-client systemd[1]: session-533.scope: Succeeded. May 25 05:22:00 oleg113-client systemd-logind[1020]: Session 533 logged out. Waiting for processes to exit. May 25 05:22:00 oleg113-client systemd-logind[1020]: Removed session 533. May 25 05:22:01 oleg113-client sshd[103001]: Accepted publickey for root from 192.168.201.13 port 51814 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:22:01 oleg113-client systemd-logind[1020]: New session 534 of user root. May 25 05:22:01 oleg113-client systemd[1]: Started Session 534 of user root. May 25 05:22:01 oleg113-client sshd[103001]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:22:01 oleg113-client sshd[103014]: Received disconnect from 192.168.201.13 port 51814:11: disconnected by user May 25 05:22:01 oleg113-client sshd[103014]: Disconnected from user root 192.168.201.13 port 51814 May 25 05:22:01 oleg113-client sshd[103001]: pam_unix(sshd:session): session closed for user root May 25 05:22:01 oleg113-client systemd-logind[1020]: Session 534 logged out. Waiting for processes to exit. May 25 05:22:01 oleg113-client systemd[1]: session-534.scope: Succeeded. May 25 05:22:01 oleg113-client systemd-logind[1020]: Removed session 534. May 25 05:22:03 oleg113-client sshd[103147]: Accepted publickey for root from 192.168.201.13 port 51818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:22:03 oleg113-client systemd-logind[1020]: New session 535 of user root. May 25 05:22:03 oleg113-client systemd[1]: Started Session 535 of user root. May 25 05:22:03 oleg113-client sshd[103147]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:22:04 oleg113-client sshd[103161]: Received disconnect from 192.168.201.13 port 51818:11: disconnected by user May 25 05:22:04 oleg113-client sshd[103161]: Disconnected from user root 192.168.201.13 port 51818 May 25 05:22:04 oleg113-client sshd[103147]: pam_unix(sshd:session): session closed for user root May 25 05:22:04 oleg113-client systemd[1]: session-535.scope: Succeeded. May 25 05:22:04 oleg113-client systemd-logind[1020]: Session 535 logged out. Waiting for processes to exit. May 25 05:22:04 oleg113-client systemd-logind[1020]: Removed session 535. May 25 05:22:06 oleg113-client sshd[103303]: Accepted publickey for root from 192.168.201.13 port 51822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:22:06 oleg113-client systemd[1]: Started Session 536 of user root. May 25 05:22:06 oleg113-client systemd-logind[1020]: New session 536 of user root. May 25 05:22:06 oleg113-client sshd[103303]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:22:07 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144a: MDT failover should stop precreation threads ========================================================== 05:22:05 (1779700925) May 25 05:22:07 oleg113-client sshd[103316]: Received disconnect from 192.168.201.13 port 51822:11: disconnected by user May 25 05:22:07 oleg113-client sshd[103316]: Disconnected from user root 192.168.201.13 port 51822 May 25 05:22:07 oleg113-client sshd[103303]: pam_unix(sshd:session): session closed for user root May 25 05:22:07 oleg113-client systemd-logind[1020]: Session 536 logged out. Waiting for processes to exit. May 25 05:22:07 oleg113-client systemd[1]: session-536.scope: Succeeded. May 25 05:22:07 oleg113-client systemd-logind[1020]: Removed session 536. May 25 05:22:17 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7938800: operation ost_setattr to node 192.168.201.113@tcp failed: rc = -107 May 25 05:22:17 oleg113-client kernel: Lustre: lustre-OST0000-osc-ffff9b15c7938800: Connection to lustre-OST0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:22:17 oleg113-client kernel: Lustre: Skipped 6 previous similar messages May 25 05:23:05 oleg113-client sshd[103775]: Accepted publickey for root from 192.168.201.13 port 60560 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:23:05 oleg113-client systemd-logind[1020]: New session 537 of user root. May 25 05:23:05 oleg113-client systemd[1]: Started Session 537 of user root. May 25 05:23:05 oleg113-client sshd[103775]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:23:06 oleg113-client sshd[103788]: Received disconnect from 192.168.201.13 port 60560:11: disconnected by user May 25 05:23:06 oleg113-client sshd[103788]: Disconnected from user root 192.168.201.13 port 60560 May 25 05:23:06 oleg113-client sshd[103775]: pam_unix(sshd:session): session closed for user root May 25 05:23:07 oleg113-client systemd-logind[1020]: Session 537 logged out. Waiting for processes to exit. May 25 05:23:07 oleg113-client systemd[1]: session-537.scope: Succeeded. May 25 05:23:07 oleg113-client systemd-logind[1020]: Removed session 537. May 25 05:23:16 oleg113-client sshd[104013]: Accepted publickey for root from 192.168.201.13 port 56086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:23:17 oleg113-client systemd-logind[1020]: New session 538 of user root. May 25 05:23:17 oleg113-client systemd[1]: Started Session 538 of user root. May 25 05:23:17 oleg113-client sshd[104013]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:23:19 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 05:23:19 oleg113-client sshd[104027]: Received disconnect from 192.168.201.13 port 56086:11: disconnected by user May 25 05:23:19 oleg113-client sshd[104027]: Disconnected from user root 192.168.201.13 port 56086 May 25 05:23:19 oleg113-client sshd[104013]: pam_unix(sshd:session): session closed for user root May 25 05:23:19 oleg113-client systemd[1]: session-538.scope: Succeeded. May 25 05:23:19 oleg113-client systemd-logind[1020]: Session 538 logged out. Waiting for processes to exit. May 25 05:23:19 oleg113-client systemd-logind[1020]: Removed session 538. May 25 05:23:23 oleg113-client sshd[104170]: Accepted publickey for root from 192.168.201.13 port 59012 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:23:23 oleg113-client systemd[1]: Started Session 539 of user root. May 25 05:23:23 oleg113-client systemd-logind[1020]: New session 539 of user root. May 25 05:23:23 oleg113-client sshd[104170]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:23:24 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 05:23:24 oleg113-client sshd[104184]: Received disconnect from 192.168.201.13 port 59012:11: disconnected by user May 25 05:23:24 oleg113-client sshd[104184]: Disconnected from user root 192.168.201.13 port 59012 May 25 05:23:24 oleg113-client sshd[104170]: pam_unix(sshd:session): session closed for user root May 25 05:23:24 oleg113-client systemd[1]: session-539.scope: Succeeded. May 25 05:23:24 oleg113-client systemd-logind[1020]: Session 539 logged out. Waiting for processes to exit. May 25 05:23:24 oleg113-client systemd-logind[1020]: Removed session 539. May 25 05:23:27 oleg113-client sshd[104226]: Accepted publickey for root from 192.168.201.13 port 59014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:23:28 oleg113-client systemd-logind[1020]: New session 540 of user root. May 25 05:23:28 oleg113-client systemd[1]: Started Session 540 of user root. May 25 05:23:28 oleg113-client sshd[104226]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:23:28 oleg113-client sshd[104239]: Received disconnect from 192.168.201.13 port 59014:11: disconnected by user May 25 05:23:28 oleg113-client sshd[104239]: Disconnected from user root 192.168.201.13 port 59014 May 25 05:23:28 oleg113-client sshd[104226]: pam_unix(sshd:session): session closed for user root May 25 05:23:29 oleg113-client systemd[1]: session-540.scope: Succeeded. May 25 05:23:29 oleg113-client systemd-logind[1020]: Session 540 logged out. Waiting for processes to exit. May 25 05:23:29 oleg113-client systemd-logind[1020]: Removed session 540. May 25 05:24:52 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779701076/real 1779701076] req@ffff9b15ec848380 x1866143517482240/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779701092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 05:24:52 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 5 previous similar messages May 25 05:25:02 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b415e268 to 0x58062bb2b415f18e May 25 05:25:02 oleg113-client kernel: Lustre: Skipped 2 previous similar messages May 25 05:25:02 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 05:25:02 oleg113-client kernel: Lustre: Skipped 8 previous similar messages May 25 05:25:04 oleg113-client kernel: Lustre: 97370:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 05:25:19 oleg113-client sshd[104553]: Accepted publickey for root from 192.168.201.13 port 39262 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:25:19 oleg113-client systemd-logind[1020]: New session 541 of user root. May 25 05:25:19 oleg113-client systemd[1]: Started Session 541 of user root. May 25 05:25:19 oleg113-client sshd[104553]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:25:19 oleg113-client sshd[104566]: Received disconnect from 192.168.201.13 port 39262:11: disconnected by user May 25 05:25:19 oleg113-client sshd[104566]: Disconnected from user root 192.168.201.13 port 39262 May 25 05:25:19 oleg113-client sshd[104553]: pam_unix(sshd:session): session closed for user root May 25 05:25:20 oleg113-client systemd[1]: session-541.scope: Succeeded. May 25 05:25:20 oleg113-client systemd-logind[1020]: Session 541 logged out. Waiting for processes to exit. May 25 05:25:20 oleg113-client systemd-logind[1020]: Removed session 541. May 25 05:25:26 oleg113-client sshd[104790]: Accepted publickey for root from 192.168.201.13 port 36312 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:25:26 oleg113-client systemd-logind[1020]: New session 542 of user root. May 25 05:25:26 oleg113-client systemd[1]: Started Session 542 of user root. May 25 05:25:26 oleg113-client sshd[104790]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:25:26 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 05:25:26 oleg113-client sshd[104803]: Received disconnect from 192.168.201.13 port 36312:11: disconnected by user May 25 05:25:27 oleg113-client sshd[104803]: Disconnected from user root 192.168.201.13 port 36312 May 25 05:25:27 oleg113-client sshd[104790]: pam_unix(sshd:session): session closed for user root May 25 05:25:27 oleg113-client systemd-logind[1020]: Session 542 logged out. Waiting for processes to exit. May 25 05:25:27 oleg113-client systemd[1]: session-542.scope: Succeeded. May 25 05:25:27 oleg113-client systemd-logind[1020]: Removed session 542. May 25 05:25:29 oleg113-client sshd[104947]: Accepted publickey for root from 192.168.201.13 port 51304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:25:29 oleg113-client systemd-logind[1020]: New session 543 of user root. May 25 05:25:29 oleg113-client systemd[1]: Started Session 543 of user root. May 25 05:25:30 oleg113-client sshd[104947]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:25:30 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 05:25:30 oleg113-client sshd[104960]: Received disconnect from 192.168.201.13 port 51304:11: disconnected by user May 25 05:25:30 oleg113-client sshd[104960]: Disconnected from user root 192.168.201.13 port 51304 May 25 05:25:30 oleg113-client sshd[104947]: pam_unix(sshd:session): session closed for user root May 25 05:25:30 oleg113-client systemd[1]: session-543.scope: Succeeded. May 25 05:25:31 oleg113-client systemd-logind[1020]: Session 543 logged out. Waiting for processes to exit. May 25 05:25:31 oleg113-client systemd-logind[1020]: Removed session 543. May 25 05:25:32 oleg113-client sshd[105002]: Accepted publickey for root from 192.168.201.13 port 51320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:25:32 oleg113-client systemd-logind[1020]: New session 544 of user root. May 25 05:25:32 oleg113-client systemd[1]: Started Session 544 of user root. May 25 05:25:32 oleg113-client sshd[105002]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:25:33 oleg113-client sshd[105016]: Received disconnect from 192.168.201.13 port 51320:11: disconnected by user May 25 05:25:33 oleg113-client sshd[105016]: Disconnected from user root 192.168.201.13 port 51320 May 25 05:25:33 oleg113-client sshd[105002]: pam_unix(sshd:session): session closed for user root May 25 05:25:33 oleg113-client systemd[1]: session-544.scope: Succeeded. May 25 05:25:33 oleg113-client systemd-logind[1020]: Session 544 logged out. Waiting for processes to exit. May 25 05:25:33 oleg113-client systemd-logind[1020]: Removed session 544. May 25 05:25:54 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:25:54 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 05:26:18 oleg113-client sshd[105322]: Accepted publickey for root from 192.168.201.13 port 49466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:18 oleg113-client systemd-logind[1020]: New session 545 of user root. May 25 05:26:18 oleg113-client systemd[1]: Started Session 545 of user root. May 25 05:26:18 oleg113-client sshd[105322]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:18 oleg113-client sshd[105335]: Received disconnect from 192.168.201.13 port 49466:11: disconnected by user May 25 05:26:18 oleg113-client sshd[105335]: Disconnected from user root 192.168.201.13 port 49466 May 25 05:26:18 oleg113-client sshd[105322]: pam_unix(sshd:session): session closed for user root May 25 05:26:19 oleg113-client systemd-logind[1020]: Session 545 logged out. Waiting for processes to exit. May 25 05:26:19 oleg113-client systemd[1]: session-545.scope: Succeeded. May 25 05:26:19 oleg113-client systemd-logind[1020]: Removed session 545. May 25 05:26:23 oleg113-client sshd[105558]: Accepted publickey for root from 192.168.201.13 port 39022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:23 oleg113-client systemd-logind[1020]: New session 546 of user root. May 25 05:26:23 oleg113-client systemd[1]: Started Session 546 of user root. May 25 05:26:23 oleg113-client sshd[105558]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:23 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid May 25 05:26:23 oleg113-client sshd[105571]: Received disconnect from 192.168.201.13 port 39022:11: disconnected by user May 25 05:26:23 oleg113-client sshd[105571]: Disconnected from user root 192.168.201.13 port 39022 May 25 05:26:23 oleg113-client sshd[105558]: pam_unix(sshd:session): session closed for user root May 25 05:26:24 oleg113-client systemd-logind[1020]: Session 546 logged out. Waiting for processes to exit. May 25 05:26:24 oleg113-client systemd[1]: session-546.scope: Succeeded. May 25 05:26:24 oleg113-client systemd-logind[1020]: Removed session 546. May 25 05:26:25 oleg113-client sshd[105714]: Accepted publickey for root from 192.168.201.13 port 39030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:25 oleg113-client systemd[1]: Started Session 547 of user root. May 25 05:26:25 oleg113-client systemd-logind[1020]: New session 547 of user root. May 25 05:26:25 oleg113-client sshd[105714]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:26 oleg113-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec May 25 05:26:26 oleg113-client sshd[105727]: Received disconnect from 192.168.201.13 port 39030:11: disconnected by user May 25 05:26:26 oleg113-client sshd[105727]: Disconnected from user root 192.168.201.13 port 39030 May 25 05:26:26 oleg113-client sshd[105714]: pam_unix(sshd:session): session closed for user root May 25 05:26:26 oleg113-client systemd-logind[1020]: Session 547 logged out. Waiting for processes to exit. May 25 05:26:26 oleg113-client systemd[1]: session-547.scope: Succeeded. May 25 05:26:26 oleg113-client systemd-logind[1020]: Removed session 547. May 25 05:26:27 oleg113-client sshd[105768]: Accepted publickey for root from 192.168.201.13 port 39036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:27 oleg113-client systemd-logind[1020]: New session 548 of user root. May 25 05:26:28 oleg113-client systemd[1]: Started Session 548 of user root. May 25 05:26:28 oleg113-client sshd[105768]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:28 oleg113-client sshd[105781]: Received disconnect from 192.168.201.13 port 39036:11: disconnected by user May 25 05:26:28 oleg113-client sshd[105781]: Disconnected from user root 192.168.201.13 port 39036 May 25 05:26:28 oleg113-client sshd[105768]: pam_unix(sshd:session): session closed for user root May 25 05:26:28 oleg113-client systemd[1]: session-548.scope: Succeeded. May 25 05:26:28 oleg113-client systemd-logind[1020]: Session 548 logged out. Waiting for processes to exit. May 25 05:26:29 oleg113-client systemd-logind[1020]: Removed session 548. May 25 05:26:29 oleg113-client sshd[105900]: Accepted publickey for root from 192.168.201.13 port 38380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:29 oleg113-client systemd-logind[1020]: New session 549 of user root. May 25 05:26:29 oleg113-client systemd[1]: Started Session 549 of user root. May 25 05:26:29 oleg113-client sshd[105900]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:30 oleg113-client sshd[105913]: Received disconnect from 192.168.201.13 port 38380:11: disconnected by user May 25 05:26:30 oleg113-client sshd[105913]: Disconnected from user root 192.168.201.13 port 38380 May 25 05:26:30 oleg113-client sshd[105900]: pam_unix(sshd:session): session closed for user root May 25 05:26:30 oleg113-client systemd-logind[1020]: Session 549 logged out. Waiting for processes to exit. May 25 05:26:30 oleg113-client systemd[1]: session-549.scope: Succeeded. May 25 05:26:30 oleg113-client systemd-logind[1020]: Removed session 549. May 25 05:26:32 oleg113-client sshd[106040]: Accepted publickey for root from 192.168.201.13 port 38386 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:32 oleg113-client systemd-logind[1020]: New session 550 of user root. May 25 05:26:32 oleg113-client systemd[1]: Started Session 550 of user root. May 25 05:26:32 oleg113-client sshd[106040]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:32 oleg113-client sshd[106053]: Received disconnect from 192.168.201.13 port 38386:11: disconnected by user May 25 05:26:32 oleg113-client sshd[106053]: Disconnected from user root 192.168.201.13 port 38386 May 25 05:26:32 oleg113-client sshd[106040]: pam_unix(sshd:session): session closed for user root May 25 05:26:33 oleg113-client systemd[1]: session-550.scope: Succeeded. May 25 05:26:33 oleg113-client systemd-logind[1020]: Session 550 logged out. Waiting for processes to exit. May 25 05:26:33 oleg113-client systemd-logind[1020]: Removed session 550. May 25 05:26:34 oleg113-client sshd[106186]: Accepted publickey for root from 192.168.201.13 port 38400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:26:34 oleg113-client systemd-logind[1020]: New session 551 of user root. May 25 05:26:34 oleg113-client systemd[1]: Started Session 551 of user root. May 25 05:26:34 oleg113-client sshd[106186]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:26:35 oleg113-client sshd[106199]: Received disconnect from 192.168.201.13 port 38400:11: disconnected by user May 25 05:26:35 oleg113-client sshd[106199]: Disconnected from user root 192.168.201.13 port 38400 May 25 05:26:35 oleg113-client sshd[106186]: pam_unix(sshd:session): session closed for user root May 25 05:26:35 oleg113-client systemd[1]: session-551.scope: Succeeded. May 25 05:26:35 oleg113-client systemd-logind[1020]: Session 551 logged out. Waiting for processes to exit. May 25 05:26:35 oleg113-client systemd-logind[1020]: Removed session 551. May 25 05:28:25 oleg113-client sshd[106393]: Accepted publickey for root from 192.168.201.13 port 53434 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:28:25 oleg113-client systemd-logind[1020]: New session 552 of user root. May 25 05:28:25 oleg113-client systemd[1]: Started Session 552 of user root. May 25 05:28:25 oleg113-client sshd[106393]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:28:25 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144b: orphan cleanup shouldn't be blocked for no objects+failover situation ========================================================== 05:28:23 (1779701303) May 25 05:28:25 oleg113-client sshd[106406]: Received disconnect from 192.168.201.13 port 53434:11: disconnected by user May 25 05:28:25 oleg113-client sshd[106406]: Disconnected from user root 192.168.201.13 port 53434 May 25 05:28:25 oleg113-client sshd[106393]: pam_unix(sshd:session): session closed for user root May 25 05:28:26 oleg113-client systemd[1]: session-552.scope: Succeeded. May 25 05:28:26 oleg113-client systemd-logind[1020]: Session 552 logged out. Waiting for processes to exit. May 25 05:28:26 oleg113-client systemd-logind[1020]: Removed session 552. May 25 05:29:44 oleg113-client sshd[106869]: Accepted publickey for root from 192.168.201.13 port 54400 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:29:44 oleg113-client systemd-logind[1020]: New session 553 of user root. May 25 05:29:44 oleg113-client systemd[1]: Started Session 553 of user root. May 25 05:29:44 oleg113-client sshd[106869]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:29:45 oleg113-client sshd[106882]: Received disconnect from 192.168.201.13 port 54400:11: disconnected by user May 25 05:29:45 oleg113-client sshd[106882]: Disconnected from user root 192.168.201.13 port 54400 May 25 05:29:45 oleg113-client sshd[106869]: pam_unix(sshd:session): session closed for user root May 25 05:29:46 oleg113-client systemd[1]: session-553.scope: Succeeded. May 25 05:29:46 oleg113-client systemd-logind[1020]: Session 553 logged out. Waiting for processes to exit. May 25 05:29:46 oleg113-client systemd-logind[1020]: Removed session 553. May 25 05:29:55 oleg113-client sshd[107106]: Accepted publickey for root from 192.168.201.13 port 47250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:29:55 oleg113-client systemd-logind[1020]: New session 554 of user root. May 25 05:29:55 oleg113-client systemd[1]: Started Session 554 of user root. May 25 05:29:55 oleg113-client sshd[107106]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:29:56 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 05:29:56 oleg113-client sshd[107120]: Received disconnect from 192.168.201.13 port 47250:11: disconnected by user May 25 05:29:56 oleg113-client sshd[107120]: Disconnected from user root 192.168.201.13 port 47250 May 25 05:29:56 oleg113-client sshd[107106]: pam_unix(sshd:session): session closed for user root May 25 05:29:56 oleg113-client systemd-logind[1020]: Session 554 logged out. Waiting for processes to exit. May 25 05:29:57 oleg113-client systemd[1]: session-554.scope: Succeeded. May 25 05:29:57 oleg113-client systemd-logind[1020]: Removed session 554. May 25 05:30:00 oleg113-client sshd[107264]: Accepted publickey for root from 192.168.201.13 port 50854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:30:00 oleg113-client systemd-logind[1020]: New session 555 of user root. May 25 05:30:00 oleg113-client systemd[1]: Started Session 555 of user root. May 25 05:30:00 oleg113-client sshd[107264]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:30:01 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 05:30:01 oleg113-client sshd[107277]: Received disconnect from 192.168.201.13 port 50854:11: disconnected by user May 25 05:30:01 oleg113-client sshd[107277]: Disconnected from user root 192.168.201.13 port 50854 May 25 05:30:02 oleg113-client sshd[107264]: pam_unix(sshd:session): session closed for user root May 25 05:30:02 oleg113-client systemd[1]: session-555.scope: Succeeded. May 25 05:30:02 oleg113-client systemd-logind[1020]: Session 555 logged out. Waiting for processes to exit. May 25 05:30:02 oleg113-client systemd-logind[1020]: Removed session 555. May 25 05:30:04 oleg113-client sshd[107319]: Accepted publickey for root from 192.168.201.13 port 50866 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:30:04 oleg113-client systemd-logind[1020]: New session 556 of user root. May 25 05:30:04 oleg113-client systemd[1]: Started Session 556 of user root. May 25 05:30:04 oleg113-client sshd[107319]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:30:08 oleg113-client sshd[107332]: Received disconnect from 192.168.201.13 port 50866:11: disconnected by user May 25 05:30:08 oleg113-client sshd[107332]: Disconnected from user root 192.168.201.13 port 50866 May 25 05:30:08 oleg113-client sshd[107319]: pam_unix(sshd:session): session closed for user root May 25 05:30:08 oleg113-client systemd[1]: session-556.scope: Succeeded. May 25 05:30:08 oleg113-client systemd-logind[1020]: Session 556 logged out. Waiting for processes to exit. May 25 05:30:08 oleg113-client systemd-logind[1020]: Removed session 556. May 25 05:31:12 oleg113-client sshd[107513]: Accepted publickey for root from 192.168.201.13 port 35668 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:31:12 oleg113-client systemd-logind[1020]: New session 557 of user root. May 25 05:31:12 oleg113-client systemd[1]: Started Session 557 of user root. May 25 05:31:12 oleg113-client sshd[107513]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:31:13 oleg113-client sshd[107526]: Received disconnect from 192.168.201.13 port 35668:11: disconnected by user May 25 05:31:13 oleg113-client sshd[107526]: Disconnected from user root 192.168.201.13 port 35668 May 25 05:31:13 oleg113-client sshd[107513]: pam_unix(sshd:session): session closed for user root May 25 05:31:13 oleg113-client systemd[1]: session-557.scope: Succeeded. May 25 05:31:13 oleg113-client systemd-logind[1020]: Session 557 logged out. Waiting for processes to exit. May 25 05:31:13 oleg113-client systemd-logind[1020]: Removed session 557. May 25 05:31:15 oleg113-client sshd[107653]: Accepted publickey for root from 192.168.201.13 port 35682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:31:15 oleg113-client systemd[1]: Started Session 558 of user root. May 25 05:31:15 oleg113-client systemd-logind[1020]: New session 558 of user root. May 25 05:31:15 oleg113-client sshd[107653]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:31:15 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:31:16 oleg113-client sshd[107668]: Received disconnect from 192.168.201.13 port 35682:11: disconnected by user May 25 05:31:16 oleg113-client sshd[107668]: Disconnected from user root 192.168.201.13 port 35682 May 25 05:31:16 oleg113-client sshd[107653]: pam_unix(sshd:session): session closed for user root May 25 05:31:16 oleg113-client systemd-logind[1020]: Session 558 logged out. Waiting for processes to exit. May 25 05:31:16 oleg113-client systemd[1]: session-558.scope: Succeeded. May 25 05:31:16 oleg113-client systemd-logind[1020]: Removed session 558. May 25 05:31:17 oleg113-client sshd[107801]: Accepted publickey for root from 192.168.201.13 port 35694 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:31:17 oleg113-client systemd[1]: Started Session 559 of user root. May 25 05:31:17 oleg113-client systemd-logind[1020]: New session 559 of user root. May 25 05:31:17 oleg113-client sshd[107801]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:31:18 oleg113-client sshd[107814]: Received disconnect from 192.168.201.13 port 35694:11: disconnected by user May 25 05:31:18 oleg113-client sshd[107814]: Disconnected from user root 192.168.201.13 port 35694 May 25 05:31:18 oleg113-client sshd[107801]: pam_unix(sshd:session): session closed for user root May 25 05:31:18 oleg113-client systemd[1]: session-559.scope: Succeeded. May 25 05:31:18 oleg113-client systemd-logind[1020]: Session 559 logged out. Waiting for processes to exit. May 25 05:31:18 oleg113-client systemd-logind[1020]: Removed session 559. May 25 05:33:06 oleg113-client sshd[108008]: Accepted publickey for root from 192.168.201.13 port 33564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:33:07 oleg113-client systemd-logind[1020]: New session 560 of user root. May 25 05:33:07 oleg113-client systemd[1]: Started Session 560 of user root. May 25 05:33:07 oleg113-client sshd[108008]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:33:07 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144c: reconnection during orphan cleanup shouldn't lose LAST_ID synchronization ========================================================== 05:33:04 (1779701584) May 25 05:33:07 oleg113-client sshd[108021]: Received disconnect from 192.168.201.13 port 33564:11: disconnected by user May 25 05:33:07 oleg113-client sshd[108021]: Disconnected from user root 192.168.201.13 port 33564 May 25 05:33:07 oleg113-client sshd[108008]: pam_unix(sshd:session): session closed for user root May 25 05:33:07 oleg113-client systemd[1]: session-560.scope: Succeeded. May 25 05:33:07 oleg113-client systemd-logind[1020]: Session 560 logged out. Waiting for processes to exit. May 25 05:33:07 oleg113-client systemd-logind[1020]: Removed session 560. May 25 05:33:21 oleg113-client sshd[108203]: Accepted publickey for root from 192.168.201.13 port 59208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:33:21 oleg113-client systemd[1]: Started Session 561 of user root. May 25 05:33:21 oleg113-client systemd-logind[1020]: New session 561 of user root. May 25 05:33:21 oleg113-client sshd[108203]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:33:21 oleg113-client sshd[108216]: Received disconnect from 192.168.201.13 port 59208:11: disconnected by user May 25 05:33:21 oleg113-client sshd[108216]: Disconnected from user root 192.168.201.13 port 59208 May 25 05:33:21 oleg113-client sshd[108203]: pam_unix(sshd:session): session closed for user root May 25 05:33:21 oleg113-client systemd[1]: session-561.scope: Succeeded. May 25 05:33:21 oleg113-client systemd-logind[1020]: Session 561 logged out. Waiting for processes to exit. May 25 05:33:21 oleg113-client systemd-logind[1020]: Removed session 561. May 25 05:35:57 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c7938800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:35:57 oleg113-client kernel: Lustre: Skipped 3 previous similar messages May 25 05:36:18 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779701762/real 1779701762] req@ffff9b15ca24fb80 x1866143528660224/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779701778 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 05:36:18 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:36:18 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 1 previous similar message May 25 05:36:18 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b415f61f to 0x58062bb2b4259b68 May 25 05:36:18 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 05:36:18 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 05:36:18 oleg113-client kernel: Lustre: Skipped 3 previous similar messages May 25 05:36:50 oleg113-client sshd[108724]: Accepted publickey for root from 192.168.201.13 port 39032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:36:50 oleg113-client systemd-logind[1020]: New session 562 of user root. May 25 05:36:50 oleg113-client systemd[1]: Started Session 562 of user root. May 25 05:36:50 oleg113-client sshd[108724]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:36:50 oleg113-client sshd[108737]: Received disconnect from 192.168.201.13 port 39032:11: disconnected by user May 25 05:36:50 oleg113-client sshd[108737]: Disconnected from user root 192.168.201.13 port 39032 May 25 05:36:50 oleg113-client sshd[108724]: pam_unix(sshd:session): session closed for user root May 25 05:36:51 oleg113-client systemd[1]: session-562.scope: Succeeded. May 25 05:36:51 oleg113-client systemd-logind[1020]: Session 562 logged out. Waiting for processes to exit. May 25 05:36:51 oleg113-client systemd-logind[1020]: Removed session 562. May 25 05:36:52 oleg113-client sshd[108863]: Accepted publickey for root from 192.168.201.13 port 39042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:36:52 oleg113-client systemd-logind[1020]: New session 563 of user root. May 25 05:36:52 oleg113-client systemd[1]: Started Session 563 of user root. May 25 05:36:52 oleg113-client sshd[108863]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:36:53 oleg113-client sshd[108876]: Received disconnect from 192.168.201.13 port 39042:11: disconnected by user May 25 05:36:53 oleg113-client sshd[108876]: Disconnected from user root 192.168.201.13 port 39042 May 25 05:36:53 oleg113-client sshd[108863]: pam_unix(sshd:session): session closed for user root May 25 05:36:53 oleg113-client systemd[1]: session-563.scope: Succeeded. May 25 05:36:53 oleg113-client systemd-logind[1020]: Session 563 logged out. Waiting for processes to exit. May 25 05:36:53 oleg113-client systemd-logind[1020]: Removed session 563. May 25 05:36:54 oleg113-client sshd[109009]: Accepted publickey for root from 192.168.201.13 port 39058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:36:54 oleg113-client systemd-logind[1020]: New session 564 of user root. May 25 05:36:54 oleg113-client systemd[1]: Started Session 564 of user root. May 25 05:36:54 oleg113-client sshd[109009]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:36:55 oleg113-client sshd[109022]: Received disconnect from 192.168.201.13 port 39058:11: disconnected by user May 25 05:36:55 oleg113-client sshd[109022]: Disconnected from user root 192.168.201.13 port 39058 May 25 05:36:55 oleg113-client sshd[109009]: pam_unix(sshd:session): session closed for user root May 25 05:36:55 oleg113-client systemd[1]: session-564.scope: Succeeded. May 25 05:36:55 oleg113-client systemd-logind[1020]: Session 564 logged out. Waiting for processes to exit. May 25 05:36:55 oleg113-client systemd-logind[1020]: Removed session 564. May 25 05:36:56 oleg113-client sshd[109165]: Accepted publickey for root from 192.168.201.13 port 39070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:36:56 oleg113-client systemd[1]: Started Session 565 of user root. May 25 05:36:56 oleg113-client systemd-logind[1020]: New session 565 of user root. May 25 05:36:56 oleg113-client sshd[109165]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:36:57 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 145: connect mdtlovs and process update logs after recovery expire ========================================================== 05:36:55 (1779701815) May 25 05:36:57 oleg113-client sshd[109178]: Received disconnect from 192.168.201.13 port 39070:11: disconnected by user May 25 05:36:57 oleg113-client sshd[109178]: Disconnected from user root 192.168.201.13 port 39070 May 25 05:36:57 oleg113-client sshd[109165]: pam_unix(sshd:session): session closed for user root May 25 05:36:57 oleg113-client systemd-logind[1020]: Session 565 logged out. Waiting for processes to exit. May 25 05:36:57 oleg113-client systemd[1]: session-565.scope: Succeeded. May 25 05:36:57 oleg113-client systemd-logind[1020]: Removed session 565. May 25 05:36:58 oleg113-client sshd[109303]: Accepted publickey for root from 192.168.201.13 port 39086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:36:58 oleg113-client systemd-logind[1020]: New session 566 of user root. May 25 05:36:58 oleg113-client systemd[1]: Started Session 566 of user root. May 25 05:36:58 oleg113-client sshd[109303]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:36:59 oleg113-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_145 needs >= 3 MDTs May 25 05:36:59 oleg113-client sshd[109316]: Received disconnect from 192.168.201.13 port 39086:11: disconnected by user May 25 05:36:59 oleg113-client sshd[109316]: Disconnected from user root 192.168.201.13 port 39086 May 25 05:36:59 oleg113-client sshd[109303]: pam_unix(sshd:session): session closed for user root May 25 05:36:59 oleg113-client systemd[1]: session-566.scope: Succeeded. May 25 05:36:59 oleg113-client systemd-logind[1020]: Session 566 logged out. Waiting for processes to exit. May 25 05:36:59 oleg113-client systemd-logind[1020]: Removed session 566. May 25 05:37:00 oleg113-client sshd[109458]: Accepted publickey for root from 192.168.201.13 port 51324 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:37:01 oleg113-client systemd-logind[1020]: New session 567 of user root. May 25 05:37:01 oleg113-client systemd[1]: Started Session 567 of user root. May 25 05:37:01 oleg113-client sshd[109458]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:37:01 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 146: test eviction is counted properly ========================================================== 05:36:59 (1779701819) May 25 05:37:01 oleg113-client sshd[109471]: Received disconnect from 192.168.201.13 port 51324:11: disconnected by user May 25 05:37:01 oleg113-client sshd[109471]: Disconnected from user root 192.168.201.13 port 51324 May 25 05:37:01 oleg113-client sshd[109458]: pam_unix(sshd:session): session closed for user root May 25 05:37:01 oleg113-client systemd-logind[1020]: Session 567 logged out. Waiting for processes to exit. May 25 05:37:01 oleg113-client systemd[1]: session-567.scope: Succeeded. May 25 05:37:01 oleg113-client systemd-logind[1020]: Removed session 567. May 25 05:37:03 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7938800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 05:37:03 oleg113-client kernel: LustreError: Skipped 44 previous similar messages May 25 05:37:03 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7938800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:37:07 oleg113-client sshd[109637]: Accepted publickey for root from 192.168.201.13 port 51326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:37:07 oleg113-client systemd[1]: Started Session 568 of user root. May 25 05:37:07 oleg113-client systemd-logind[1020]: New session 568 of user root. May 25 05:37:07 oleg113-client sshd[109637]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:37:07 oleg113-client sshd[109650]: Received disconnect from 192.168.201.13 port 51326:11: disconnected by user May 25 05:37:07 oleg113-client sshd[109650]: Disconnected from user root 192.168.201.13 port 51326 May 25 05:37:07 oleg113-client sshd[109637]: pam_unix(sshd:session): session closed for user root May 25 05:37:08 oleg113-client systemd[1]: session-568.scope: Succeeded. May 25 05:37:08 oleg113-client systemd-logind[1020]: Session 568 logged out. Waiting for processes to exit. May 25 05:37:08 oleg113-client systemd-logind[1020]: Removed session 568. May 25 05:37:09 oleg113-client sshd[109777]: Accepted publickey for root from 192.168.201.13 port 59220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:37:09 oleg113-client systemd[1]: Started Session 569 of user root. May 25 05:37:09 oleg113-client systemd-logind[1020]: New session 569 of user root. May 25 05:37:09 oleg113-client sshd[109777]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:37:09 oleg113-client sshd[109790]: Received disconnect from 192.168.201.13 port 59220:11: disconnected by user May 25 05:37:09 oleg113-client sshd[109790]: Disconnected from user root 192.168.201.13 port 59220 May 25 05:37:09 oleg113-client sshd[109777]: pam_unix(sshd:session): session closed for user root May 25 05:37:09 oleg113-client systemd-logind[1020]: Session 569 logged out. Waiting for processes to exit. May 25 05:37:09 oleg113-client systemd[1]: session-569.scope: Succeeded. May 25 05:37:09 oleg113-client systemd-logind[1020]: Removed session 569. May 25 05:37:11 oleg113-client sshd[109923]: Accepted publickey for root from 192.168.201.13 port 59222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:37:11 oleg113-client systemd[1]: Started Session 570 of user root. May 25 05:37:11 oleg113-client systemd-logind[1020]: New session 570 of user root. May 25 05:37:11 oleg113-client sshd[109923]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:37:11 oleg113-client sshd[109936]: Received disconnect from 192.168.201.13 port 59222:11: disconnected by user May 25 05:37:11 oleg113-client sshd[109936]: Disconnected from user root 192.168.201.13 port 59222 May 25 05:37:11 oleg113-client sshd[109923]: pam_unix(sshd:session): session closed for user root May 25 05:37:11 oleg113-client systemd[1]: session-570.scope: Succeeded. May 25 05:37:11 oleg113-client systemd-logind[1020]: Session 570 logged out. Waiting for processes to exit. May 25 05:37:11 oleg113-client systemd-logind[1020]: Removed session 570. May 25 05:37:13 oleg113-client sshd[110078]: Accepted publickey for root from 192.168.201.13 port 59232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:37:13 oleg113-client systemd-logind[1020]: New session 571 of user root. May 25 05:37:13 oleg113-client systemd[1]: Started Session 571 of user root. May 25 05:37:13 oleg113-client sshd[110078]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:37:13 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 147: Check client reconnect ======= 05:37:12 (1779701832) May 25 05:37:13 oleg113-client sshd[110092]: Received disconnect from 192.168.201.13 port 59232:11: disconnected by user May 25 05:37:13 oleg113-client sshd[110092]: Disconnected from user root 192.168.201.13 port 59232 May 25 05:37:13 oleg113-client sshd[110078]: pam_unix(sshd:session): session closed for user root May 25 05:37:14 oleg113-client systemd[1]: session-571.scope: Succeeded. May 25 05:37:14 oleg113-client systemd-logind[1020]: Session 571 logged out. Waiting for processes to exit. May 25 05:37:14 oleg113-client systemd-logind[1020]: Removed session 571. May 25 05:39:47 oleg113-client sshd[110270]: Accepted publickey for root from 192.168.201.13 port 44994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:39:47 oleg113-client systemd[1]: Started Session 572 of user root. May 25 05:39:47 oleg113-client systemd-logind[1020]: New session 572 of user root. May 25 05:39:48 oleg113-client sshd[110270]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:39:48 oleg113-client sshd[110283]: Received disconnect from 192.168.201.13 port 44994:11: disconnected by user May 25 05:39:48 oleg113-client sshd[110283]: Disconnected from user root 192.168.201.13 port 44994 May 25 05:39:48 oleg113-client sshd[110270]: pam_unix(sshd:session): session closed for user root May 25 05:39:48 oleg113-client systemd[1]: session-572.scope: Succeeded. May 25 05:39:48 oleg113-client systemd-logind[1020]: Session 572 logged out. Waiting for processes to exit. May 25 05:39:48 oleg113-client systemd-logind[1020]: Removed session 572. May 25 05:39:52 oleg113-client sshd[110411]: Accepted publickey for root from 192.168.201.13 port 60116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:39:52 oleg113-client systemd-logind[1020]: New session 573 of user root. May 25 05:39:52 oleg113-client systemd[1]: Started Session 573 of user root. May 25 05:39:52 oleg113-client sshd[110411]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:39:52 oleg113-client sshd[110424]: Received disconnect from 192.168.201.13 port 60116:11: disconnected by user May 25 05:39:52 oleg113-client sshd[110424]: Disconnected from user root 192.168.201.13 port 60116 May 25 05:39:52 oleg113-client sshd[110411]: pam_unix(sshd:session): session closed for user root May 25 05:39:52 oleg113-client systemd[1]: session-573.scope: Succeeded. May 25 05:39:52 oleg113-client systemd-logind[1020]: Session 573 logged out. Waiting for processes to exit. May 25 05:39:52 oleg113-client systemd-logind[1020]: Removed session 573. May 25 05:39:53 oleg113-client sshd[110557]: Accepted publickey for root from 192.168.201.13 port 60124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:39:53 oleg113-client systemd-logind[1020]: New session 574 of user root. May 25 05:39:53 oleg113-client systemd[1]: Started Session 574 of user root. May 25 05:39:53 oleg113-client sshd[110557]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:39:54 oleg113-client sshd[110570]: Received disconnect from 192.168.201.13 port 60124:11: disconnected by user May 25 05:39:54 oleg113-client sshd[110570]: Disconnected from user root 192.168.201.13 port 60124 May 25 05:39:54 oleg113-client sshd[110557]: pam_unix(sshd:session): session closed for user root May 25 05:39:54 oleg113-client systemd[1]: session-574.scope: Succeeded. May 25 05:39:54 oleg113-client systemd-logind[1020]: Session 574 logged out. Waiting for processes to exit. May 25 05:39:54 oleg113-client systemd-logind[1020]: Removed session 574. May 25 05:40:02 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7938800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:40:04 oleg113-client sshd[110736]: Accepted publickey for root from 192.168.201.13 port 60104 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:40:04 oleg113-client systemd-logind[1020]: New session 575 of user root. May 25 05:40:04 oleg113-client systemd[1]: Started Session 575 of user root. May 25 05:40:04 oleg113-client sshd[110736]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:40:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 148: data corruption through resend ========================================================== 05:40:03 (1779702003) May 25 05:40:04 oleg113-client sshd[110749]: Received disconnect from 192.168.201.13 port 60104:11: disconnected by user May 25 05:40:04 oleg113-client sshd[110749]: Disconnected from user root 192.168.201.13 port 60104 May 25 05:40:04 oleg113-client sshd[110736]: pam_unix(sshd:session): session closed for user root May 25 05:40:04 oleg113-client systemd[1]: session-575.scope: Succeeded. May 25 05:40:04 oleg113-client systemd-logind[1020]: Session 575 logged out. Waiting for processes to exit. May 25 05:40:04 oleg113-client systemd-logind[1020]: Removed session 575. May 25 05:40:51 oleg113-client sshd[111127]: Accepted publickey for root from 192.168.201.13 port 43954 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:40:52 oleg113-client systemd[1]: Started Session 576 of user root. May 25 05:40:52 oleg113-client systemd-logind[1020]: New session 576 of user root. May 25 05:40:52 oleg113-client sshd[111127]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:40:52 oleg113-client sshd[111140]: Received disconnect from 192.168.201.13 port 43954:11: disconnected by user May 25 05:40:52 oleg113-client sshd[111140]: Disconnected from user root 192.168.201.13 port 43954 May 25 05:40:52 oleg113-client sshd[111127]: pam_unix(sshd:session): session closed for user root May 25 05:40:52 oleg113-client systemd[1]: session-576.scope: Succeeded. May 25 05:40:52 oleg113-client systemd-logind[1020]: Session 576 logged out. Waiting for processes to exit. May 25 05:40:52 oleg113-client systemd-logind[1020]: Removed session 576. May 25 05:40:54 oleg113-client sshd[111266]: Accepted publickey for root from 192.168.201.13 port 43956 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:40:54 oleg113-client systemd[1]: Started Session 577 of user root. May 25 05:40:54 oleg113-client systemd-logind[1020]: New session 577 of user root. May 25 05:40:54 oleg113-client sshd[111266]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:40:55 oleg113-client sshd[111279]: Received disconnect from 192.168.201.13 port 43956:11: disconnected by user May 25 05:40:55 oleg113-client sshd[111279]: Disconnected from user root 192.168.201.13 port 43956 May 25 05:40:55 oleg113-client sshd[111266]: pam_unix(sshd:session): session closed for user root May 25 05:40:55 oleg113-client systemd-logind[1020]: Session 577 logged out. Waiting for processes to exit. May 25 05:40:55 oleg113-client systemd[1]: session-577.scope: Succeeded. May 25 05:40:55 oleg113-client systemd-logind[1020]: Removed session 577. May 25 05:40:56 oleg113-client sshd[111413]: Accepted publickey for root from 192.168.201.13 port 43962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:40:56 oleg113-client systemd-logind[1020]: New session 578 of user root. May 25 05:40:56 oleg113-client systemd[1]: Started Session 578 of user root. May 25 05:40:56 oleg113-client sshd[111413]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:40:57 oleg113-client sshd[111426]: Received disconnect from 192.168.201.13 port 43962:11: disconnected by user May 25 05:40:57 oleg113-client sshd[111426]: Disconnected from user root 192.168.201.13 port 43962 May 25 05:40:57 oleg113-client sshd[111413]: pam_unix(sshd:session): session closed for user root May 25 05:40:57 oleg113-client systemd[1]: session-578.scope: Succeeded. May 25 05:40:57 oleg113-client systemd-logind[1020]: Session 578 logged out. Waiting for processes to exit. May 25 05:40:57 oleg113-client systemd-logind[1020]: Removed session 578. May 25 05:40:59 oleg113-client sshd[111568]: Accepted publickey for root from 192.168.201.13 port 55070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:40:59 oleg113-client systemd-logind[1020]: New session 579 of user root. May 25 05:40:59 oleg113-client systemd[1]: Started Session 579 of user root. May 25 05:40:59 oleg113-client sshd[111568]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:41:00 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 149: skip orphan removal at umount ========================================================== 05:40:57 (1779702057) May 25 05:41:00 oleg113-client sshd[111581]: Received disconnect from 192.168.201.13 port 55070:11: disconnected by user May 25 05:41:00 oleg113-client sshd[111581]: Disconnected from user root 192.168.201.13 port 55070 May 25 05:41:00 oleg113-client sshd[111568]: pam_unix(sshd:session): session closed for user root May 25 05:41:00 oleg113-client systemd[1]: session-579.scope: Succeeded. May 25 05:41:00 oleg113-client systemd-logind[1020]: Session 579 logged out. Waiting for processes to exit. May 25 05:41:00 oleg113-client systemd-logind[1020]: Removed session 579. May 25 05:41:54 oleg113-client kernel: LustreError: lustre-MDT0001-mdc-ffff9b15c7938800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. May 25 05:42:00 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7938800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:42:04 oleg113-client sshd[112080]: Accepted publickey for root from 192.168.201.13 port 53310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:04 oleg113-client systemd-logind[1020]: New session 580 of user root. May 25 05:42:04 oleg113-client systemd[1]: Started Session 580 of user root. May 25 05:42:04 oleg113-client sshd[112080]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:05 oleg113-client sshd[112093]: Received disconnect from 192.168.201.13 port 53310:11: disconnected by user May 25 05:42:05 oleg113-client sshd[112093]: Disconnected from user root 192.168.201.13 port 53310 May 25 05:42:05 oleg113-client sshd[112080]: pam_unix(sshd:session): session closed for user root May 25 05:42:05 oleg113-client systemd-logind[1020]: Session 580 logged out. Waiting for processes to exit. May 25 05:42:05 oleg113-client systemd[1]: session-580.scope: Succeeded. May 25 05:42:05 oleg113-client systemd-logind[1020]: Removed session 580. May 25 05:42:06 oleg113-client sshd[112213]: Accepted publickey for root from 192.168.201.13 port 53314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:07 oleg113-client systemd-logind[1020]: New session 581 of user root. May 25 05:42:07 oleg113-client systemd[1]: Started Session 581 of user root. May 25 05:42:07 oleg113-client sshd[112213]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:07 oleg113-client sshd[112226]: Received disconnect from 192.168.201.13 port 53314:11: disconnected by user May 25 05:42:07 oleg113-client sshd[112226]: Disconnected from user root 192.168.201.13 port 53314 May 25 05:42:07 oleg113-client sshd[112213]: pam_unix(sshd:session): session closed for user root May 25 05:42:07 oleg113-client systemd-logind[1020]: Session 581 logged out. Waiting for processes to exit. May 25 05:42:07 oleg113-client systemd[1]: session-581.scope: Succeeded. May 25 05:42:07 oleg113-client systemd-logind[1020]: Removed session 581. May 25 05:42:09 oleg113-client sshd[112353]: Accepted publickey for root from 192.168.201.13 port 53322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:09 oleg113-client systemd-logind[1020]: New session 582 of user root. May 25 05:42:09 oleg113-client systemd[1]: Started Session 582 of user root. May 25 05:42:09 oleg113-client sshd[112353]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:09 oleg113-client sshd[112366]: Received disconnect from 192.168.201.13 port 53322:11: disconnected by user May 25 05:42:09 oleg113-client sshd[112366]: Disconnected from user root 192.168.201.13 port 53322 May 25 05:42:09 oleg113-client sshd[112353]: pam_unix(sshd:session): session closed for user root May 25 05:42:09 oleg113-client systemd[1]: session-582.scope: Succeeded. May 25 05:42:09 oleg113-client systemd-logind[1020]: Session 582 logged out. Waiting for processes to exit. May 25 05:42:09 oleg113-client systemd-logind[1020]: Removed session 582. May 25 05:42:11 oleg113-client sshd[112499]: Accepted publickey for root from 192.168.201.13 port 47508 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:11 oleg113-client systemd-logind[1020]: New session 583 of user root. May 25 05:42:11 oleg113-client systemd[1]: Started Session 583 of user root. May 25 05:42:11 oleg113-client sshd[112499]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:12 oleg113-client sshd[112512]: Received disconnect from 192.168.201.13 port 47508:11: disconnected by user May 25 05:42:12 oleg113-client sshd[112512]: Disconnected from user root 192.168.201.13 port 47508 May 25 05:42:12 oleg113-client sshd[112499]: pam_unix(sshd:session): session closed for user root May 25 05:42:12 oleg113-client systemd[1]: session-583.scope: Succeeded. May 25 05:42:12 oleg113-client systemd-logind[1020]: Session 583 logged out. Waiting for processes to exit. May 25 05:42:12 oleg113-client systemd-logind[1020]: Removed session 583. May 25 05:42:15 oleg113-client sshd[112655]: Accepted publickey for root from 192.168.201.13 port 47524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:15 oleg113-client systemd-logind[1020]: New session 584 of user root. May 25 05:42:15 oleg113-client systemd[1]: Started Session 584 of user root. May 25 05:42:15 oleg113-client sshd[112655]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:15 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 150: statfs when MDT0 offline with lazystatfs option ========================================================== 05:42:13 (1779702133) May 25 05:42:15 oleg113-client sshd[112668]: Received disconnect from 192.168.201.13 port 47524:11: disconnected by user May 25 05:42:15 oleg113-client sshd[112668]: Disconnected from user root 192.168.201.13 port 47524 May 25 05:42:15 oleg113-client sshd[112655]: pam_unix(sshd:session): session closed for user root May 25 05:42:16 oleg113-client systemd[1]: session-584.scope: Succeeded. May 25 05:42:16 oleg113-client systemd-logind[1020]: Session 584 logged out. Waiting for processes to exit. May 25 05:42:16 oleg113-client systemd-logind[1020]: Removed session 584. May 25 05:42:22 oleg113-client kernel: LustreError: 112759:0:(lmv_obd.c:1450:lmv_statfs()) lustre-MDT0000-mdc-ffff9b15c7938800: can't stat MDS #0: rc = -19 May 25 05:42:24 oleg113-client sshd[112846]: Accepted publickey for root from 192.168.201.13 port 60602 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:24 oleg113-client systemd-logind[1020]: New session 585 of user root. May 25 05:42:24 oleg113-client systemd[1]: Started Session 585 of user root. May 25 05:42:24 oleg113-client sshd[112846]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:24 oleg113-client sshd[112859]: Received disconnect from 192.168.201.13 port 60602:11: disconnected by user May 25 05:42:24 oleg113-client sshd[112859]: Disconnected from user root 192.168.201.13 port 60602 May 25 05:42:24 oleg113-client sshd[112846]: pam_unix(sshd:session): session closed for user root May 25 05:42:25 oleg113-client systemd-logind[1020]: Session 585 logged out. Waiting for processes to exit. May 25 05:42:25 oleg113-client systemd[1]: session-585.scope: Succeeded. May 25 05:42:25 oleg113-client systemd-logind[1020]: Removed session 585. May 25 05:42:26 oleg113-client sshd[112985]: Accepted publickey for root from 192.168.201.13 port 60604 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:26 oleg113-client systemd-logind[1020]: New session 586 of user root. May 25 05:42:26 oleg113-client systemd[1]: Started Session 586 of user root. May 25 05:42:26 oleg113-client sshd[112985]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:27 oleg113-client sshd[112999]: Received disconnect from 192.168.201.13 port 60604:11: disconnected by user May 25 05:42:27 oleg113-client sshd[112999]: Disconnected from user root 192.168.201.13 port 60604 May 25 05:42:27 oleg113-client sshd[112985]: pam_unix(sshd:session): session closed for user root May 25 05:42:27 oleg113-client systemd-logind[1020]: Session 586 logged out. Waiting for processes to exit. May 25 05:42:27 oleg113-client systemd[1]: session-586.scope: Succeeded. May 25 05:42:27 oleg113-client systemd-logind[1020]: Removed session 586. May 25 05:42:29 oleg113-client sshd[113132]: Accepted publickey for root from 192.168.201.13 port 33918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:42:29 oleg113-client systemd-logind[1020]: New session 587 of user root. May 25 05:42:29 oleg113-client systemd[1]: Started Session 587 of user root. May 25 05:42:29 oleg113-client sshd[113132]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:42:30 oleg113-client sshd[113145]: Received disconnect from 192.168.201.13 port 33918:11: disconnected by user May 25 05:42:30 oleg113-client sshd[113145]: Disconnected from user root 192.168.201.13 port 33918 May 25 05:42:30 oleg113-client sshd[113132]: pam_unix(sshd:session): session closed for user root May 25 05:42:30 oleg113-client systemd[1]: session-587.scope: Succeeded. May 25 05:42:30 oleg113-client systemd-logind[1020]: Session 587 logged out. Waiting for processes to exit. May 25 05:42:30 oleg113-client systemd-logind[1020]: Removed session 587. May 25 05:43:02 oleg113-client sshd[113410]: Accepted publickey for root from 192.168.201.13 port 35736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:02 oleg113-client systemd[1]: Started Session 588 of user root. May 25 05:43:02 oleg113-client systemd-logind[1020]: New session 588 of user root. May 25 05:43:02 oleg113-client sshd[113410]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:03 oleg113-client sshd[113423]: Received disconnect from 192.168.201.13 port 35736:11: disconnected by user May 25 05:43:03 oleg113-client sshd[113423]: Disconnected from user root 192.168.201.13 port 35736 May 25 05:43:03 oleg113-client sshd[113410]: pam_unix(sshd:session): session closed for user root May 25 05:43:04 oleg113-client systemd[1]: session-588.scope: Succeeded. May 25 05:43:04 oleg113-client systemd-logind[1020]: Session 588 logged out. Waiting for processes to exit. May 25 05:43:04 oleg113-client systemd-logind[1020]: Removed session 588. May 25 05:43:07 oleg113-client sshd[113563]: Accepted publickey for root from 192.168.201.13 port 35744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:07 oleg113-client systemd[1]: Started Session 589 of user root. May 25 05:43:07 oleg113-client systemd-logind[1020]: New session 589 of user root. May 25 05:43:07 oleg113-client sshd[113563]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:08 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 152: QoS object allocation could be awakened in case of OST failover ========================================================== 05:43:04 (1779702184) May 25 05:43:08 oleg113-client sshd[113576]: Received disconnect from 192.168.201.13 port 35744:11: disconnected by user May 25 05:43:08 oleg113-client sshd[113576]: Disconnected from user root 192.168.201.13 port 35744 May 25 05:43:08 oleg113-client sshd[113563]: pam_unix(sshd:session): session closed for user root May 25 05:43:09 oleg113-client systemd[1]: session-589.scope: Succeeded. May 25 05:43:09 oleg113-client systemd-logind[1020]: Session 589 logged out. Waiting for processes to exit. May 25 05:43:09 oleg113-client systemd-logind[1020]: Removed session 589. May 25 05:43:39 oleg113-client sshd[113797]: Accepted publickey for root from 192.168.201.13 port 60986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:39 oleg113-client systemd-logind[1020]: New session 590 of user root. May 25 05:43:39 oleg113-client systemd[1]: Started Session 590 of user root. May 25 05:43:39 oleg113-client sshd[113797]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:40 oleg113-client sshd[113810]: Received disconnect from 192.168.201.13 port 60986:11: disconnected by user May 25 05:43:40 oleg113-client sshd[113810]: Disconnected from user root 192.168.201.13 port 60986 May 25 05:43:40 oleg113-client sshd[113797]: pam_unix(sshd:session): session closed for user root May 25 05:43:40 oleg113-client systemd[1]: session-590.scope: Succeeded. May 25 05:43:40 oleg113-client systemd-logind[1020]: Session 590 logged out. Waiting for processes to exit. May 25 05:43:40 oleg113-client systemd-logind[1020]: Removed session 590. May 25 05:43:42 oleg113-client sshd[113936]: Accepted publickey for root from 192.168.201.13 port 32768 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:42 oleg113-client systemd-logind[1020]: New session 591 of user root. May 25 05:43:42 oleg113-client systemd[1]: Started Session 591 of user root. May 25 05:43:42 oleg113-client sshd[113936]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:43 oleg113-client sshd[113949]: Received disconnect from 192.168.201.13 port 32768:11: disconnected by user May 25 05:43:43 oleg113-client sshd[113949]: Disconnected from user root 192.168.201.13 port 32768 May 25 05:43:43 oleg113-client sshd[113936]: pam_unix(sshd:session): session closed for user root May 25 05:43:43 oleg113-client systemd[1]: session-591.scope: Succeeded. May 25 05:43:43 oleg113-client systemd-logind[1020]: Session 591 logged out. Waiting for processes to exit. May 25 05:43:43 oleg113-client systemd-logind[1020]: Removed session 591. May 25 05:43:45 oleg113-client sshd[114082]: Accepted publickey for root from 192.168.201.13 port 32780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:45 oleg113-client systemd-logind[1020]: New session 592 of user root. May 25 05:43:45 oleg113-client systemd[1]: Started Session 592 of user root. May 25 05:43:45 oleg113-client sshd[114082]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:46 oleg113-client sshd[114095]: Received disconnect from 192.168.201.13 port 32780:11: disconnected by user May 25 05:43:46 oleg113-client sshd[114095]: Disconnected from user root 192.168.201.13 port 32780 May 25 05:43:46 oleg113-client sshd[114082]: pam_unix(sshd:session): session closed for user root May 25 05:43:46 oleg113-client systemd[1]: session-592.scope: Succeeded. May 25 05:43:46 oleg113-client systemd-logind[1020]: Session 592 logged out. Waiting for processes to exit. May 25 05:43:46 oleg113-client systemd-logind[1020]: Removed session 592. May 25 05:43:52 oleg113-client sshd[114250]: Accepted publickey for root from 192.168.201.13 port 35220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:43:52 oleg113-client systemd-logind[1020]: New session 593 of user root. May 25 05:43:52 oleg113-client systemd[1]: Started Session 593 of user root. May 25 05:43:52 oleg113-client sshd[114250]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:43:53 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 153: evict vs reconnect race ====== 05:43:50 (1779702230) May 25 05:43:53 oleg113-client sshd[114263]: Received disconnect from 192.168.201.13 port 35220:11: disconnected by user May 25 05:43:53 oleg113-client sshd[114263]: Disconnected from user root 192.168.201.13 port 35220 May 25 05:43:53 oleg113-client sshd[114250]: pam_unix(sshd:session): session closed for user root May 25 05:43:53 oleg113-client systemd-logind[1020]: Session 593 logged out. Waiting for processes to exit. May 25 05:43:53 oleg113-client systemd[1]: session-593.scope: Succeeded. May 25 05:43:53 oleg113-client systemd-logind[1020]: Removed session 593. May 25 05:44:55 oleg113-client sshd[114670]: Accepted publickey for root from 192.168.201.13 port 46316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:44:55 oleg113-client systemd-logind[1020]: New session 594 of user root. May 25 05:44:55 oleg113-client systemd[1]: Started Session 594 of user root. May 25 05:44:55 oleg113-client sshd[114670]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:44:56 oleg113-client sshd[114683]: Received disconnect from 192.168.201.13 port 46316:11: disconnected by user May 25 05:44:56 oleg113-client sshd[114683]: Disconnected from user root 192.168.201.13 port 46316 May 25 05:44:56 oleg113-client sshd[114670]: pam_unix(sshd:session): session closed for user root May 25 05:44:56 oleg113-client systemd-logind[1020]: Session 594 logged out. Waiting for processes to exit. May 25 05:44:56 oleg113-client systemd[1]: session-594.scope: Succeeded. May 25 05:44:56 oleg113-client systemd-logind[1020]: Removed session 594. May 25 05:44:57 oleg113-client sshd[114809]: Accepted publickey for root from 192.168.201.13 port 46322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:44:58 oleg113-client systemd-logind[1020]: New session 595 of user root. May 25 05:44:58 oleg113-client systemd[1]: Started Session 595 of user root. May 25 05:44:58 oleg113-client sshd[114809]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:44:58 oleg113-client sshd[114822]: Received disconnect from 192.168.201.13 port 46322:11: disconnected by user May 25 05:44:58 oleg113-client sshd[114822]: Disconnected from user root 192.168.201.13 port 46322 May 25 05:44:58 oleg113-client sshd[114809]: pam_unix(sshd:session): session closed for user root May 25 05:44:58 oleg113-client systemd-logind[1020]: Session 595 logged out. Waiting for processes to exit. May 25 05:44:58 oleg113-client systemd[1]: session-595.scope: Succeeded. May 25 05:44:58 oleg113-client systemd-logind[1020]: Removed session 595. May 25 05:45:00 oleg113-client sshd[114956]: Accepted publickey for root from 192.168.201.13 port 53806 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:45:00 oleg113-client systemd[1]: Started Session 596 of user root. May 25 05:45:00 oleg113-client systemd-logind[1020]: New session 596 of user root. May 25 05:45:00 oleg113-client sshd[114956]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:45:01 oleg113-client sshd[114969]: Received disconnect from 192.168.201.13 port 53806:11: disconnected by user May 25 05:45:01 oleg113-client sshd[114969]: Disconnected from user root 192.168.201.13 port 53806 May 25 05:45:01 oleg113-client sshd[114956]: pam_unix(sshd:session): session closed for user root May 25 05:45:01 oleg113-client systemd[1]: session-596.scope: Succeeded. May 25 05:45:01 oleg113-client systemd-logind[1020]: Session 596 logged out. Waiting for processes to exit. May 25 05:45:01 oleg113-client systemd-logind[1020]: Removed session 596. May 25 05:45:02 oleg113-client sshd[115111]: Accepted publickey for root from 192.168.201.13 port 53822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:45:02 oleg113-client systemd-logind[1020]: New session 597 of user root. May 25 05:45:02 oleg113-client systemd[1]: Started Session 597 of user root. May 25 05:45:02 oleg113-client sshd[115111]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:45:03 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154a: corruption update llog can be skipped ========================================================== 05:45:01 (1779702301) May 25 05:45:03 oleg113-client sshd[115124]: Received disconnect from 192.168.201.13 port 53822:11: disconnected by user May 25 05:45:03 oleg113-client sshd[115124]: Disconnected from user root 192.168.201.13 port 53822 May 25 05:45:03 oleg113-client sshd[115111]: pam_unix(sshd:session): session closed for user root May 25 05:45:03 oleg113-client systemd-logind[1020]: Session 597 logged out. Waiting for processes to exit. May 25 05:45:03 oleg113-client systemd[1]: session-597.scope: Succeeded. May 25 05:45:03 oleg113-client systemd-logind[1020]: Removed session 597. May 25 05:46:04 oleg113-client kernel: Lustre: Evicted from MGS (at 192.168.201.113@tcp) after server handle changed from 0x58062bb2b425cf2b to 0x58062bb2b425d608 May 25 05:46:04 oleg113-client kernel: Lustre: Skipped 4 previous similar messages May 25 05:46:21 oleg113-client sshd[115851]: Accepted publickey for root from 192.168.201.13 port 49094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:46:21 oleg113-client systemd-logind[1020]: New session 598 of user root. May 25 05:46:21 oleg113-client systemd[1]: Started Session 598 of user root. May 25 05:46:21 oleg113-client sshd[115851]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:46:21 oleg113-client sshd[115864]: Received disconnect from 192.168.201.13 port 49094:11: disconnected by user May 25 05:46:21 oleg113-client sshd[115864]: Disconnected from user root 192.168.201.13 port 49094 May 25 05:46:21 oleg113-client sshd[115851]: pam_unix(sshd:session): session closed for user root May 25 05:46:22 oleg113-client systemd[1]: session-598.scope: Succeeded. May 25 05:46:22 oleg113-client systemd-logind[1020]: Session 598 logged out. Waiting for processes to exit. May 25 05:46:22 oleg113-client systemd-logind[1020]: Removed session 598. May 25 05:46:23 oleg113-client sshd[115991]: Accepted publickey for root from 192.168.201.13 port 49102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:46:24 oleg113-client systemd[1]: Started Session 599 of user root. May 25 05:46:24 oleg113-client systemd-logind[1020]: New session 599 of user root. May 25 05:46:24 oleg113-client sshd[115991]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:46:24 oleg113-client sshd[116004]: Received disconnect from 192.168.201.13 port 49102:11: disconnected by user May 25 05:46:24 oleg113-client sshd[116004]: Disconnected from user root 192.168.201.13 port 49102 May 25 05:46:24 oleg113-client sshd[115991]: pam_unix(sshd:session): session closed for user root May 25 05:46:25 oleg113-client systemd[1]: session-599.scope: Succeeded. May 25 05:46:25 oleg113-client systemd-logind[1020]: Session 599 logged out. Waiting for processes to exit. May 25 05:46:25 oleg113-client systemd-logind[1020]: Removed session 599. May 25 05:46:26 oleg113-client sshd[116137]: Accepted publickey for root from 192.168.201.13 port 49106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:46:26 oleg113-client systemd-logind[1020]: New session 600 of user root. May 25 05:46:26 oleg113-client systemd[1]: Started Session 600 of user root. May 25 05:46:26 oleg113-client sshd[116137]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:46:27 oleg113-client sshd[116150]: Received disconnect from 192.168.201.13 port 49106:11: disconnected by user May 25 05:46:27 oleg113-client sshd[116150]: Disconnected from user root 192.168.201.13 port 49106 May 25 05:46:27 oleg113-client sshd[116137]: pam_unix(sshd:session): session closed for user root May 25 05:46:27 oleg113-client systemd-logind[1020]: Session 600 logged out. Waiting for processes to exit. May 25 05:46:27 oleg113-client systemd[1]: session-600.scope: Succeeded. May 25 05:46:27 oleg113-client systemd-logind[1020]: Removed session 600. May 25 05:46:29 oleg113-client sshd[116293]: Accepted publickey for root from 192.168.201.13 port 57144 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:46:29 oleg113-client systemd-logind[1020]: New session 601 of user root. May 25 05:46:29 oleg113-client systemd[1]: Started Session 601 of user root. May 25 05:46:29 oleg113-client sshd[116293]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:46:29 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154b: restore update llog after failed recovery ========================================================== 05:46:27 (1779702387) May 25 05:46:29 oleg113-client sshd[116306]: Received disconnect from 192.168.201.13 port 57144:11: disconnected by user May 25 05:46:29 oleg113-client sshd[116306]: Disconnected from user root 192.168.201.13 port 57144 May 25 05:46:29 oleg113-client sshd[116293]: pam_unix(sshd:session): session closed for user root May 25 05:46:29 oleg113-client systemd-logind[1020]: Session 601 logged out. Waiting for processes to exit. May 25 05:46:29 oleg113-client systemd[1]: session-601.scope: Succeeded. May 25 05:46:29 oleg113-client systemd-logind[1020]: Removed session 601. May 25 05:46:35 oleg113-client kernel: Lustre: lustre-MDT0000-mdc-ffff9b15c7938800: Connection to lustre-MDT0000 (at 192.168.201.113@tcp) was lost; in progress operations using this service will wait for recovery to complete May 25 05:46:35 oleg113-client kernel: Lustre: Skipped 9 previous similar messages May 25 05:46:51 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1779702395/real 1779702395] req@ffff9b15c47d8380 x1866143528880000/t0(0) o400->MGC192.168.201.113@tcp@192.168.201.113@tcp:26/25 lens 224/224 e 0 to 1 dl 1779702411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 May 25 05:46:51 oleg113-client kernel: Lustre: 2421:0:(client.c:2480:ptlrpc_expire_one_request()) Skipped 2 previous similar messages May 25 05:46:51 oleg113-client kernel: LustreError: MGC192.168.201.113@tcp: Connection to MGS (at 192.168.201.113@tcp) was lost; in progress operations using this service will fail May 25 05:46:51 oleg113-client kernel: LustreError: Skipped 4 previous similar messages May 25 05:46:51 oleg113-client kernel: Lustre: MGC192.168.201.113@tcp: Connection restored to 192.168.201.113@tcp (at 192.168.201.113@tcp) May 25 05:46:51 oleg113-client kernel: Lustre: Skipped 13 previous similar messages May 25 05:46:53 oleg113-client kernel: Lustre: 97370:0:(mgc_request.c:1899:mgc_process_log()) MGC192.168.201.113@tcp: IR log lustre-cliir failed, not fatal: rc = -2 May 25 05:47:07 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15c7938800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:47:24 oleg113-client systemd-udevd[116640]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:47:24 oleg113-client kernel: Lustre: Mounted lustre-client May 25 05:47:28 oleg113-client systemd[1]: mnt-lustre2.mount: Succeeded. May 25 05:47:28 oleg113-client kernel: LustreError: 116674:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c5d2c800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:47:28 oleg113-client kernel: LustreError: 116674:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:47:28 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:47:30 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:47:49 oleg113-client kernel: LustreError: 116694:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c7938800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:47:49 oleg113-client kernel: LustreError: 116694:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:47:49 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:47:50 oleg113-client systemd-udevd[116734]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:47:51 oleg113-client sshd[116836]: Accepted publickey for root from 192.168.201.13 port 45460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:47:51 oleg113-client systemd[1]: Started Session 602 of user root. May 25 05:47:51 oleg113-client systemd-logind[1020]: New session 602 of user root. May 25 05:47:51 oleg113-client sshd[116836]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:47:52 oleg113-client sshd[116849]: Received disconnect from 192.168.201.13 port 45460:11: disconnected by user May 25 05:47:52 oleg113-client sshd[116849]: Disconnected from user root 192.168.201.13 port 45460 May 25 05:47:52 oleg113-client sshd[116836]: pam_unix(sshd:session): session closed for user root May 25 05:47:52 oleg113-client systemd-logind[1020]: Session 602 logged out. Waiting for processes to exit. May 25 05:47:52 oleg113-client systemd[1]: session-602.scope: Succeeded. May 25 05:47:52 oleg113-client systemd-logind[1020]: Removed session 602. May 25 05:47:55 oleg113-client sshd[116975]: Accepted publickey for root from 192.168.201.13 port 45462 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:47:55 oleg113-client systemd-logind[1020]: New session 603 of user root. May 25 05:47:55 oleg113-client systemd[1]: Started Session 603 of user root. May 25 05:47:55 oleg113-client sshd[116975]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:47:56 oleg113-client sshd[116988]: Received disconnect from 192.168.201.13 port 45462:11: disconnected by user May 25 05:47:56 oleg113-client sshd[116988]: Disconnected from user root 192.168.201.13 port 45462 May 25 05:47:56 oleg113-client sshd[116975]: pam_unix(sshd:session): session closed for user root May 25 05:47:56 oleg113-client systemd[1]: session-603.scope: Succeeded. May 25 05:47:56 oleg113-client systemd-logind[1020]: Session 603 logged out. Waiting for processes to exit. May 25 05:47:56 oleg113-client systemd-logind[1020]: Removed session 603. May 25 05:47:59 oleg113-client sshd[117123]: Accepted publickey for root from 192.168.201.13 port 45478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:47:59 oleg113-client systemd-logind[1020]: New session 604 of user root. May 25 05:47:59 oleg113-client systemd[1]: Started Session 604 of user root. May 25 05:47:59 oleg113-client sshd[117123]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:47:59 oleg113-client sshd[117136]: Received disconnect from 192.168.201.13 port 45478:11: disconnected by user May 25 05:47:59 oleg113-client sshd[117136]: Disconnected from user root 192.168.201.13 port 45478 May 25 05:48:00 oleg113-client sshd[117123]: pam_unix(sshd:session): session closed for user root May 25 05:48:00 oleg113-client systemd[1]: session-604.scope: Succeeded. May 25 05:48:00 oleg113-client systemd-logind[1020]: Session 604 logged out. Waiting for processes to exit. May 25 05:48:00 oleg113-client systemd-logind[1020]: Removed session 604. May 25 05:48:03 oleg113-client sshd[117286]: Accepted publickey for root from 192.168.201.13 port 35116 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:48:03 oleg113-client systemd-logind[1020]: New session 605 of user root. May 25 05:48:03 oleg113-client systemd[1]: Started Session 605 of user root. May 25 05:48:03 oleg113-client sshd[117286]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:48:04 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 155: failover after client remount ========================================================== 05:48:01 (1779702481) May 25 05:48:04 oleg113-client sshd[117300]: Received disconnect from 192.168.201.13 port 35116:11: disconnected by user May 25 05:48:04 oleg113-client sshd[117300]: Disconnected from user root 192.168.201.13 port 35116 May 25 05:48:04 oleg113-client sshd[117286]: pam_unix(sshd:session): session closed for user root May 25 05:48:04 oleg113-client systemd[1]: session-605.scope: Succeeded. May 25 05:48:04 oleg113-client systemd-logind[1020]: Session 605 logged out. Waiting for processes to exit. May 25 05:48:04 oleg113-client systemd-logind[1020]: Removed session 605. May 25 05:48:10 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:48:10 oleg113-client kernel: LustreError: 117369:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15d1e38800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:48:10 oleg113-client kernel: LustreError: 117369:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:48:10 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:48:12 oleg113-client systemd-udevd[117416]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:48:13 oleg113-client kernel: Lustre: Mounted lustre-client May 25 05:48:13 oleg113-client kernel: Lustre: Skipped 1 previous similar message May 25 05:48:25 oleg113-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 May 25 05:49:26 oleg113-client sshd[117884]: Accepted publickey for root from 192.168.201.13 port 36484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:49:26 oleg113-client systemd-logind[1020]: New session 606 of user root. May 25 05:49:26 oleg113-client systemd[1]: Started Session 606 of user root. May 25 05:49:26 oleg113-client sshd[117884]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:49:26 oleg113-client sshd[117897]: Received disconnect from 192.168.201.13 port 36484:11: disconnected by user May 25 05:49:27 oleg113-client sshd[117897]: Disconnected from user root 192.168.201.13 port 36484 May 25 05:49:27 oleg113-client rsyslogd[1082]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] May 25 05:49:27 oleg113-client sshd[117884]: pam_unix(sshd:session): session closed for user root May 25 05:49:27 oleg113-client systemd[1]: session-606.scope: Succeeded. May 25 05:49:27 oleg113-client systemd-logind[1020]: Session 606 logged out. Waiting for processes to exit. May 25 05:49:27 oleg113-client systemd-logind[1020]: Removed session 606. May 25 05:49:28 oleg113-client sshd[118024]: Accepted publickey for root from 192.168.201.13 port 36494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:49:28 oleg113-client systemd[1]: Started Session 607 of user root. May 25 05:49:28 oleg113-client systemd-logind[1020]: New session 607 of user root. May 25 05:49:28 oleg113-client sshd[118024]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:49:29 oleg113-client sshd[118037]: Received disconnect from 192.168.201.13 port 36494:11: disconnected by user May 25 05:49:29 oleg113-client sshd[118037]: Disconnected from user root 192.168.201.13 port 36494 May 25 05:49:29 oleg113-client sshd[118024]: pam_unix(sshd:session): session closed for user root May 25 05:49:29 oleg113-client systemd-logind[1020]: Session 607 logged out. Waiting for processes to exit. May 25 05:49:29 oleg113-client systemd[1]: session-607.scope: Succeeded. May 25 05:49:29 oleg113-client systemd-logind[1020]: Removed session 607. May 25 05:49:30 oleg113-client sshd[118170]: Accepted publickey for root from 192.168.201.13 port 47306 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:49:30 oleg113-client systemd[1]: Started Session 608 of user root. May 25 05:49:30 oleg113-client systemd-logind[1020]: New session 608 of user root. May 25 05:49:30 oleg113-client sshd[118170]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:49:31 oleg113-client sshd[118183]: Received disconnect from 192.168.201.13 port 47306:11: disconnected by user May 25 05:49:31 oleg113-client sshd[118183]: Disconnected from user root 192.168.201.13 port 47306 May 25 05:49:31 oleg113-client sshd[118170]: pam_unix(sshd:session): session closed for user root May 25 05:49:31 oleg113-client systemd-logind[1020]: Session 608 logged out. Waiting for processes to exit. May 25 05:49:31 oleg113-client systemd[1]: session-608.scope: Succeeded. May 25 05:49:31 oleg113-client systemd-logind[1020]: Removed session 608. May 25 05:49:33 oleg113-client sshd[118327]: Accepted publickey for root from 192.168.201.13 port 47320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:49:33 oleg113-client systemd-logind[1020]: New session 609 of user root. May 25 05:49:33 oleg113-client systemd[1]: Started Session 609 of user root. May 25 05:49:33 oleg113-client sshd[118327]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:49:34 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 156: tot_granted miscount after client eviction ========================================================== 05:49:31 (1779702571) May 25 05:49:34 oleg113-client sshd[118340]: Received disconnect from 192.168.201.13 port 47320:11: disconnected by user May 25 05:49:34 oleg113-client sshd[118340]: Disconnected from user root 192.168.201.13 port 47320 May 25 05:49:34 oleg113-client sshd[118327]: pam_unix(sshd:session): session closed for user root May 25 05:49:34 oleg113-client systemd[1]: session-609.scope: Succeeded. May 25 05:49:34 oleg113-client systemd-logind[1020]: Session 609 logged out. Waiting for processes to exit. May 25 05:49:34 oleg113-client systemd-logind[1020]: Removed session 609. May 25 05:49:51 oleg113-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-OST0000 May 25 05:50:26 oleg113-client kernel: LustreError: 2418:0:(client.c:3523:ptlrpc_replay_req()) cfs_fail_timeout id 536 sleeping for 45000ms May 25 05:50:40 oleg113-client sshd[118806]: Accepted publickey for root from 192.168.201.13 port 33538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:50:40 oleg113-client systemd[1]: Started Session 610 of user root. May 25 05:50:40 oleg113-client systemd-logind[1020]: New session 610 of user root. May 25 05:50:40 oleg113-client sshd[118806]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:11 oleg113-client kernel: LustreError: 2418:0:(client.c:3523:ptlrpc_replay_req()) cfs_fail_timeout id 536 awake May 25 05:51:11 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5e000: operation ost_write to node 192.168.201.113@tcp failed: rc = -107 May 25 05:51:11 oleg113-client kernel: LustreError: Skipped 1 previous similar message May 25 05:51:11 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5e000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:51:11 oleg113-client sshd[118819]: Received disconnect from 192.168.201.13 port 33538:11: disconnected by user May 25 05:51:11 oleg113-client sshd[118819]: Disconnected from user root 192.168.201.13 port 33538 May 25 05:51:11 oleg113-client sshd[118806]: pam_unix(sshd:session): session closed for user root May 25 05:51:11 oleg113-client systemd-logind[1020]: Session 610 logged out. Waiting for processes to exit. May 25 05:51:12 oleg113-client systemd[1]: session-610.scope: Succeeded. May 25 05:51:12 oleg113-client systemd-logind[1020]: Removed session 610. May 25 05:51:19 oleg113-client sshd[119049]: Accepted publickey for root from 192.168.201.13 port 38642 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:19 oleg113-client systemd-logind[1020]: New session 611 of user root. May 25 05:51:19 oleg113-client systemd[1]: Started Session 611 of user root. May 25 05:51:19 oleg113-client sshd[119049]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:20 oleg113-client kernel: Lustre: DEBUG MARKER: oleg113-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid May 25 05:51:20 oleg113-client sshd[119062]: Received disconnect from 192.168.201.13 port 38642:11: disconnected by user May 25 05:51:20 oleg113-client sshd[119062]: Disconnected from user root 192.168.201.13 port 38642 May 25 05:51:20 oleg113-client sshd[119049]: pam_unix(sshd:session): session closed for user root May 25 05:51:20 oleg113-client systemd[1]: session-611.scope: Succeeded. May 25 05:51:20 oleg113-client systemd-logind[1020]: Session 611 logged out. Waiting for processes to exit. May 25 05:51:20 oleg113-client systemd-logind[1020]: Removed session 611. May 25 05:51:22 oleg113-client sshd[119205]: Accepted publickey for root from 192.168.201.13 port 38658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:22 oleg113-client systemd-logind[1020]: New session 612 of user root. May 25 05:51:22 oleg113-client systemd[1]: Started Session 612 of user root. May 25 05:51:22 oleg113-client sshd[119205]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:22 oleg113-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec May 25 05:51:22 oleg113-client sshd[119218]: Received disconnect from 192.168.201.13 port 38658:11: disconnected by user May 25 05:51:22 oleg113-client sshd[119218]: Disconnected from user root 192.168.201.13 port 38658 May 25 05:51:22 oleg113-client sshd[119205]: pam_unix(sshd:session): session closed for user root May 25 05:51:23 oleg113-client systemd-logind[1020]: Session 612 logged out. Waiting for processes to exit. May 25 05:51:23 oleg113-client systemd[1]: session-612.scope: Succeeded. May 25 05:51:23 oleg113-client systemd-logind[1020]: Removed session 612. May 25 05:51:25 oleg113-client sshd[119260]: Accepted publickey for root from 192.168.201.13 port 38672 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:25 oleg113-client systemd-logind[1020]: New session 613 of user root. May 25 05:51:25 oleg113-client systemd[1]: Started Session 613 of user root. May 25 05:51:25 oleg113-client sshd[119260]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:26 oleg113-client sshd[119273]: Received disconnect from 192.168.201.13 port 38672:11: disconnected by user May 25 05:51:26 oleg113-client sshd[119273]: Disconnected from user root 192.168.201.13 port 38672 May 25 05:51:26 oleg113-client sshd[119260]: pam_unix(sshd:session): session closed for user root May 25 05:51:26 oleg113-client systemd-logind[1020]: Session 613 logged out. Waiting for processes to exit. May 25 05:51:26 oleg113-client systemd[1]: session-613.scope: Succeeded. May 25 05:51:26 oleg113-client systemd-logind[1020]: Removed session 613. May 25 05:51:31 oleg113-client sshd[119420]: Accepted publickey for root from 192.168.201.13 port 45216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:31 oleg113-client systemd-logind[1020]: New session 614 of user root. May 25 05:51:31 oleg113-client systemd[1]: Started Session 614 of user root. May 25 05:51:31 oleg113-client sshd[119420]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:31 oleg113-client sshd[119433]: Received disconnect from 192.168.201.13 port 45216:11: disconnected by user May 25 05:51:31 oleg113-client sshd[119433]: Disconnected from user root 192.168.201.13 port 45216 May 25 05:51:32 oleg113-client sshd[119420]: pam_unix(sshd:session): session closed for user root May 25 05:51:32 oleg113-client systemd-logind[1020]: Session 614 logged out. Waiting for processes to exit. May 25 05:51:32 oleg113-client systemd[1]: session-614.scope: Succeeded. May 25 05:51:32 oleg113-client systemd-logind[1020]: Removed session 614. May 25 05:51:34 oleg113-client sshd[119559]: Accepted publickey for root from 192.168.201.13 port 45224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:34 oleg113-client systemd[1]: Started Session 615 of user root. May 25 05:51:34 oleg113-client systemd-logind[1020]: New session 615 of user root. May 25 05:51:34 oleg113-client sshd[119559]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:34 oleg113-client sshd[119572]: Received disconnect from 192.168.201.13 port 45224:11: disconnected by user May 25 05:51:34 oleg113-client sshd[119572]: Disconnected from user root 192.168.201.13 port 45224 May 25 05:51:34 oleg113-client sshd[119559]: pam_unix(sshd:session): session closed for user root May 25 05:51:34 oleg113-client systemd-logind[1020]: Session 615 logged out. Waiting for processes to exit. May 25 05:51:34 oleg113-client systemd[1]: session-615.scope: Succeeded. May 25 05:51:34 oleg113-client systemd-logind[1020]: Removed session 615. May 25 05:51:36 oleg113-client sshd[119706]: Accepted publickey for root from 192.168.201.13 port 45228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:36 oleg113-client systemd-logind[1020]: New session 616 of user root. May 25 05:51:36 oleg113-client systemd[1]: Started Session 616 of user root. May 25 05:51:36 oleg113-client sshd[119706]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:37 oleg113-client sshd[119720]: Received disconnect from 192.168.201.13 port 45228:11: disconnected by user May 25 05:51:37 oleg113-client sshd[119720]: Disconnected from user root 192.168.201.13 port 45228 May 25 05:51:37 oleg113-client sshd[119706]: pam_unix(sshd:session): session closed for user root May 25 05:51:37 oleg113-client systemd-logind[1020]: Session 616 logged out. Waiting for processes to exit. May 25 05:51:37 oleg113-client systemd[1]: session-616.scope: Succeeded. May 25 05:51:37 oleg113-client systemd-logind[1020]: Removed session 616. May 25 05:51:40 oleg113-client sshd[119872]: Accepted publickey for root from 192.168.201.13 port 59398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:40 oleg113-client systemd-logind[1020]: New session 617 of user root. May 25 05:51:40 oleg113-client systemd[1]: Started Session 617 of user root. May 25 05:51:40 oleg113-client sshd[119872]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:41 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 157: eviction during mmaped i/o === 05:51:39 (1779702699) May 25 05:51:41 oleg113-client sshd[119885]: Received disconnect from 192.168.201.13 port 59398:11: disconnected by user May 25 05:51:41 oleg113-client sshd[119885]: Disconnected from user root 192.168.201.13 port 59398 May 25 05:51:41 oleg113-client sshd[119872]: pam_unix(sshd:session): session closed for user root May 25 05:51:41 oleg113-client systemd[1]: session-617.scope: Succeeded. May 25 05:51:41 oleg113-client systemd-logind[1020]: Session 617 logged out. Waiting for processes to exit. May 25 05:51:41 oleg113-client systemd-logind[1020]: Removed session 617. May 25 05:51:42 oleg113-client kernel: LustreError: 119932:0:(vvp_io.c:1484:vvp_io_fault_start()) cfs_fail_timeout id 1432 sleeping for 3000ms May 25 05:51:45 oleg113-client kernel: LustreError: 119932:0:(vvp_io.c:1484:vvp_io_fault_start()) cfs_fail_timeout id 1432 awake May 25 05:51:45 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5e000: operation ost_read to node 192.168.201.113@tcp failed: rc = -107 May 25 05:51:45 oleg113-client kernel: LustreError: lustre-OST0000-osc-ffff9b15c7c5e000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. May 25 05:51:45 oleg113-client kernel: LustreError: 119946:0:(ldlm_resource.c:1180:ldlm_resource_complain()) lustre-OST0000-osc-ffff9b15c7c5e000: namespace resource [0x280000402:0x1523:0x0].0x0 (ffff9b15e708a600) refcount nonzero (1) after lock cleanup; forcing cleanup. May 25 05:51:45 oleg113-client systemd[1]: Created slice system-systemd\x2dcoredump.slice. May 25 05:51:45 oleg113-client systemd[119948]: systemd-coredump@0-119947-0.service: Failed to set up special execution directory in /var/lib: Read-only file system May 25 05:51:45 oleg113-client systemd[119948]: systemd-coredump@0-119947-0.service: Failed at step STATE_DIRECTORY spawning /usr/lib/systemd/systemd-coredump: Read-only file system May 25 05:51:45 oleg113-client systemd[1]: Started Process Core Dump (PID 119947/UID 0). May 25 05:51:45 oleg113-client systemd[1]: systemd-coredump@0-119947-0.service: Succeeded. May 25 05:51:47 oleg113-client sshd[120040]: Accepted publickey for root from 192.168.201.13 port 59408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:47 oleg113-client systemd-logind[1020]: New session 618 of user root. May 25 05:51:47 oleg113-client systemd[1]: Started Session 618 of user root. May 25 05:51:47 oleg113-client sshd[120040]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:47 oleg113-client sshd[120053]: Received disconnect from 192.168.201.13 port 59408:11: disconnected by user May 25 05:51:47 oleg113-client sshd[120053]: Disconnected from user root 192.168.201.13 port 59408 May 25 05:51:47 oleg113-client sshd[120040]: pam_unix(sshd:session): session closed for user root May 25 05:51:47 oleg113-client systemd[1]: session-618.scope: Succeeded. May 25 05:51:47 oleg113-client systemd-logind[1020]: Session 618 logged out. Waiting for processes to exit. May 25 05:51:47 oleg113-client systemd-logind[1020]: Removed session 618. May 25 05:51:50 oleg113-client sshd[120181]: Accepted publickey for root from 192.168.201.13 port 49058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:50 oleg113-client systemd[1]: Started Session 619 of user root. May 25 05:51:50 oleg113-client systemd-logind[1020]: New session 619 of user root. May 25 05:51:50 oleg113-client sshd[120181]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:51 oleg113-client sshd[120194]: Received disconnect from 192.168.201.13 port 49058:11: disconnected by user May 25 05:51:51 oleg113-client sshd[120194]: Disconnected from user root 192.168.201.13 port 49058 May 25 05:51:51 oleg113-client sshd[120181]: pam_unix(sshd:session): session closed for user root May 25 05:51:51 oleg113-client systemd-logind[1020]: Session 619 logged out. Waiting for processes to exit. May 25 05:51:51 oleg113-client systemd[1]: session-619.scope: Succeeded. May 25 05:51:51 oleg113-client systemd-logind[1020]: Removed session 619. May 25 05:51:53 oleg113-client sshd[120327]: Accepted publickey for root from 192.168.201.13 port 49060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:53 oleg113-client systemd-logind[1020]: New session 620 of user root. May 25 05:51:53 oleg113-client systemd[1]: Started Session 620 of user root. May 25 05:51:53 oleg113-client sshd[120327]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:53 oleg113-client sshd[120340]: Received disconnect from 192.168.201.13 port 49060:11: disconnected by user May 25 05:51:53 oleg113-client sshd[120340]: Disconnected from user root 192.168.201.13 port 49060 May 25 05:51:54 oleg113-client sshd[120327]: pam_unix(sshd:session): session closed for user root May 25 05:51:54 oleg113-client systemd[1]: session-620.scope: Succeeded. May 25 05:51:54 oleg113-client systemd-logind[1020]: Session 620 logged out. Waiting for processes to exit. May 25 05:51:54 oleg113-client systemd-logind[1020]: Removed session 620. May 25 05:51:56 oleg113-client sshd[120483]: Accepted publickey for root from 192.168.201.13 port 49064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:51:56 oleg113-client systemd-logind[1020]: New session 621 of user root. May 25 05:51:56 oleg113-client systemd[1]: Started Session 621 of user root. May 25 05:51:56 oleg113-client sshd[120483]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:51:57 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 158a: connect without access right ========================================================== 05:51:54 (1779702714) May 25 05:51:57 oleg113-client sshd[120496]: Received disconnect from 192.168.201.13 port 49064:11: disconnected by user May 25 05:51:57 oleg113-client sshd[120496]: Disconnected from user root 192.168.201.13 port 49064 May 25 05:51:57 oleg113-client sshd[120483]: pam_unix(sshd:session): session closed for user root May 25 05:51:58 oleg113-client systemd[1]: session-621.scope: Succeeded. May 25 05:51:58 oleg113-client systemd-logind[1020]: Session 621 logged out. Waiting for processes to exit. May 25 05:51:58 oleg113-client systemd-logind[1020]: Removed session 621. May 25 05:52:01 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:52:01 oleg113-client kernel: LustreError: 120551:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c7c5e000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:52:01 oleg113-client kernel: LustreError: 120551:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:52:01 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:52:02 oleg113-client systemd-udevd[120588]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:52:02 oleg113-client kernel: Lustre: Mounted lustre-client May 25 05:52:37 oleg113-client kernel: Lustre: lustre-MDT0001-mdc-ffff9b15c793d800: connection denied by lustre-MDT0001_UUID: rc = -13 May 25 05:52:37 oleg113-client kernel: LustreError: lustre-MDT0001-mdc-ffff9b15c793d800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. May 25 05:53:07 oleg113-client kernel: LustreError: lustre-MDT0001-mdc-ffff9b15c793d800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. May 25 05:53:09 oleg113-client sshd[121035]: Accepted publickey for root from 192.168.201.13 port 43382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:53:09 oleg113-client systemd-logind[1020]: New session 622 of user root. May 25 05:53:09 oleg113-client systemd[1]: Started Session 622 of user root. May 25 05:53:09 oleg113-client sshd[121035]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:53:10 oleg113-client sshd[121048]: Received disconnect from 192.168.201.13 port 43382:11: disconnected by user May 25 05:53:10 oleg113-client sshd[121048]: Disconnected from user root 192.168.201.13 port 43382 May 25 05:53:10 oleg113-client sshd[121035]: pam_unix(sshd:session): session closed for user root May 25 05:53:11 oleg113-client systemd[1]: session-622.scope: Succeeded. May 25 05:53:11 oleg113-client systemd-logind[1020]: Session 622 logged out. Waiting for processes to exit. May 25 05:53:11 oleg113-client systemd-logind[1020]: Removed session 622. May 25 05:53:12 oleg113-client sshd[121175]: Accepted publickey for root from 192.168.201.13 port 43394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:53:13 oleg113-client systemd-logind[1020]: New session 623 of user root. May 25 05:53:13 oleg113-client systemd[1]: Started Session 623 of user root. May 25 05:53:13 oleg113-client sshd[121175]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:53:13 oleg113-client sshd[121188]: Received disconnect from 192.168.201.13 port 43394:11: disconnected by user May 25 05:53:13 oleg113-client sshd[121188]: Disconnected from user root 192.168.201.13 port 43394 May 25 05:53:13 oleg113-client sshd[121175]: pam_unix(sshd:session): session closed for user root May 25 05:53:14 oleg113-client systemd-logind[1020]: Session 623 logged out. Waiting for processes to exit. May 25 05:53:14 oleg113-client systemd[1]: session-623.scope: Succeeded. May 25 05:53:14 oleg113-client systemd-logind[1020]: Removed session 623. May 25 05:53:17 oleg113-client sshd[121321]: Accepted publickey for root from 192.168.201.13 port 43410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:53:17 oleg113-client systemd-logind[1020]: New session 624 of user root. May 25 05:53:17 oleg113-client systemd[1]: Started Session 624 of user root. May 25 05:53:17 oleg113-client sshd[121321]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:53:18 oleg113-client sshd[121334]: Received disconnect from 192.168.201.13 port 43410:11: disconnected by user May 25 05:53:18 oleg113-client sshd[121334]: Disconnected from user root 192.168.201.13 port 43410 May 25 05:53:18 oleg113-client sshd[121321]: pam_unix(sshd:session): session closed for user root May 25 05:53:18 oleg113-client systemd-logind[1020]: Session 624 logged out. Waiting for processes to exit. May 25 05:53:18 oleg113-client systemd[1]: session-624.scope: Succeeded. May 25 05:53:18 oleg113-client systemd-logind[1020]: Removed session 624. May 25 05:53:24 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 05:53:24 oleg113-client kernel: LustreError: 121391:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15c793d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 05:53:24 oleg113-client kernel: LustreError: 121391:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 05:53:24 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 05:53:25 oleg113-client systemd-udevd[121431]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. May 25 05:53:28 oleg113-client sshd[121483]: Accepted publickey for root from 192.168.201.13 port 46166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:53:28 oleg113-client systemd-logind[1020]: New session 625 of user root. May 25 05:53:28 oleg113-client systemd[1]: Started Session 625 of user root. May 25 05:53:28 oleg113-client sshd[121483]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:53:28 oleg113-client sshd[121496]: Received disconnect from 192.168.201.13 port 46166:11: disconnected by user May 25 05:53:29 oleg113-client sshd[121496]: Disconnected from user root 192.168.201.13 port 46166 May 25 05:53:29 oleg113-client sshd[121483]: pam_unix(sshd:session): session closed for user root May 25 05:53:29 oleg113-client systemd[1]: session-625.scope: Succeeded. May 25 05:53:29 oleg113-client systemd-logind[1020]: Session 625 logged out. Waiting for processes to exit. May 25 05:53:29 oleg113-client systemd-logind[1020]: Removed session 625. May 25 05:53:31 oleg113-client sshd[121635]: Accepted publickey for root from 192.168.201.13 port 57026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:53:31 oleg113-client systemd-logind[1020]: New session 626 of user root. May 25 05:53:31 oleg113-client systemd[1]: Started Session 626 of user root. May 25 05:53:31 oleg113-client sshd[121635]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:53:31 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 160: MDT destroys are blocked by grouplocks ========================================================== 05:53:29 (1779702809) May 25 05:53:31 oleg113-client sshd[121649]: Received disconnect from 192.168.201.13 port 57026:11: disconnected by user May 25 05:53:31 oleg113-client sshd[121649]: Disconnected from user root 192.168.201.13 port 57026 May 25 05:53:31 oleg113-client sshd[121635]: pam_unix(sshd:session): session closed for user root May 25 05:53:31 oleg113-client systemd[1]: session-626.scope: Succeeded. May 25 05:53:31 oleg113-client systemd-logind[1020]: Session 626 logged out. Waiting for processes to exit. May 25 05:53:31 oleg113-client systemd-logind[1020]: Removed session 626. May 25 05:53:36 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15cac4a800: operation ldlm_enqueue to node 192.168.201.113@tcp failed: rc = -107 May 25 05:53:36 oleg113-client kernel: LustreError: lustre-MDT0000-mdc-ffff9b15cac4a800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. May 25 05:54:24 oleg113-client sshd[121895]: Accepted publickey for root from 192.168.201.13 port 42120 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:24 oleg113-client systemd[1]: Started Session 627 of user root. May 25 05:54:24 oleg113-client systemd-logind[1020]: New session 627 of user root. May 25 05:54:24 oleg113-client sshd[121895]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:25 oleg113-client sshd[121908]: Received disconnect from 192.168.201.13 port 42120:11: disconnected by user May 25 05:54:25 oleg113-client sshd[121908]: Disconnected from user root 192.168.201.13 port 42120 May 25 05:54:25 oleg113-client sshd[121895]: pam_unix(sshd:session): session closed for user root May 25 05:54:25 oleg113-client systemd-logind[1020]: Session 627 logged out. Waiting for processes to exit. May 25 05:54:25 oleg113-client systemd[1]: session-627.scope: Succeeded. May 25 05:54:25 oleg113-client systemd-logind[1020]: Removed session 627. May 25 05:54:27 oleg113-client sshd[122034]: Accepted publickey for root from 192.168.201.13 port 42124 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:27 oleg113-client systemd-logind[1020]: New session 628 of user root. May 25 05:54:27 oleg113-client systemd[1]: Started Session 628 of user root. May 25 05:54:27 oleg113-client sshd[122034]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:27 oleg113-client sshd[122047]: Received disconnect from 192.168.201.13 port 42124:11: disconnected by user May 25 05:54:27 oleg113-client sshd[122047]: Disconnected from user root 192.168.201.13 port 42124 May 25 05:54:27 oleg113-client sshd[122034]: pam_unix(sshd:session): session closed for user root May 25 05:54:28 oleg113-client systemd[1]: session-628.scope: Succeeded. May 25 05:54:28 oleg113-client systemd-logind[1020]: Session 628 logged out. Waiting for processes to exit. May 25 05:54:28 oleg113-client systemd-logind[1020]: Removed session 628. May 25 05:54:29 oleg113-client sshd[122181]: Accepted publickey for root from 192.168.201.13 port 51254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:29 oleg113-client systemd-logind[1020]: New session 629 of user root. May 25 05:54:29 oleg113-client systemd[1]: Started Session 629 of user root. May 25 05:54:29 oleg113-client sshd[122181]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:30 oleg113-client sshd[122194]: Received disconnect from 192.168.201.13 port 51254:11: disconnected by user May 25 05:54:30 oleg113-client sshd[122194]: Disconnected from user root 192.168.201.13 port 51254 May 25 05:54:30 oleg113-client sshd[122181]: pam_unix(sshd:session): session closed for user root May 25 05:54:30 oleg113-client systemd[1]: session-629.scope: Succeeded. May 25 05:54:30 oleg113-client systemd-logind[1020]: Session 629 logged out. Waiting for processes to exit. May 25 05:54:30 oleg113-client systemd-logind[1020]: Removed session 629. May 25 05:54:32 oleg113-client sshd[122336]: Accepted publickey for root from 192.168.201.13 port 51264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:32 oleg113-client systemd-logind[1020]: New session 630 of user root. May 25 05:54:32 oleg113-client systemd[1]: Started Session 630 of user root. May 25 05:54:32 oleg113-client sshd[122336]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:33 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 161: evict osp by ping evictor ==== 05:54:30 (1779702870) May 25 05:54:33 oleg113-client sshd[122349]: Received disconnect from 192.168.201.13 port 51264:11: disconnected by user May 25 05:54:33 oleg113-client sshd[122349]: Disconnected from user root 192.168.201.13 port 51264 May 25 05:54:33 oleg113-client sshd[122336]: pam_unix(sshd:session): session closed for user root May 25 05:54:33 oleg113-client systemd-logind[1020]: Session 630 logged out. Waiting for processes to exit. May 25 05:54:33 oleg113-client systemd[1]: session-630.scope: Succeeded. May 25 05:54:33 oleg113-client systemd-logind[1020]: Removed session 630. May 25 05:54:47 oleg113-client sshd[122486]: Accepted publickey for root from 192.168.201.13 port 52460 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:47 oleg113-client systemd-logind[1020]: New session 631 of user root. May 25 05:54:47 oleg113-client systemd[1]: Started Session 631 of user root. May 25 05:54:47 oleg113-client sshd[122486]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:48 oleg113-client sshd[122499]: Received disconnect from 192.168.201.13 port 52460:11: disconnected by user May 25 05:54:48 oleg113-client sshd[122499]: Disconnected from user root 192.168.201.13 port 52460 May 25 05:54:48 oleg113-client sshd[122486]: pam_unix(sshd:session): session closed for user root May 25 05:54:48 oleg113-client systemd-logind[1020]: Session 631 logged out. Waiting for processes to exit. May 25 05:54:48 oleg113-client systemd[1]: session-631.scope: Succeeded. May 25 05:54:48 oleg113-client systemd-logind[1020]: Removed session 631. May 25 05:54:51 oleg113-client sshd[122626]: Accepted publickey for root from 192.168.201.13 port 43986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:51 oleg113-client systemd-logind[1020]: New session 632 of user root. May 25 05:54:51 oleg113-client systemd[1]: Started Session 632 of user root. May 25 05:54:51 oleg113-client sshd[122626]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:52 oleg113-client sshd[122639]: Received disconnect from 192.168.201.13 port 43986:11: disconnected by user May 25 05:54:52 oleg113-client sshd[122639]: Disconnected from user root 192.168.201.13 port 43986 May 25 05:54:52 oleg113-client sshd[122626]: pam_unix(sshd:session): session closed for user root May 25 05:54:52 oleg113-client systemd[1]: session-632.scope: Succeeded. May 25 05:54:52 oleg113-client systemd-logind[1020]: Session 632 logged out. Waiting for processes to exit. May 25 05:54:52 oleg113-client systemd-logind[1020]: Removed session 632. May 25 05:54:54 oleg113-client sshd[122772]: Accepted publickey for root from 192.168.201.13 port 43996 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:54 oleg113-client systemd-logind[1020]: New session 633 of user root. May 25 05:54:54 oleg113-client systemd[1]: Started Session 633 of user root. May 25 05:54:54 oleg113-client sshd[122772]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:55 oleg113-client sshd[122785]: Received disconnect from 192.168.201.13 port 43996:11: disconnected by user May 25 05:54:55 oleg113-client sshd[122785]: Disconnected from user root 192.168.201.13 port 43996 May 25 05:54:55 oleg113-client sshd[122772]: pam_unix(sshd:session): session closed for user root May 25 05:54:55 oleg113-client systemd-logind[1020]: Session 633 logged out. Waiting for processes to exit. May 25 05:54:55 oleg113-client systemd[1]: session-633.scope: Succeeded. May 25 05:54:55 oleg113-client systemd-logind[1020]: Removed session 633. May 25 05:54:58 oleg113-client sshd[122928]: Accepted publickey for root from 192.168.201.13 port 44000 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:54:58 oleg113-client systemd[1]: Started Session 634 of user root. May 25 05:54:58 oleg113-client systemd-logind[1020]: New session 634 of user root. May 25 05:54:58 oleg113-client sshd[122928]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:54:59 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 162: File attributes should be persisted after MDS failover ========================================================== 05:54:56 (1779702896) May 25 05:54:59 oleg113-client sshd[122941]: Received disconnect from 192.168.201.13 port 44000:11: disconnected by user May 25 05:54:59 oleg113-client sshd[122941]: Disconnected from user root 192.168.201.13 port 44000 May 25 05:54:59 oleg113-client sshd[122928]: pam_unix(sshd:session): session closed for user root May 25 05:54:59 oleg113-client systemd-logind[1020]: Session 634 logged out. Waiting for processes to exit. May 25 05:54:59 oleg113-client systemd[1]: session-634.scope: Succeeded. May 25 05:54:59 oleg113-client systemd-logind[1020]: Removed session 634. May 25 05:55:19 oleg113-client kernel: LustreError: 2418:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff9b15c4f3b800 x1866143529098752/t163208757318(163208757318) o101->lustre-MDT0000-mdc-ffff9b15cac4a800@192.168.201.113@tcp:12/10 lens 576/608 e 0 to 0 dl 1779702974 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'chattr.0' uid:0 gid:0 projid:0 May 25 05:55:35 oleg113-client sshd[123348]: Accepted publickey for root from 192.168.201.13 port 52304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:55:35 oleg113-client systemd-logind[1020]: New session 635 of user root. May 25 05:55:35 oleg113-client systemd[1]: Started Session 635 of user root. May 25 05:55:35 oleg113-client sshd[123348]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:55:35 oleg113-client sshd[123361]: Received disconnect from 192.168.201.13 port 52304:11: disconnected by user May 25 05:55:35 oleg113-client sshd[123361]: Disconnected from user root 192.168.201.13 port 52304 May 25 05:55:35 oleg113-client sshd[123348]: pam_unix(sshd:session): session closed for user root May 25 05:55:36 oleg113-client systemd[1]: session-635.scope: Succeeded. May 25 05:55:36 oleg113-client systemd-logind[1020]: Session 635 logged out. Waiting for processes to exit. May 25 05:55:36 oleg113-client systemd-logind[1020]: Removed session 635. May 25 05:55:37 oleg113-client sshd[123488]: Accepted publickey for root from 192.168.201.13 port 52314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:55:37 oleg113-client systemd-logind[1020]: New session 636 of user root. May 25 05:55:37 oleg113-client systemd[1]: Started Session 636 of user root. May 25 05:55:37 oleg113-client sshd[123488]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:55:38 oleg113-client sshd[123501]: Received disconnect from 192.168.201.13 port 52314:11: disconnected by user May 25 05:55:38 oleg113-client sshd[123501]: Disconnected from user root 192.168.201.13 port 52314 May 25 05:55:38 oleg113-client sshd[123488]: pam_unix(sshd:session): session closed for user root May 25 05:55:38 oleg113-client systemd-logind[1020]: Session 636 logged out. Waiting for processes to exit. May 25 05:55:38 oleg113-client systemd[1]: session-636.scope: Succeeded. May 25 05:55:38 oleg113-client systemd-logind[1020]: Removed session 636. May 25 05:55:40 oleg113-client sshd[123634]: Accepted publickey for root from 192.168.201.13 port 54780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:55:40 oleg113-client systemd-logind[1020]: New session 637 of user root. May 25 05:55:40 oleg113-client systemd[1]: Started Session 637 of user root. May 25 05:55:40 oleg113-client sshd[123634]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:55:41 oleg113-client sshd[123648]: Received disconnect from 192.168.201.13 port 54780:11: disconnected by user May 25 05:55:41 oleg113-client sshd[123648]: Disconnected from user root 192.168.201.13 port 54780 May 25 05:55:41 oleg113-client sshd[123634]: pam_unix(sshd:session): session closed for user root May 25 05:55:42 oleg113-client systemd-logind[1020]: Session 637 logged out. Waiting for processes to exit. May 25 05:55:42 oleg113-client systemd[1]: session-637.scope: Succeeded. May 25 05:55:42 oleg113-client systemd-logind[1020]: Removed session 637. May 25 05:55:44 oleg113-client sshd[123792]: Accepted publickey for root from 192.168.201.13 port 54782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:55:44 oleg113-client systemd-logind[1020]: New session 638 of user root. May 25 05:55:44 oleg113-client systemd[1]: Started Session 638 of user root. May 25 05:55:44 oleg113-client sshd[123792]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:55:45 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test 163: changelog check for fail write and processing records ========================================================== 05:55:42 (1779702942) May 25 05:55:45 oleg113-client sshd[123805]: Received disconnect from 192.168.201.13 port 54782:11: disconnected by user May 25 05:55:45 oleg113-client sshd[123805]: Disconnected from user root 192.168.201.13 port 54782 May 25 05:55:45 oleg113-client sshd[123792]: pam_unix(sshd:session): session closed for user root May 25 05:55:45 oleg113-client systemd[1]: session-638.scope: Succeeded. May 25 05:55:45 oleg113-client systemd-logind[1020]: Session 638 logged out. Waiting for processes to exit. May 25 05:55:45 oleg113-client systemd-logind[1020]: Removed session 638. May 25 05:56:06 oleg113-client sshd[124159]: Accepted publickey for root from 192.168.201.13 port 47316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:56:06 oleg113-client systemd-logind[1020]: New session 639 of user root. May 25 05:56:06 oleg113-client systemd[1]: Started Session 639 of user root. May 25 05:56:06 oleg113-client sshd[124159]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:56:06 oleg113-client sshd[124172]: Received disconnect from 192.168.201.13 port 47316:11: disconnected by user May 25 05:56:06 oleg113-client sshd[124172]: Disconnected from user root 192.168.201.13 port 47316 May 25 05:56:06 oleg113-client sshd[124159]: pam_unix(sshd:session): session closed for user root May 25 05:56:07 oleg113-client systemd[1]: session-639.scope: Succeeded. May 25 05:56:07 oleg113-client systemd-logind[1020]: Session 639 logged out. Waiting for processes to exit. May 25 05:56:07 oleg113-client systemd-logind[1020]: Removed session 639. May 25 05:56:09 oleg113-client sshd[124298]: Accepted publickey for root from 192.168.201.13 port 47332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:56:09 oleg113-client systemd-logind[1020]: New session 640 of user root. May 25 05:56:09 oleg113-client systemd[1]: Started Session 640 of user root. May 25 05:56:09 oleg113-client sshd[124298]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:56:10 oleg113-client sshd[124311]: Received disconnect from 192.168.201.13 port 47332:11: disconnected by user May 25 05:56:10 oleg113-client sshd[124311]: Disconnected from user root 192.168.201.13 port 47332 May 25 05:56:10 oleg113-client sshd[124298]: pam_unix(sshd:session): session closed for user root May 25 05:56:10 oleg113-client systemd[1]: session-640.scope: Succeeded. May 25 05:56:10 oleg113-client systemd-logind[1020]: Session 640 logged out. Waiting for processes to exit. May 25 05:56:10 oleg113-client systemd-logind[1020]: Removed session 640. May 25 05:56:12 oleg113-client sshd[124445]: Accepted publickey for root from 192.168.201.13 port 40896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:56:12 oleg113-client systemd-logind[1020]: New session 641 of user root. May 25 05:56:12 oleg113-client systemd[1]: Started Session 641 of user root. May 25 05:56:12 oleg113-client sshd[124445]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:56:13 oleg113-client sshd[124458]: Received disconnect from 192.168.201.13 port 40896:11: disconnected by user May 25 05:56:13 oleg113-client sshd[124458]: Disconnected from user root 192.168.201.13 port 40896 May 25 05:56:13 oleg113-client sshd[124445]: pam_unix(sshd:session): session closed for user root May 25 05:56:13 oleg113-client systemd[1]: session-641.scope: Succeeded. May 25 05:56:13 oleg113-client systemd-logind[1020]: Session 641 logged out. Waiting for processes to exit. May 25 05:56:13 oleg113-client systemd-logind[1020]: Removed session 641. May 25 05:56:28 oleg113-client sshd[124704]: Accepted publickey for root from 192.168.201.13 port 60448 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:56:28 oleg113-client systemd-logind[1020]: New session 642 of user root. May 25 05:56:28 oleg113-client systemd[1]: Started Session 642 of user root. May 25 05:56:28 oleg113-client sshd[124704]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:56:28 oleg113-client kernel: Lustre: DEBUG MARKER: == recovery-small test complete, duration 9601 sec ======= 05:56:26 (1779702986) May 25 05:56:28 oleg113-client sshd[124717]: Received disconnect from 192.168.201.13 port 60448:11: disconnected by user May 25 05:56:28 oleg113-client sshd[124717]: Disconnected from user root 192.168.201.13 port 60448 May 25 05:56:28 oleg113-client sshd[124704]: pam_unix(sshd:session): session closed for user root May 25 05:56:29 oleg113-client systemd-logind[1020]: Session 642 logged out. Waiting for processes to exit. May 25 05:56:29 oleg113-client systemd[1]: session-642.scope: Succeeded. May 25 05:56:29 oleg113-client systemd-logind[1020]: Removed session 642. May 25 05:56:30 oleg113-client sshd[124850]: Accepted publickey for root from 192.168.201.13 port 41110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 05:56:31 oleg113-client systemd[1]: Started Session 643 of user root. May 25 05:56:31 oleg113-client systemd-logind[1020]: New session 643 of user root. May 25 05:56:31 oleg113-client sshd[124850]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 05:56:31 oleg113-client kernel: Lustre: DEBUG MARKER: === recovery-small: start cleanup 05:56:28 (1779702988) === May 25 05:56:31 oleg113-client sshd[124863]: Received disconnect from 192.168.201.13 port 41110:11: disconnected by user May 25 05:56:31 oleg113-client sshd[124863]: Disconnected from user root 192.168.201.13 port 41110 May 25 05:56:31 oleg113-client sshd[124850]: pam_unix(sshd:session): session closed for user root May 25 05:56:32 oleg113-client systemd[1]: session-643.scope: Succeeded. May 25 05:56:32 oleg113-client systemd-logind[1020]: Session 643 logged out. Waiting for processes to exit. May 25 05:56:32 oleg113-client systemd-logind[1020]: Removed session 643. May 25 05:58:21 oleg113-client systemd[1]: Starting dnf makecache... May 25 05:58:28 oleg113-client dnf[124932]: Failed determining last makecache time. May 25 05:58:28 oleg113-client dnf[124932]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' May 25 05:58:28 oleg113-client dnf[124932]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' May 25 05:58:29 oleg113-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE May 25 05:58:29 oleg113-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. May 25 05:58:29 oleg113-client systemd[1]: Failed to start dnf makecache. May 25 06:01:01 oleg113-client CROND[124960]: (root) CMD (run-parts /etc/cron.hourly) May 25 06:01:01 oleg113-client run-parts[124960]: (/etc/cron.hourly) starting 0anacron May 25 06:01:01 oleg113-client run-parts[124960]: (/etc/cron.hourly) finished 0anacron May 25 06:03:21 oleg113-client sshd[125085]: Accepted publickey for root from 192.168.201.13 port 47364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 06:03:21 oleg113-client systemd-logind[1020]: New session 644 of user root. May 25 06:03:21 oleg113-client systemd[1]: Started Session 644 of user root. May 25 06:03:21 oleg113-client sshd[125085]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 06:03:21 oleg113-client sshd[125098]: Received disconnect from 192.168.201.13 port 47364:11: disconnected by user May 25 06:03:21 oleg113-client sshd[125098]: Disconnected from user root 192.168.201.13 port 47364 May 25 06:03:21 oleg113-client sshd[125085]: pam_unix(sshd:session): session closed for user root May 25 06:03:22 oleg113-client systemd[1]: session-644.scope: Succeeded. May 25 06:03:22 oleg113-client systemd-logind[1020]: Session 644 logged out. Waiting for processes to exit. May 25 06:03:22 oleg113-client systemd-logind[1020]: Removed session 644. May 25 06:03:24 oleg113-client sshd[125226]: Accepted publickey for root from 192.168.201.13 port 47368 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU May 25 06:03:24 oleg113-client systemd-logind[1020]: New session 645 of user root. May 25 06:03:24 oleg113-client systemd[1]: Started Session 645 of user root. May 25 06:03:24 oleg113-client sshd[125226]: pam_unix(sshd:session): session opened for user root by (uid=0) May 25 06:03:25 oleg113-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish cleanup 06:03:23 (1779703403) === May 25 06:03:25 oleg113-client sshd[125239]: Received disconnect from 192.168.201.13 port 47368:11: disconnected by user May 25 06:03:25 oleg113-client sshd[125239]: Disconnected from user root 192.168.201.13 port 47368 May 25 06:03:25 oleg113-client sshd[125226]: pam_unix(sshd:session): session closed for user root May 25 06:03:25 oleg113-client systemd[1]: session-645.scope: Succeeded. May 25 06:03:25 oleg113-client systemd-logind[1020]: Session 645 logged out. Waiting for processes to exit. May 25 06:03:25 oleg113-client systemd-logind[1020]: Removed session 645. May 25 06:03:27 oleg113-client systemd[1]: mnt-lustre.mount: Succeeded. May 25 06:03:28 oleg113-client kernel: LustreError: 125296:0:(lov_obd.c:792:lov_cleanup()) lustre-clilov-ffff9b15cac4a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 May 25 06:03:28 oleg113-client kernel: LustreError: 125296:0:(lov_obd.c:792:lov_cleanup()) Skipped 1 previous similar message May 25 06:03:28 oleg113-client kernel: Lustre: Unmounted lustre-client May 25 06:04:44 oleg113-client kernel: Key type lgssc unregistered May 25 06:04:44 oleg113-client kernel: LNet: 125986:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit May 25 06:04:44 oleg113-client kernel: LNetError: 125986:0:(acceptor.c:246:lnet_acceptor_remove_socket()) Interface ens2 not found May 25 06:04:44 oleg113-client kernel: LNet: Removed LNI 192.168.201.13@tcp May 25 06:04:46 oleg113-client kernel: Key type .llcrypt unregistered May 25 06:04:46 oleg113-client kernel: Key type ._llcrypt unregistered May 25 06:04:47 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event0 (Power Button) May 25 06:04:47 oleg113-client systemd-udevd[126055]: Using default interface naming scheme 'rhel-8.0'. May 25 06:04:47 oleg113-client systemd-logind[1020]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) May 25 06:05:00 oleg113-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. May 25 06:05:00 oleg113-client sshd[1549]: Received disconnect from 192.168.200.253 port 47094:11: disconnected by user May 25 06:05:00 oleg113-client sshd[1549]: Disconnected from user root 192.168.200.253 port 47094 May 25 06:05:00 oleg113-client sshd[1526]: pam_unix(sshd:session): session closed for user root May 25 06:05:00 oleg113-client systemd-logind[1020]: Session 3 logged out. Waiting for processes to exit. May 25 06:05:00 oleg113-client systemd[1]: session-3.scope: Succeeded. May 25 06:05:00 oleg113-client systemd-logind[1020]: Removed session 3.