Nov 18 18:01:13 oleg228-client kernel: Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 Nov 18 18:01:13 oleg228-client kernel: Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Nov 18 18:01:13 oleg228-client kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Nov 18 18:01:13 oleg228-client kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Nov 18 18:01:13 oleg228-client kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Nov 18 18:01:13 oleg228-client kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Nov 18 18:01:13 oleg228-client kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Nov 18 18:01:13 oleg228-client kernel: signal: max sigframe size: 1776 Nov 18 18:01:13 oleg228-client kernel: BIOS-provided physical RAM map: Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Nov 18 18:01:13 oleg228-client kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable Nov 18 18:01:13 oleg228-client kernel: NX (Execute Disable) protection: active Nov 18 18:01:13 oleg228-client kernel: SMBIOS 2.8 present. Nov 18 18:01:13 oleg228-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 Nov 18 18:01:13 oleg228-client kernel: Hypervisor detected: KVM Nov 18 18:01:13 oleg228-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Nov 18 18:01:13 oleg228-client kernel: kvm-clock: using sched offset of 496058855 cycles Nov 18 18:01:13 oleg228-client kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Nov 18 18:01:13 oleg228-client kernel: tsc: Detected 2399.998 MHz processor Nov 18 18:01:13 oleg228-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Nov 18 18:01:13 oleg228-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Nov 18 18:01:13 oleg228-client kernel: last_pfn = 0x146e00 max_arch_pfn = 0x400000000 Nov 18 18:01:13 oleg228-client kernel: MTRR default type: write-back Nov 18 18:01:13 oleg228-client kernel: MTRR fixed ranges enabled: Nov 18 18:01:13 oleg228-client kernel: 00000-9FFFF write-back Nov 18 18:01:13 oleg228-client kernel: A0000-BFFFF uncachable Nov 18 18:01:13 oleg228-client kernel: C0000-FFFFF write-protect Nov 18 18:01:13 oleg228-client kernel: MTRR variable ranges enabled: Nov 18 18:01:13 oleg228-client kernel: 0 base 0000C0000000 mask 3FFFC0000000 uncachable Nov 18 18:01:13 oleg228-client kernel: 1 disabled Nov 18 18:01:13 oleg228-client kernel: 2 disabled Nov 18 18:01:13 oleg228-client kernel: 3 disabled Nov 18 18:01:13 oleg228-client kernel: 4 disabled Nov 18 18:01:13 oleg228-client kernel: 5 disabled Nov 18 18:01:13 oleg228-client kernel: 6 disabled Nov 18 18:01:13 oleg228-client kernel: 7 disabled Nov 18 18:01:13 oleg228-client kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Nov 18 18:01:13 oleg228-client kernel: last_pfn = 0xbffda max_arch_pfn = 0x400000000 Nov 18 18:01:13 oleg228-client kernel: found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce01000, 0x2ce01fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce02000, 0x2ce02fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce03000, 0x2ce03fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce04000, 0x2ce04fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce05000, 0x2ce05fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce06000, 0x2ce06fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce07000, 0x2ce07fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce08000, 0x2ce08fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce09000, 0x2ce09fff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce0a000, 0x2ce0afff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce0b000, 0x2ce0bfff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: BRK [0x2ce0c000, 0x2ce0cfff] PGTABLE Nov 18 18:01:13 oleg228-client kernel: RAMDISK: [mem 0xbcc64000-0xbffcffff] Nov 18 18:01:13 oleg228-client kernel: ACPI: Early table checksum verification disabled Nov 18 18:01:13 oleg228-client kernel: ACPI: RSDP 0x00000000000F5970 000014 (v00 BOCHS ) Nov 18 18:01:13 oleg228-client kernel: ACPI: RSDT 0x00000000BFFE1BB7 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: FACP 0x00000000BFFE1A53 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: DSDT 0x00000000BFFE0040 001A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: FACS 0x00000000BFFE0000 000040 Nov 18 18:01:13 oleg228-client kernel: ACPI: APIC 0x00000000BFFE1AC7 000090 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: HPET 0x00000000BFFE1B57 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: WAET 0x00000000BFFE1B8F 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving FACP table memory at [mem 0xbffe1a53-0xbffe1ac6] Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a52] Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving APIC table memory at [mem 0xbffe1ac7-0xbffe1b56] Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving HPET table memory at [mem 0xbffe1b57-0xbffe1b8e] Nov 18 18:01:13 oleg228-client kernel: ACPI: Reserving WAET table memory at [mem 0xbffe1b8f-0xbffe1bb6] Nov 18 18:01:13 oleg228-client kernel: ACPI: Local APIC address 0xfee00000 Nov 18 18:01:13 oleg228-client kernel: No NUMA configuration found Nov 18 18:01:13 oleg228-client kernel: Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] Nov 18 18:01:13 oleg228-client kernel: NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] Nov 18 18:01:13 oleg228-client kernel: Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) Nov 18 18:01:13 oleg228-client kernel: Zone ranges: Nov 18 18:01:13 oleg228-client kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Nov 18 18:01:13 oleg228-client kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Nov 18 18:01:13 oleg228-client kernel: Normal [mem 0x0000000100000000-0x0000000146dfffff] Nov 18 18:01:13 oleg228-client kernel: Device empty Nov 18 18:01:13 oleg228-client kernel: Movable zone start for each node Nov 18 18:01:13 oleg228-client kernel: Early memory node ranges Nov 18 18:01:13 oleg228-client kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Nov 18 18:01:13 oleg228-client kernel: node 0: [mem 0x0000000000100000-0x00000000bffd9fff] Nov 18 18:01:13 oleg228-client kernel: node 0: [mem 0x0000000100000000-0x0000000146dfffff] Nov 18 18:01:13 oleg228-client kernel: Zeroed struct page in unavailable ranges: 4744 pages Nov 18 18:01:13 oleg228-client kernel: Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] Nov 18 18:01:13 oleg228-client kernel: On node 0 totalpages: 1076600 Nov 18 18:01:13 oleg228-client kernel: DMA zone: 64 pages used for memmap Nov 18 18:01:13 oleg228-client kernel: DMA zone: 158 pages reserved Nov 18 18:01:13 oleg228-client kernel: DMA zone: 3998 pages, LIFO batch:0 Nov 18 18:01:13 oleg228-client kernel: DMA32 zone: 12224 pages used for memmap Nov 18 18:01:13 oleg228-client kernel: DMA32 zone: 782298 pages, LIFO batch:63 Nov 18 18:01:13 oleg228-client kernel: Normal zone: 4536 pages used for memmap Nov 18 18:01:13 oleg228-client kernel: Normal zone: 290304 pages, LIFO batch:63 Nov 18 18:01:13 oleg228-client kernel: ACPI: PM-Timer IO Port: 0x608 Nov 18 18:01:13 oleg228-client kernel: ACPI: Local APIC address 0xfee00000 Nov 18 18:01:13 oleg228-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Nov 18 18:01:13 oleg228-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Nov 18 18:01:13 oleg228-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Nov 18 18:01:13 oleg228-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Nov 18 18:01:13 oleg228-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Nov 18 18:01:13 oleg228-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Nov 18 18:01:13 oleg228-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Nov 18 18:01:13 oleg228-client kernel: ACPI: IRQ0 used by override. Nov 18 18:01:13 oleg228-client kernel: ACPI: IRQ5 used by override. Nov 18 18:01:13 oleg228-client kernel: ACPI: IRQ9 used by override. Nov 18 18:01:13 oleg228-client kernel: ACPI: IRQ10 used by override. Nov 18 18:01:13 oleg228-client kernel: ACPI: IRQ11 used by override. Nov 18 18:01:13 oleg228-client kernel: Using ACPI (MADT) for SMP configuration information Nov 18 18:01:13 oleg228-client kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000 Nov 18 18:01:13 oleg228-client kernel: TSC deadline timer available Nov 18 18:01:13 oleg228-client kernel: smpboot: Allowing 4 CPUs, 0 hotplug CPUs Nov 18 18:01:13 oleg228-client kernel: kvm-guest: KVM setup pv remote TLB flush Nov 18 18:01:13 oleg228-client kernel: kvm-guest: setup PV sched yield Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] Nov 18 18:01:13 oleg228-client kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Nov 18 18:01:13 oleg228-client kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Nov 18 18:01:13 oleg228-client kernel: Booting paravirtualized kernel on KVM Nov 18 18:01:13 oleg228-client kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Nov 18 18:01:13 oleg228-client kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 Nov 18 18:01:13 oleg228-client kernel: percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 Nov 18 18:01:13 oleg228-client kernel: pcpu-alloc: s221184 r8192 d28672 u524288 alloc=1*2097152 Nov 18 18:01:13 oleg228-client kernel: pcpu-alloc: [0] 0 1 2 3 Nov 18 18:01:13 oleg228-client kernel: kvm-guest: PV spinlocks enabled Nov 18 18:01:13 oleg228-client kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) Nov 18 18:01:13 oleg228-client kernel: Built 1 zonelists, mobility grouping on. Total pages: 1059618 Nov 18 18:01:13 oleg228-client kernel: Policy zone: Normal Nov 18 18:01:13 oleg228-client kernel: Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Nov 18 18:01:13 oleg228-client kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. Nov 18 18:01:13 oleg228-client kernel: audit: disabled (until reboot) Nov 18 18:01:13 oleg228-client kernel: software IO TLB: area num 4. Nov 18 18:01:13 oleg228-client kernel: Memory: 2829700K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) Nov 18 18:01:13 oleg228-client kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 Nov 18 18:01:13 oleg228-client kernel: kmemleak: Kernel memory leak detector disabled Nov 18 18:01:13 oleg228-client kernel: ftrace: allocating 41240 entries in 162 pages Nov 18 18:01:13 oleg228-client kernel: ftrace: allocated 162 pages with 3 groups Nov 18 18:01:13 oleg228-client kernel: rcu: Hierarchical RCU implementation. Nov 18 18:01:13 oleg228-client kernel: rcu: #011RCU event tracing is enabled. Nov 18 18:01:13 oleg228-client kernel: rcu: #011RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. Nov 18 18:01:13 oleg228-client kernel: rcu: #011RCU callback double-/use-after-free debug enabled. Nov 18 18:01:13 oleg228-client kernel: #011Rude variant of Tasks RCU enabled. Nov 18 18:01:13 oleg228-client kernel: #011Tracing variant of Tasks RCU enabled. Nov 18 18:01:13 oleg228-client kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Nov 18 18:01:13 oleg228-client kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 Nov 18 18:01:13 oleg228-client kernel: NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 Nov 18 18:01:13 oleg228-client kernel: random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 Nov 18 18:01:13 oleg228-client kernel: Console: colour *CGA 80x25 Nov 18 18:01:13 oleg228-client kernel: printk: console [ttyS1] enabled Nov 18 18:01:13 oleg228-client kernel: ACPI: Core revision 20220331 Nov 18 18:01:13 oleg228-client kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns Nov 18 18:01:13 oleg228-client kernel: hpet clockevent registered Nov 18 18:01:13 oleg228-client kernel: APIC: Switch to symmetric I/O mode setup Nov 18 18:01:13 oleg228-client kernel: x2apic enabled Nov 18 18:01:13 oleg228-client kernel: Switched APIC routing to physical x2apic. Nov 18 18:01:13 oleg228-client kernel: kvm-guest: setup PV IPIs Nov 18 18:01:13 oleg228-client kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Nov 18 18:01:13 oleg228-client kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns Nov 18 18:01:13 oleg228-client kernel: Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) Nov 18 18:01:13 oleg228-client kernel: pid_max: default: 32768 minimum: 301 Nov 18 18:01:13 oleg228-client kernel: LSM: Security Framework initializing Nov 18 18:01:13 oleg228-client kernel: Yama: becoming mindful. Nov 18 18:01:13 oleg228-client kernel: SELinux: Initializing. Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE selinux *** Nov 18 18:01:13 oleg228-client kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE tmpfs *** Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE proc *** Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE cgroup *** Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE cgroup2 *** Nov 18 18:01:13 oleg228-client kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated Nov 18 18:01:13 oleg228-client kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Nov 18 18:01:13 oleg228-client kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Nov 18 18:01:13 oleg228-client kernel: Spectre V2 : User space: Vulnerable Nov 18 18:01:13 oleg228-client kernel: Speculative Store Bypass: Vulnerable Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffffffff99859000-0xffffffff99860fff] Nov 18 18:01:13 oleg228-client kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) Nov 18 18:01:13 oleg228-client kernel: Performance Events: IvyBridge events, full-width counters, Intel PMU driver. Nov 18 18:01:13 oleg228-client kernel: ... version: 2 Nov 18 18:01:13 oleg228-client kernel: ... bit width: 48 Nov 18 18:01:13 oleg228-client kernel: ... generic registers: 4 Nov 18 18:01:13 oleg228-client kernel: ... value mask: 0000ffffffffffff Nov 18 18:01:13 oleg228-client kernel: ... max period: 00007fffffffffff Nov 18 18:01:13 oleg228-client kernel: ... fixed-purpose events: 3 Nov 18 18:01:13 oleg228-client kernel: ... event mask: 000000070000000f Nov 18 18:01:13 oleg228-client kernel: rcu: Hierarchical SRCU implementation. Nov 18 18:01:13 oleg228-client kernel: smp: Bringing up secondary CPUs ... Nov 18 18:01:13 oleg228-client kernel: x86: Booting SMP configuration: Nov 18 18:01:13 oleg228-client kernel: .... node #0, CPUs: #1 #2 #3 Nov 18 18:01:13 oleg228-client kernel: smp: Brought up 1 node, 4 CPUs Nov 18 18:01:13 oleg228-client kernel: smpboot: Max logical packages: 1 Nov 18 18:01:13 oleg228-client kernel: smpboot: Total of 4 processors activated (19199.98 BogoMIPS) Nov 18 18:01:13 oleg228-client kernel: node 0 deferred pages initialised in 69ms Nov 18 18:01:13 oleg228-client kernel: devtmpfs: initialized Nov 18 18:01:13 oleg228-client kernel: x86/mm: Memory block size: 128MB Nov 18 18:01:13 oleg228-client kernel: gcov: version magic: 0x41383552 Nov 18 18:01:13 oleg228-client kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Nov 18 18:01:13 oleg228-client kernel: futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: pinctrl core: initialized pinctrl subsystem Nov 18 18:01:13 oleg228-client kernel: Nov 18 18:01:13 oleg228-client kernel: ************************************************************* Nov 18 18:01:13 oleg228-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Nov 18 18:01:13 oleg228-client kernel: ** ** Nov 18 18:01:13 oleg228-client kernel: ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** Nov 18 18:01:13 oleg228-client kernel: ** ** Nov 18 18:01:13 oleg228-client kernel: ** This means that this kernel is built to expose internal ** Nov 18 18:01:13 oleg228-client kernel: ** IOMMU data structures, which may compromise security on ** Nov 18 18:01:13 oleg228-client kernel: ** your system. ** Nov 18 18:01:13 oleg228-client kernel: ** ** Nov 18 18:01:13 oleg228-client kernel: ** If you see this message and you are not debugging the ** Nov 18 18:01:13 oleg228-client kernel: ** kernel, report this immediately to your vendor! ** Nov 18 18:01:13 oleg228-client kernel: ** ** Nov 18 18:01:13 oleg228-client kernel: ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** Nov 18 18:01:13 oleg228-client kernel: ************************************************************* Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 16 Nov 18 18:01:13 oleg228-client kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Nov 18 18:01:13 oleg228-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Nov 18 18:01:13 oleg228-client kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Nov 18 18:01:13 oleg228-client kernel: cpuidle: using governor menu Nov 18 18:01:13 oleg228-client kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 18 18:01:13 oleg228-client kernel: PCI: Using configuration type 1 for base access Nov 18 18:01:13 oleg228-client kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on Nov 18 18:01:13 oleg228-client kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Nov 18 18:01:13 oleg228-client kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Nov 18 18:01:13 oleg228-client kernel: cryptd: max_cpu_qlen set to 1000 Nov 18 18:01:13 oleg228-client kernel: ACPI: Added _OSI(Module Device) Nov 18 18:01:13 oleg228-client kernel: ACPI: Added _OSI(Processor Device) Nov 18 18:01:13 oleg228-client kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Nov 18 18:01:13 oleg228-client kernel: ACPI: Added _OSI(Processor Aggregator Device) Nov 18 18:01:13 oleg228-client kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 18 18:01:13 oleg228-client kernel: ACPI: Interpreter enabled Nov 18 18:01:13 oleg228-client kernel: ACPI: PM: (supports S0 S3 S4 S5) Nov 18 18:01:13 oleg228-client kernel: ACPI: Using IOAPIC for interrupt routing Nov 18 18:01:13 oleg228-client kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [2] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [3] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [4] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [5] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [6] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [7] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [8] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [9] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [10] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [11] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [12] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [13] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [14] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [15] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [16] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [17] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [18] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [19] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [20] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [21] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [22] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [23] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [24] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [25] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [26] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [27] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [28] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [29] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [30] registered Nov 18 18:01:13 oleg228-client kernel: acpiphp: Slot [31] registered Nov 18 18:01:13 oleg228-client kernel: PCI host bridge to bus 0000:00 Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [mem 0x180000000-0x1ffffffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] Nov 18 18:01:13 oleg228-client kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Nov 18 18:01:13 oleg228-client kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Nov 18 18:01:13 oleg228-client kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Nov 18 18:01:13 oleg228-client kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Nov 18 18:01:13 oleg228-client kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Nov 18 18:01:13 oleg228-client kernel: iommu: Default domain type: Passthrough Nov 18 18:01:13 oleg228-client kernel: SCSI subsystem initialized Nov 18 18:01:13 oleg228-client kernel: ACPI: bus type USB registered Nov 18 18:01:13 oleg228-client kernel: usbcore: registered new interface driver usbfs Nov 18 18:01:13 oleg228-client kernel: usbcore: registered new interface driver hub Nov 18 18:01:13 oleg228-client kernel: usbcore: registered new device driver usb Nov 18 18:01:13 oleg228-client kernel: pps_core: LinuxPPS API ver. 1 registered Nov 18 18:01:13 oleg228-client kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Nov 18 18:01:13 oleg228-client kernel: PTP clock support registered Nov 18 18:01:13 oleg228-client kernel: EDAC MC: Ver: 3.0.0 Nov 18 18:01:13 oleg228-client kernel: PCI: Using ACPI for IRQ routing Nov 18 18:01:13 oleg228-client kernel: PCI: pci_cache_line_size set to 64 bytes Nov 18 18:01:13 oleg228-client kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Nov 18 18:01:13 oleg228-client kernel: e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] Nov 18 18:01:13 oleg228-client kernel: e820: reserve RAM buffer [mem 0x146e00000-0x147ffffff] Nov 18 18:01:13 oleg228-client kernel: NetLabel: Initializing Nov 18 18:01:13 oleg228-client kernel: NetLabel: domain hash size = 128 Nov 18 18:01:13 oleg228-client kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Nov 18 18:01:13 oleg228-client kernel: NetLabel: unlabeled traffic allowed by default Nov 18 18:01:13 oleg228-client kernel: vgaarb: loaded Nov 18 18:01:13 oleg228-client kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 Nov 18 18:01:13 oleg228-client kernel: hpet0: 3 comparators, 64-bit 100.000000 MHz counter Nov 18 18:01:13 oleg228-client kernel: clocksource: Switched to clocksource kvm-clock Nov 18 18:01:13 oleg228-client kernel: VFS: Disk quotas dquot_6.6.0 Nov 18 18:01:13 oleg228-client kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE ramfs *** Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE hugetlbfs *** Nov 18 18:01:13 oleg228-client kernel: pnp: PnP ACPI init Nov 18 18:01:13 oleg228-client kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) Nov 18 18:01:13 oleg228-client kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) Nov 18 18:01:13 oleg228-client kernel: pnp 00:02: [dma 2] Nov 18 18:01:13 oleg228-client kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) Nov 18 18:01:13 oleg228-client kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) Nov 18 18:01:13 oleg228-client kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) Nov 18 18:01:13 oleg228-client kernel: pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) Nov 18 18:01:13 oleg228-client kernel: pnp: PnP ACPI: found 6 devices Nov 18 18:01:13 oleg228-client kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Nov 18 18:01:13 oleg228-client kernel: pci_bus 0000:00: resource 8 [mem 0x180000000-0x1ffffffff window] Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 2 Nov 18 18:01:13 oleg228-client kernel: IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: TCP: Hash tables configured (established 65536 bind 65536) Nov 18 18:01:13 oleg228-client kernel: MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 1 Nov 18 18:01:13 oleg228-client kernel: RPC: Registered named UNIX socket transport module. Nov 18 18:01:13 oleg228-client kernel: RPC: Registered udp transport module. Nov 18 18:01:13 oleg228-client kernel: RPC: Registered tcp transport module. Nov 18 18:01:13 oleg228-client kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 44 Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Nov 18 18:01:13 oleg228-client kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds Nov 18 18:01:13 oleg228-client kernel: PCI: CLS 0 bytes, default 64 Nov 18 18:01:13 oleg228-client kernel: Unpacking initramfs... Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffff9ccb7cc64000-0xffff9ccb7ffcffff] Nov 18 18:01:13 oleg228-client kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Nov 18 18:01:13 oleg228-client kernel: software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) Nov 18 18:01:13 oleg228-client kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns Nov 18 18:01:13 oleg228-client kernel: Initialise system trusted keyrings Nov 18 18:01:13 oleg228-client kernel: Key type blacklist registered Nov 18 18:01:13 oleg228-client kernel: workingset: timestamp_bits=36 max_order=20 bucket_order=0 Nov 18 18:01:13 oleg228-client kernel: zbud: loaded Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE nfs *** Nov 18 18:01:13 oleg228-client kernel: *** VALIDATE nfs4 *** Nov 18 18:01:13 oleg228-client kernel: pstore: using deflate compression Nov 18 18:01:13 oleg228-client kernel: Platform Keyring initialized Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 38 Nov 18 18:01:13 oleg228-client kernel: Key type asymmetric registered Nov 18 18:01:13 oleg228-client kernel: Asymmetric key parser 'x509' registered Nov 18 18:01:13 oleg228-client kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) Nov 18 18:01:13 oleg228-client kernel: io scheduler mq-deadline registered Nov 18 18:01:13 oleg228-client kernel: io scheduler kyber registered Nov 18 18:01:13 oleg228-client kernel: io scheduler bfq registered Nov 18 18:01:13 oleg228-client kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE Nov 18 18:01:13 oleg228-client kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Nov 18 18:01:13 oleg228-client kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Nov 18 18:01:13 oleg228-client kernel: ACPI: Power Button [PWRF] Nov 18 18:01:13 oleg228-client kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 Nov 18 18:01:13 oleg228-client kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 11 Nov 18 18:01:13 oleg228-client kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 18 18:01:13 oleg228-client kernel: 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A Nov 18 18:01:13 oleg228-client kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Nov 18 18:01:13 oleg228-client kernel: Non-volatile memory driver v1.3 Nov 18 18:01:13 oleg228-client kernel: Linux agpgart interface v0.103 Nov 18 18:01:13 oleg228-client kernel: virtio_blk virtio1: [vda] 133856 512-byte logical blocks (68.5 MB/65.4 MiB) Nov 18 18:01:13 oleg228-client kernel: vda: detected capacity change from 0 to 68534272 Nov 18 18:01:13 oleg228-client kernel: virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) Nov 18 18:01:13 oleg228-client kernel: vdb: detected capacity change from 0 to 1073741824 Nov 18 18:01:13 oleg228-client kernel: libphy: Fixed MDIO Bus: probed Nov 18 18:01:13 oleg228-client kernel: usbcore: registered new interface driver usbserial_generic Nov 18 18:01:13 oleg228-client kernel: usbserial: USB Serial support registered for generic Nov 18 18:01:13 oleg228-client kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Nov 18 18:01:13 oleg228-client kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Nov 18 18:01:13 oleg228-client kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Nov 18 18:01:13 oleg228-client kernel: mousedev: PS/2 mouse device common for all mice Nov 18 18:01:13 oleg228-client kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Nov 18 18:01:13 oleg228-client kernel: rtc_cmos 00:05: RTC can wake from S4 Nov 18 18:01:13 oleg228-client kernel: rtc_cmos 00:05: registered as rtc0 Nov 18 18:01:13 oleg228-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Nov 18 18:01:13 oleg228-client kernel: rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs Nov 18 18:01:13 oleg228-client kernel: intel_pstate: CPU model not supported Nov 18 18:01:13 oleg228-client kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Nov 18 18:01:13 oleg228-client kernel: hid: raw HID events driver (C) Jiri Kosina Nov 18 18:01:13 oleg228-client kernel: usbcore: registered new interface driver usbhid Nov 18 18:01:13 oleg228-client kernel: usbhid: USB HID core driver Nov 18 18:01:13 oleg228-client kernel: drop_monitor: Initializing network drop monitor service Nov 18 18:01:13 oleg228-client kernel: Initializing XFRM netlink socket Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 10 Nov 18 18:01:13 oleg228-client kernel: Segment Routing with IPv6 Nov 18 18:01:13 oleg228-client kernel: NET: Registered protocol family 17 Nov 18 18:01:13 oleg228-client kernel: mpls_gso: MPLS GSO support Nov 18 18:01:13 oleg228-client kernel: start plist test Nov 18 18:01:13 oleg228-client kernel: end plist test Nov 18 18:01:13 oleg228-client kernel: RAS: Correctable Errors collector initialized. Nov 18 18:01:13 oleg228-client kernel: AVX version of gcm_enc/dec engaged. Nov 18 18:01:13 oleg228-client kernel: AES CTR mode by8 optimization enabled Nov 18 18:01:13 oleg228-client kernel: sched_clock: Marking stable (4548878586, 0)->(5607267046, -1058388460) Nov 18 18:01:13 oleg228-client kernel: registered taskstats version 1 Nov 18 18:01:13 oleg228-client kernel: Loading compiled-in X.509 certificates Nov 18 18:01:13 oleg228-client kernel: zswap: loaded using pool lzo/zbud Nov 18 18:01:13 oleg228-client kernel: Key type big_key registered Nov 18 18:01:13 oleg228-client kernel: Key type encrypted registered Nov 18 18:01:13 oleg228-client kernel: ima: No TPM chip found, activating TPM-bypass! Nov 18 18:01:13 oleg228-client kernel: ima: Allocated hash algorithm: sha1 Nov 18 18:01:13 oleg228-client kernel: ima: No architecture policies found Nov 18 18:01:13 oleg228-client kernel: evm: Initialising EVM extended attributes: Nov 18 18:01:13 oleg228-client kernel: evm: security.selinux Nov 18 18:01:13 oleg228-client kernel: evm: security.ima Nov 18 18:01:13 oleg228-client kernel: evm: security.capability Nov 18 18:01:13 oleg228-client kernel: evm: HMAC attrs: 0x1 Nov 18 18:01:13 oleg228-client kernel: rtc_cmos 00:05: setting system clock to 2025-11-18 23:01:12 UTC (1763506872) Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffffffff9a803000-0xffffffff9a9fffff] Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffffffff99582000-0xffffffff99858fff] Nov 18 18:01:13 oleg228-client kernel: Write protecting the kernel read-only data: 28672k Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffffffff97c03000-0xffffffff97dfffff] Nov 18 18:01:13 oleg228-client kernel: debug: unmapping init [mem 0xffffffff98514000-0xffffffff985fffff] Nov 18 18:01:13 oleg228-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 18 18:01:13 oleg228-client systemd[1]: Detected virtualization kvm. Nov 18 18:01:13 oleg228-client systemd[1]: Detected architecture x86-64. Nov 18 18:01:13 oleg228-client systemd[1]: Running in initial RAM disk. Nov 18 18:01:13 oleg228-client systemd[1]: No hostname configured. Nov 18 18:01:13 oleg228-client systemd[1]: Set hostname to . Nov 18 18:01:13 oleg228-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Nov 18 18:01:13 oleg228-client systemd[1]: Initializing machine ID from random generator. Nov 18 18:01:13 oleg228-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Nov 18 18:01:13 oleg228-client systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Nov 18 18:01:13 oleg228-client kernel: random: systemd: uninitialized urandom read (16 bytes read) Nov 18 18:01:13 oleg228-client systemd[1]: Reached target Initrd Root Device. Nov 18 18:01:13 oleg228-client systemd[1]: Reached target Timers. Nov 18 18:01:13 oleg228-client systemd-journald[227]: Journal started Nov 18 18:01:13 oleg228-client systemd-journald[227]: Runtime journal (/run/log/journal/e8e8086a37cf4b11a12b6e556cee5a1a) is 8.0M, max 184.6M, 176.6M free. Nov 18 18:01:13 oleg228-client systemd-vconsole-setup[233]: KD_FONT_OP_GET failed while trying to get the font metadata: Invalid argument Nov 18 18:01:13 oleg228-client systemd-vconsole-setup[233]: Fonts will not be copied to remaining consoles Nov 18 18:01:13 oleg228-client dracut-cmdline[252]: dracut-8.10 (Green Obsidian) dracut-049-233.git20240115.el8 Nov 18 18:01:13 oleg228-client dracut-cmdline[252]: Using kernel command line parameters: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Nov 18 18:01:13 oleg228-client systemd[1]: Started dracut cmdline hook. Nov 18 18:01:13 oleg228-client systemd[1]: Starting dracut pre-udev hook... Nov 18 18:01:14 oleg228-client kernel: device-mapper: uevent: version 1.0.3 Nov 18 18:01:14 oleg228-client kernel: device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Nov 18 18:01:14 oleg228-client rpc.statd[385]: Version 2.3.3 starting Nov 18 18:01:14 oleg228-client rpc.statd[385]: Initializing NSM state Nov 18 18:01:14 oleg228-client rpc.idmapd[390]: Setting log level to 0 Nov 18 18:01:14 oleg228-client systemd[1]: Started dracut pre-udev hook. Nov 18 18:01:14 oleg228-client systemd[1]: Starting udev Kernel Device Manager... Nov 18 18:01:14 oleg228-client systemd[1]: Started udev Kernel Device Manager. Nov 18 18:01:14 oleg228-client systemd[1]: Starting dracut pre-trigger hook... Nov 18 18:01:14 oleg228-client systemd[1]: Started dracut pre-trigger hook. Nov 18 18:01:14 oleg228-client systemd[1]: Starting udev Coldplug all Devices... Nov 18 18:01:14 oleg228-client systemd[1]: Mounting Kernel Configuration File System... Nov 18 18:01:14 oleg228-client systemd[1]: Mounted Kernel Configuration File System. Nov 18 18:01:14 oleg228-client systemd[1]: Started udev Coldplug all Devices. Nov 18 18:01:14 oleg228-client systemd[1]: Reached target System Initialization. Nov 18 18:01:14 oleg228-client systemd[1]: Reached target Basic System. Nov 18 18:01:14 oleg228-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Nov 18 18:01:14 oleg228-client systemd-udevd[439]: Using default interface naming scheme 'rhel-8.0'. Nov 18 18:01:14 oleg228-client systemd-udevd[439]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 18 18:01:14 oleg228-client systemd[1]: Starting dracut initqueue hook... Nov 18 18:01:15 oleg228-client rngd[446]: Disabling 7: PKCS11 Entropy generator (pkcs11) Nov 18 18:01:15 oleg228-client rngd[446]: Disabling 5: NIST Network Entropy Beacon (nist) Nov 18 18:01:15 oleg228-client rngd[446]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Nov 18 18:01:15 oleg228-client rngd[446]: Initializing available sources Nov 18 18:01:15 oleg228-client rngd[446]: [hwrng ]: Initialization Failed Nov 18 18:01:15 oleg228-client rngd[446]: [rdrand]: Enabling RDRAND rng support Nov 18 18:01:15 oleg228-client rngd[446]: [rdrand]: Initialized Nov 18 18:01:15 oleg228-client rngd[446]: [jitter]: JITTER timeout set to 5 sec Nov 18 18:01:15 oleg228-client kernel: virtio_net virtio0 ens2: renamed from eth0 Nov 18 18:01:15 oleg228-client kernel: libata version 3.00 loaded. Nov 18 18:01:15 oleg228-client systemd-udevd[449]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 18 18:01:15 oleg228-client kernel: ata_piix 0000:00:01.1: version 2.13 Nov 18 18:01:15 oleg228-client kernel: scsi host0: ata_piix Nov 18 18:01:15 oleg228-client kernel: scsi host1: ata_piix Nov 18 18:01:15 oleg228-client kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 Nov 18 18:01:15 oleg228-client kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 Nov 18 18:01:15 oleg228-client rngd[446]: [jitter]: Initializing AES buffer Nov 18 18:01:15 oleg228-client dracut-initqueue[504]: Starting dhcp for interface ens2 Nov 18 18:01:16 oleg228-client dracut-initqueue[537]: dhcp: PREINIT ens2 up Nov 18 18:01:16 oleg228-client dhclient[536]: Created duid "\000\004\350\350\010j7\317K\021\241+nUl\356Z\032". Nov 18 18:01:16 oleg228-client dhclient[536]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 7 (xid=0x969b4c02) Nov 18 18:01:16 oleg228-client dhclient[536]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0x969b4c02) Nov 18 18:01:16 oleg228-client dhclient[536]: DHCPOFFER from 192.168.202.254 Nov 18 18:01:16 oleg228-client dhclient[536]: DHCPACK from 192.168.202.254 (xid=0x969b4c02) Nov 18 18:01:16 oleg228-client dracut-initqueue[555]: dhcp: BOND setting ens2 Nov 18 18:01:16 oleg228-client kernel: random: fast init done Nov 18 18:01:18 oleg228-client dhclient[536]: bound to 192.168.202.28 -- renewal in 27319 seconds. Nov 18 18:01:18 oleg228-client dracut-initqueue[583]: RTNETLINK answers: File exists Nov 18 18:01:20 oleg228-client rngd[446]: [jitter]: Unable to obtain AES key, disabling JITTER source Nov 18 18:01:20 oleg228-client rngd[446]: [jitter]: Initialization Failed Nov 18 18:01:20 oleg228-client kernel: random: crng init done Nov 18 18:01:20 oleg228-client kernel: random: 7 urandom warning(s) missed due to ratelimiting Nov 18 18:01:20 oleg228-client systemd[1]: Reloading. Nov 18 18:01:20 oleg228-client systemd[617]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Nov 18 18:01:20 oleg228-client systemd[1]: Starting nbd nbd0... Nov 18 18:01:20 oleg228-client nbd-client[652]: Negotiation: ..size = 30720MB Nov 18 18:01:20 oleg228-client nbd-client[652]: Connected /dev/nbd0 Nov 18 18:01:20 oleg228-client systemd[1]: nbd0.service: Succeeded. Nov 18 18:01:20 oleg228-client systemd[1]: Started nbd nbd0. Nov 18 18:01:20 oleg228-client systemd[1]: Started dracut initqueue hook. Nov 18 18:01:20 oleg228-client systemd[1]: Mounting /sysroot... Nov 18 18:01:20 oleg228-client systemd[1]: Reached target Remote File Systems (Pre). Nov 18 18:01:20 oleg228-client systemd[1]: Reached target Remote File Systems. Nov 18 18:01:20 oleg228-client kernel: EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) Nov 18 18:01:20 oleg228-client systemd[1]: Mounted /sysroot. Nov 18 18:01:20 oleg228-client systemd[1]: Reached target Initrd Root File System. Nov 18 18:01:20 oleg228-client systemd[1]: Starting Reload Configuration from the Real Root... Nov 18 18:01:20 oleg228-client systemd[1]: Reloading. Nov 18 18:01:20 oleg228-client systemd[675]: /usr/lib/systemd/system-generators/systemd-fstab-generator failed with exit status 1. Nov 18 18:01:20 oleg228-client systemd[1]: initrd-parse-etc.service: Succeeded. Nov 18 18:01:20 oleg228-client systemd[1]: Started Reload Configuration from the Real Root. Nov 18 18:01:20 oleg228-client systemd[1]: Reached target Initrd File Systems. Nov 18 18:01:20 oleg228-client systemd[1]: Reached target Initrd Default Target. Nov 18 18:01:20 oleg228-client systemd[1]: Starting dracut pre-pivot and cleanup hook... Nov 18 18:01:21 oleg228-client systemd[1]: var-lib-nfs-rpc_pipefs.mount: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Started dracut pre-pivot and cleanup hook. Nov 18 18:01:21 oleg228-client systemd[1]: Starting Cleaning Up and Shutting Down Daemons... Nov 18 18:01:21 oleg228-client systemd[1]: dracut-pre-pivot.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped dracut pre-pivot and cleanup hook. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Remote File Systems. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Initrd Default Target. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Initrd Root Device. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Remote File Systems (Pre). Nov 18 18:01:21 oleg228-client rngd[446]: [rdrand]: Shutting down Nov 18 18:01:21 oleg228-client systemd[1]: Stopping Hardware RNG Entropy Gatherer Daemon... Nov 18 18:01:21 oleg228-client systemd[1]: dracut-initqueue.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped dracut initqueue hook. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Timers. Nov 18 18:01:21 oleg228-client systemd[1]: rngd.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Hardware RNG Entropy Gatherer Daemon. Nov 18 18:01:21 oleg228-client systemd[1]: initrd-cleanup.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Started Cleaning Up and Shutting Down Daemons. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Basic System. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Slices. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target System Initialization. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Local Encrypted Volumes. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-tmpfiles-setup.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Create Volatile Files and Directories. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Local File Systems. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Swap. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-sysctl.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Apply Kernel Variables. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-udev-trigger.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped udev Coldplug all Devices. Nov 18 18:01:21 oleg228-client systemd[1]: dracut-pre-trigger.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped dracut pre-trigger hook. Nov 18 18:01:21 oleg228-client systemd[1]: Stopping udev Kernel Device Manager... Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Paths. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-ask-password-console.path: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped target Sockets. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-udevd.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped udev Kernel Device Manager. Nov 18 18:01:21 oleg228-client systemd[1]: dracut-pre-udev.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped dracut pre-udev hook. Nov 18 18:01:21 oleg228-client systemd[1]: dracut-cmdline.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped dracut cmdline hook. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-tmpfiles-setup-dev.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Create Static Device Nodes in /dev. Nov 18 18:01:21 oleg228-client systemd[1]: kmod-static-nodes.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Stopped Create list of required static device nodes for the current kernel. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-udevd-kernel.socket: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Closed udev Kernel Socket. Nov 18 18:01:21 oleg228-client systemd[1]: systemd-udevd-control.socket: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Closed udev Control Socket. Nov 18 18:01:21 oleg228-client systemd[1]: Starting Cleanup udevd DB... Nov 18 18:01:21 oleg228-client systemd[1]: initrd-udevadm-cleanup-db.service: Succeeded. Nov 18 18:01:21 oleg228-client systemd[1]: Started Cleanup udevd DB. Nov 18 18:01:21 oleg228-client systemd[1]: Reached target Switch Root. Nov 18 18:01:21 oleg228-client systemd[1]: Starting Switch Root... Nov 18 18:01:21 oleg228-client systemd[1]: Switching root. Nov 18 18:01:21 oleg228-client systemd-journald[227]: Journal stopped Nov 18 18:01:22 oleg228-client kernel: printk: systemd: 26 output lines suppressed due to ratelimiting Nov 18 18:01:22 oleg228-client kernel: SELinux: Disabled at runtime. Nov 18 18:01:22 oleg228-client systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 18 18:01:22 oleg228-client systemd[1]: Detected virtualization kvm. Nov 18 18:01:22 oleg228-client systemd[1]: Detected architecture x86-64. Nov 18 18:01:22 oleg228-client systemd[1]: initrd-switch-root.service: Succeeded. Nov 18 18:01:22 oleg228-client systemd[1]: Stopped Switch Root. Nov 18 18:01:22 oleg228-client systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. Nov 18 18:01:22 oleg228-client systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Nov 18 18:01:22 oleg228-client systemd[1]: Stopped Journal Service. Nov 18 18:01:22 oleg228-client systemd[1]: Starting Journal Service... Nov 18 18:01:22 oleg228-client systemd[1]: Created slice User and Session Slice. Nov 18 18:01:22 oleg228-client systemd-journald[789]: Journal started Nov 18 18:01:22 oleg228-client systemd-journald[789]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Nov 18 18:01:22 oleg228-client systemd[1]: systemd-journald.service: Succeeded. Nov 18 18:01:22 oleg228-client kernel: Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS Nov 18 18:01:23 oleg228-client systemd[1]: Mounted Huge Pages File System. Nov 18 18:01:23 oleg228-client systemd-remount-fs[805]: mount.nfs: access denied by server while mounting 192.168.10.1:/exports/rhel8.5-nfsroot Nov 18 18:01:23 oleg228-client systemd[1]: Mounted Kernel Debug File System. Nov 18 18:01:23 oleg228-client systemd-remount-fs[799]: /usr/bin/mount for / exited with exit status 32. Nov 18 18:01:23 oleg228-client systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 18 18:01:23 oleg228-client systemd[1]: Activated swap /dev/disk/by-label/SWAP. Nov 18 18:01:23 oleg228-client systemd[1]: systemd-remount-fs.service: Main process exited, code=exited, status=1/FAILURE Nov 18 18:01:23 oleg228-client systemd[1]: systemd-remount-fs.service: Failed with result 'exit-code'. Nov 18 18:01:23 oleg228-client systemd[1]: Failed to start Remount Root and Kernel File Systems. Nov 18 18:01:23 oleg228-client systemd[1]: Mounted POSIX Message Queue File System. Nov 18 18:01:23 oleg228-client systemd[1]: Started Apply Kernel Variables. Nov 18 18:01:23 oleg228-client systemd[1]: Starting Configure read-only root support... Nov 18 18:01:23 oleg228-client systemd[1]: Reached target Swap. Nov 18 18:01:23 oleg228-client systemd[1]: Starting Create Static Device Nodes in /dev... Nov 18 18:01:23 oleg228-client systemd[1]: Starting Flush Journal to Persistent Storage... Nov 18 18:01:23 oleg228-client systemd-journald[789]: Runtime journal (/run/log/journal/a82c5ce2bafb4275b974cc7d83c03742) is 1.2M, max 10.0M, 8.7M free. Nov 18 18:01:23 oleg228-client systemd[1]: Started Flush Journal to Persistent Storage. Nov 18 18:01:23 oleg228-client systemd[1]: Started Create Static Device Nodes in /dev. Nov 18 18:01:23 oleg228-client systemd[1]: Reached target Local File Systems (Pre). Nov 18 18:01:23 oleg228-client systemd[1]: Mounting /mnt... Nov 18 18:01:23 oleg228-client systemd[1]: Mounting /home/green/git/lustre-release... Nov 18 18:01:23 oleg228-client systemd[1]: Starting udev Kernel Device Manager... Nov 18 18:01:23 oleg228-client systemd[1]: Started udev Coldplug all Devices. Nov 18 18:01:23 oleg228-client systemd[1]: Mounted /mnt. Nov 18 18:01:23 oleg228-client kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Nov 18 18:01:23 oleg228-client systemd[1]: Mounted /home/green/git/lustre-release. Nov 18 18:01:23 oleg228-client systemd[1]: Started udev Kernel Device Manager. Nov 18 18:01:23 oleg228-client kernel: input: PC Speaker as /devices/platform/pcspkr/input/input5 Nov 18 18:01:23 oleg228-client kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Nov 18 18:01:24 oleg228-client systemd-udevd[862]: Using default interface naming scheme 'rhel-8.0'. Nov 18 18:01:24 oleg228-client systemd-udevd[862]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 18 18:01:24 oleg228-client kernel: RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer Nov 18 18:01:24 oleg228-client kernel: EDAC sbridge: Seeking for: PCI ID 8086:0ea0 Nov 18 18:01:24 oleg228-client kernel: EDAC sbridge: Ver: 1.1.2 Nov 18 18:01:24 oleg228-client systemd-udevd[851]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 18 18:01:25 oleg228-client kernel: Key type dns_resolver registered Nov 18 18:01:25 oleg228-client kernel: NFS: Registering the id_resolver key type Nov 18 18:01:25 oleg228-client kernel: Key type id_resolver registered Nov 18 18:01:25 oleg228-client kernel: Key type id_legacy registered Nov 18 18:01:25 oleg228-client nfsrahead[984]: setting /var/lib/stateless/state readahead to 128 Nov 18 18:01:26 oleg228-client systemd[1]: Started Configure read-only root support. Nov 18 18:01:26 oleg228-client systemd[1]: Starting Load/Save Random Seed... Nov 18 18:01:26 oleg228-client systemd[1]: Reached target Local File Systems. Nov 18 18:01:26 oleg228-client systemd[1]: Starting Mark the need to relabel after reboot... Nov 18 18:01:26 oleg228-client systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 18 18:01:26 oleg228-client touch[997]: /bin/touch: cannot touch '/.autorelabel': Read-only file system Nov 18 18:01:26 oleg228-client systemd[1]: Starting Create Volatile Files and Directories... Nov 18 18:01:26 oleg228-client systemd[1]: Started Load/Save Random Seed. Nov 18 18:01:26 oleg228-client systemd[1]: Started Mark the need to relabel after reboot. Nov 18 18:01:26 oleg228-client systemd-tmpfiles[1000]: rm(/var/lib/rpm/__db.003): Read-only file system Nov 18 18:01:26 oleg228-client systemd-tmpfiles[1000]: rm(/var/lib/rpm/__db.002): Read-only file system Nov 18 18:01:26 oleg228-client systemd-tmpfiles[1000]: rm(/var/lib/rpm/__db.001): Read-only file system Nov 18 18:01:26 oleg228-client systemd[1]: Started Create Volatile Files and Directories. Nov 18 18:01:26 oleg228-client systemd[1]: Starting RPC Bind... Nov 18 18:01:26 oleg228-client systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 18 18:01:26 oleg228-client systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 18 18:01:26 oleg228-client systemd[1]: Started RPC Bind. Nov 18 18:01:27 oleg228-client systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 18 18:01:27 oleg228-client systemd[1]: Starting Update is Completed... Nov 18 18:01:27 oleg228-client systemd[1]: Started Update is Completed. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target System Initialization. Nov 18 18:01:27 oleg228-client systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 18 18:01:27 oleg228-client systemd[1]: Started dnf makecache --timer. Nov 18 18:01:27 oleg228-client systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Timers. Nov 18 18:01:27 oleg228-client systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Sockets. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Basic System. Nov 18 18:01:27 oleg228-client systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 18 18:01:27 oleg228-client systemd[1]: Started irqbalance daemon. Nov 18 18:01:27 oleg228-client systemd[1]: Started D-Bus System Message Bus. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target sshd-keygen.target. Nov 18 18:01:27 oleg228-client systemd[1]: Started Hardware RNG Entropy Gatherer Daemon. Nov 18 18:01:27 oleg228-client systemd[1]: Starting Login Service... Nov 18 18:01:27 oleg228-client systemd[1]: Starting Network Manager... Nov 18 18:01:27 oleg228-client systemd[1]: Started Restore /run/initramfs on shutdown. Nov 18 18:01:27 oleg228-client rngd[1014]: Disabling 7: PKCS11 Entropy generator (pkcs11) Nov 18 18:01:27 oleg228-client rngd[1014]: Disabling 5: NIST Network Entropy Beacon (nist) Nov 18 18:01:27 oleg228-client rngd[1014]: Disabling 9: Qrypt quantum entropy beacon (qrypt) Nov 18 18:01:27 oleg228-client rngd[1014]: Initializing available sources Nov 18 18:01:27 oleg228-client rngd[1014]: [hwrng ]: Initialization Failed Nov 18 18:01:27 oleg228-client rngd[1014]: [rdrand]: Enabling RDRAND rng support Nov 18 18:01:27 oleg228-client rngd[1014]: [rdrand]: Initialized Nov 18 18:01:27 oleg228-client rngd[1014]: [jitter]: JITTER timeout set to 5 sec Nov 18 18:01:27 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event0 (Power Button) Nov 18 18:01:27 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Nov 18 18:01:27 oleg228-client systemd-logind[1015]: New seat seat0. Nov 18 18:01:27 oleg228-client systemd[1]: Started Login Service. Nov 18 18:01:27 oleg228-client rngd[1014]: [jitter]: Initializing AES buffer Nov 18 18:01:27 oleg228-client NetworkManager[1017]: [1763506887.4059] NetworkManager (version 1.40.16-19.el8_10) is starting... (boot:479d65d0-6fc2-4222-8c84-c1606917f41b) Nov 18 18:01:27 oleg228-client NetworkManager[1017]: [1763506887.4105] Read config: /etc/NetworkManager/NetworkManager.conf (run: 10-dracut-dhclient.conf) Nov 18 18:01:27 oleg228-client systemd[1]: Started Network Manager. Nov 18 18:01:27 oleg228-client NetworkManager[1017]: [1763506887.4370] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" Nov 18 18:01:27 oleg228-client systemd[1]: Starting Network Manager Wait Online... Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Network. Nov 18 18:01:27 oleg228-client systemd[1]: Starting OpenSSH server daemon... Nov 18 18:01:27 oleg228-client NetworkManager[1017]: [1763506887.4618] manager[0x56034ea08020]: monitoring kernel firmware directory '/lib/firmware'. Nov 18 18:01:27 oleg228-client dbus-daemon[1013]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.2' (uid=0 pid=1017 comm="/usr/sbin/NetworkManager --no-daemon ") Nov 18 18:01:27 oleg228-client systemd[1]: Starting Dynamic System Tuning Daemon... Nov 18 18:01:27 oleg228-client systemd[1]: Starting GSSAPI Proxy Daemon... Nov 18 18:01:27 oleg228-client sshd[1033]: Server listening on 0.0.0.0 port 22. Nov 18 18:01:27 oleg228-client sshd[1033]: Server listening on :: port 22. Nov 18 18:01:27 oleg228-client systemd[1]: Started OpenSSH server daemon. Nov 18 18:01:27 oleg228-client systemd[1]: Starting Hostname Service... Nov 18 18:01:27 oleg228-client systemd[1]: Started GSSAPI Proxy Daemon. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target NFS client services. Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Remote File Systems (Pre). Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Remote File Systems. Nov 18 18:01:27 oleg228-client systemd[1]: Starting Permit User Sessions... Nov 18 18:01:27 oleg228-client systemd[1]: Started Permit User Sessions. Nov 18 18:01:27 oleg228-client systemd[1]: Started Command Scheduler. Nov 18 18:01:27 oleg228-client systemd[1]: Started Getty on tty1. Nov 18 18:01:27 oleg228-client crond[1051]: (CRON) STARTUP (1.5.2) Nov 18 18:01:27 oleg228-client systemd[1]: Started Serial Getty on ttyS1. Nov 18 18:01:27 oleg228-client systemd[1]: Started Serial Getty on ttyS0. Nov 18 18:01:27 oleg228-client crond[1051]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 74% if used.) Nov 18 18:01:27 oleg228-client crond[1051]: (CRON) INFO (running with inotify support) Nov 18 18:01:27 oleg228-client systemd[1]: Reached target Login Prompts. Nov 18 18:01:28 oleg228-client dbus-daemon[1013]: [system] Successfully activated service 'org.freedesktop.hostname1' Nov 18 18:01:28 oleg228-client systemd[1]: Started Hostname Service. Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.2819] hostname: hostname: using hostnamed Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.2828] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3112] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-device-plugin-team.so) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3114] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3115] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3115] manager: Networking is enabled by state file Nov 18 18:01:28 oleg228-client dbus-daemon[1013]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.2' (uid=0 pid=1017 comm="/usr/sbin/NetworkManager --no-daemon ") Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3192] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.40.16-19.el8_10/libnm-settings-plugin-ifcfg-rh.so") Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3194] settings: Loaded settings plugin: keyfile (internal) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3357] dhcp: init: Using DHCP client 'dhclient' Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3477] device (lo): carrier: link connected Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3508] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) Nov 18 18:01:28 oleg228-client systemd[1]: Starting Network Manager Script Dispatcher Service... Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3623] device (ens2): carrier: link connected Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3678] manager: (ens2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3751] manager: (ens2): assume: will attempt to assume matching connection 'ens2' (0a5de5a3-e7ae-4a40-90c3-facb7bd8cf6a) (guessed) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3758] manager: (ens2): assume: taking over an initramfs-configured connection Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3763] device (ens2): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3855] device (ens2): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.3929] device (ens2): Activation: starting connection 'ens2' (0a5de5a3-e7ae-4a40-90c3-facb7bd8cf6a) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.4169] device (ens2): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.4246] device (ens2): state change: prepare -> config (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.4292] device (ens2): state change: config -> ip-config (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.4375] dhcp4 (ens2): activation: beginning transaction (timeout in 45 seconds) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.4641] dhcp4 (ens2): dhclient started with pid 1056 Nov 18 18:01:28 oleg228-client dbus-daemon[1013]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.2' (uid=0 pid=1017 comm="/usr/sbin/NetworkManager --no-daemon ") Nov 18 18:01:28 oleg228-client dbus-daemon[1013]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. Nov 18 18:01:28 oleg228-client dbus-daemon[1013]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' Nov 18 18:01:28 oleg228-client systemd[1]: Started Network Manager Script Dispatcher Service. Nov 18 18:01:28 oleg228-client dhclient[1056]: DHCPREQUEST on ens2 to 255.255.255.255 port 67 (xid=0x29a8b20f) Nov 18 18:01:28 oleg228-client dhclient[1056]: DHCPACK from 192.168.202.254 (xid=0x29a8b20f) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6898] dhcp4 (ens2): address 192.168.202.28 Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6899] dhcp4 (ens2): plen 24 (255.255.255.0) Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6899] dhcp4 (ens2): gateway 192.168.202.254 Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6899] dhcp4 (ens2): lease time 60000 Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6899] dhcp4 (ens2): hostname 'oleg228-client.virtnet' Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6900] dhcp4 (ens2): nameserver '192.168.200.253' Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6900] dhcp4 (ens2): domain name 'virtnet' Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6900] dhcp4 (ens2): state changed new lease, address=192.168.202.28 Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6918] policy: set 'ens2' (ens2) as default for IPv4 routing and DNS Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.6958] device (ens2): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7103] device (ens2): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7107] device (ens2): state change: secondaries -> activated (reason 'none', sys-iface-state: 'assume') Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7115] manager: NetworkManager state is now CONNECTED_SITE Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7120] device (ens2): Activation: successful, device activated. Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7130] manager: NetworkManager state is now CONNECTED_GLOBAL Nov 18 18:01:28 oleg228-client NetworkManager[1017]: [1763506888.7140] manager: startup complete Nov 18 18:01:28 oleg228-client dhclient[1056]: bound to 192.168.202.28 -- renewal in 25374 seconds. Nov 18 18:01:28 oleg228-client systemd[1]: Started Network Manager Wait Online. Nov 18 18:01:28 oleg228-client systemd[1]: Reached target Network is Online. Nov 18 18:01:28 oleg228-client systemd[1]: Starting Notify NFS peers of a restart... Nov 18 18:01:28 oleg228-client systemd[1]: Starting System Logging Service... Nov 18 18:01:28 oleg228-client sm-notify[1075]: Version 2.3.3 starting Nov 18 18:01:28 oleg228-client systemd[1]: Starting Crash recovery kernel arming... Nov 18 18:01:28 oleg228-client systemd[1]: Started Notify NFS peers of a restart. Nov 18 18:01:29 oleg228-client rsyslogd[1076]: [origin software="rsyslogd" swVersion="8.2102.0-15.el8_10.1" x-pid="1076" x-info="https://www.rsyslog.com"] start Nov 18 18:01:29 oleg228-client systemd[1]: Started System Logging Service. Nov 18 18:01:29 oleg228-client rsyslogd[1076]: imjournal: No statefile exists, /var/lib/rsyslog/imjournal.state will be created (ignore if this is first run): No such file or directory [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/2040 ] Nov 18 18:01:29 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:01:29 oleg228-client kdumpctl[1185]: basename: missing operand Nov 18 18:01:29 oleg228-client kdumpctl[1185]: Try 'basename --help' for more information. Nov 18 18:01:31 oleg228-client dbus-daemon[1013]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.7' (uid=0 pid=1035 comm="/usr/libexec/platform-python -Es /usr/sbin/tuned -") Nov 18 18:01:31 oleg228-client systemd[1]: Starting Authorization Manager... Nov 18 18:01:31 oleg228-client polkitd[1355]: Started polkitd version 0.115 Nov 18 18:01:31 oleg228-client systemd[1]: Started Dynamic System Tuning Daemon. Nov 18 18:01:31 oleg228-client systemd[1]: Reached target Multi-User System. Nov 18 18:01:31 oleg228-client systemd[1]: Reached target Graphical Interface. Nov 18 18:01:31 oleg228-client systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 18 18:01:31 oleg228-client polkitd[1355]: Loading rules from directory /etc/polkit-1/rules.d Nov 18 18:01:31 oleg228-client polkitd[1355]: Loading rules from directory /usr/share/polkit-1/rules.d Nov 18 18:01:31 oleg228-client polkitd[1355]: Finished loading, compiling and executing 2 rules Nov 18 18:01:31 oleg228-client dbus-daemon[1013]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Nov 18 18:01:31 oleg228-client systemd[1]: Started Authorization Manager. Nov 18 18:01:31 oleg228-client polkitd[1355]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Nov 18 18:01:32 oleg228-client rngd[1014]: [jitter]: Unable to obtain AES key, disabling JITTER source Nov 18 18:01:32 oleg228-client rngd[1014]: [jitter]: Initialization Failed Nov 18 18:01:32 oleg228-client rngd[1014]: Process privileges have been dropped to 2:2 Nov 18 18:01:32 oleg228-client systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 18 18:01:32 oleg228-client systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 18 18:01:33 oleg228-client kdumpctl[1081]: kdump: kexec: loaded kdump kernel Nov 18 18:01:33 oleg228-client kdumpctl[1081]: kdump: Starting kdump: [OK] Nov 18 18:01:33 oleg228-client systemd[1]: Started Crash recovery kernel arming. Nov 18 18:01:33 oleg228-client systemd[1]: Startup finished in 4.719s (kernel) + 9.511s (initrd) + 11.273s (userspace) = 25.503s. Nov 18 18:01:36 oleg228-client sshd[1453]: Accepted publickey for root from 192.168.200.253 port 38488 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Nov 18 18:01:36 oleg228-client systemd[1]: Created slice User Slice of UID 0. Nov 18 18:01:36 oleg228-client systemd[1]: Starting User runtime directory /run/user/0... Nov 18 18:01:36 oleg228-client systemd-logind[1015]: New session 1 of user root. Nov 18 18:01:36 oleg228-client systemd[1]: Started User runtime directory /run/user/0. Nov 18 18:01:36 oleg228-client systemd[1]: Starting User Manager for UID 0... Nov 18 18:01:36 oleg228-client systemd[1468]: pam_unix(systemd-user:session): session opened for user root by (uid=0) Nov 18 18:01:36 oleg228-client systemd[1468]: Reached target Timers. Nov 18 18:01:36 oleg228-client systemd[1468]: Starting D-Bus User Message Bus Socket. Nov 18 18:01:36 oleg228-client systemd[1468]: Reached target Paths. Nov 18 18:01:36 oleg228-client systemd[1468]: Listening on D-Bus User Message Bus Socket. Nov 18 18:01:36 oleg228-client systemd[1468]: Reached target Sockets. Nov 18 18:01:36 oleg228-client systemd[1468]: Reached target Basic System. Nov 18 18:01:36 oleg228-client systemd[1468]: Reached target Default. Nov 18 18:01:36 oleg228-client systemd[1468]: Startup finished in 138ms. Nov 18 18:01:36 oleg228-client systemd[1]: Started User Manager for UID 0. Nov 18 18:01:36 oleg228-client systemd[1]: Started Session 1 of user root. Nov 18 18:01:36 oleg228-client sshd[1453]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:01:37 oleg228-client sshd[1479]: Received disconnect from 192.168.200.253 port 38488:11: disconnected by user Nov 18 18:01:37 oleg228-client sshd[1479]: Disconnected from user root 192.168.200.253 port 38488 Nov 18 18:01:37 oleg228-client sshd[1453]: pam_unix(sshd:session): session closed for user root Nov 18 18:01:37 oleg228-client systemd[1]: session-1.scope: Succeeded. Nov 18 18:01:37 oleg228-client systemd-logind[1015]: Session 1 logged out. Waiting for processes to exit. Nov 18 18:01:37 oleg228-client systemd-logind[1015]: Removed session 1. Nov 18 18:01:37 oleg228-client sshd[1514]: Accepted publickey for root from 192.168.200.253 port 38498 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Nov 18 18:01:37 oleg228-client systemd-logind[1015]: New session 3 of user root. Nov 18 18:01:37 oleg228-client systemd[1]: Started Session 3 of user root. Nov 18 18:01:37 oleg228-client sshd[1514]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:01:38 oleg228-client systemd[1]: NetworkManager-dispatcher.service: Succeeded. Nov 18 18:01:58 oleg228-client systemd[1]: systemd-hostnamed.service: Succeeded. Nov 18 18:01:58 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event0 (Power Button) Nov 18 18:01:58 oleg228-client systemd-udevd[2293]: Using default interface naming scheme 'rhel-8.0'. Nov 18 18:01:59 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Nov 18 18:01:59 oleg228-client kernel: libcfs: loading out-of-tree module taints kernel. Nov 18 18:01:59 oleg228-client kernel: Key type ._llcrypt registered Nov 18 18:01:59 oleg228-client kernel: Key type .llcrypt registered Nov 18 18:01:59 oleg228-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Nov 18 18:01:59 oleg228-client kernel: alg: No test for adler32 (adler32-zlib) Nov 18 18:02:01 oleg228-client kernel: Lustre: Lustre: Build Version: 2.16.61_43_g35e72c9 Nov 18 18:02:02 oleg228-client kernel: LNet: Added LNI 192.168.202.28@tcp [8/256/0/180] Nov 18 18:02:03 oleg228-client kernel: Key type lgssc registered Nov 18 18:02:05 oleg228-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Nov 18 18:03:08 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event0 (Power Button) Nov 18 18:03:08 oleg228-client systemd-udevd[4473]: Using default interface naming scheme 'rhel-8.0'. Nov 18 18:03:08 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Nov 18 18:04:31 oleg228-client kernel: hrtimer: interrupt took 4836572 ns Nov 18 18:04:46 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 18:04:48 oleg228-client sshd[6238]: Accepted publickey for root from 192.168.202.28 port 58380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:04:48 oleg228-client systemd[1]: Started Session 4 of user root. Nov 18 18:04:48 oleg228-client systemd-logind[1015]: New session 4 of user root. Nov 18 18:04:48 oleg228-client sshd[6238]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:04:49 oleg228-client sshd[6251]: Received disconnect from 192.168.202.28 port 58380:11: disconnected by user Nov 18 18:04:49 oleg228-client sshd[6251]: Disconnected from user root 192.168.202.28 port 58380 Nov 18 18:04:49 oleg228-client sshd[6238]: pam_unix(sshd:session): session closed for user root Nov 18 18:04:49 oleg228-client systemd[1]: session-4.scope: Succeeded. Nov 18 18:04:49 oleg228-client systemd-logind[1015]: Session 4 logged out. Waiting for processes to exit. Nov 18 18:04:49 oleg228-client systemd-logind[1015]: Removed session 4. Nov 18 18:04:52 oleg228-client sshd[6416]: Accepted publickey for root from 192.168.202.28 port 57570 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:04:52 oleg228-client systemd-logind[1015]: New session 5 of user root. Nov 18 18:04:52 oleg228-client systemd[1]: Started Session 5 of user root. Nov 18 18:04:52 oleg228-client sshd[6416]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:04:52 oleg228-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Nov 18 18:04:52 oleg228-client sshd[6429]: Received disconnect from 192.168.202.28 port 57570:11: disconnected by user Nov 18 18:04:52 oleg228-client sshd[6429]: Disconnected from user root 192.168.202.28 port 57570 Nov 18 18:04:52 oleg228-client sshd[6416]: pam_unix(sshd:session): session closed for user root Nov 18 18:04:52 oleg228-client systemd[1]: session-5.scope: Succeeded. Nov 18 18:04:52 oleg228-client systemd-logind[1015]: Session 5 logged out. Waiting for processes to exit. Nov 18 18:04:52 oleg228-client systemd-logind[1015]: Removed session 5. Nov 18 18:04:53 oleg228-client sshd[6550]: Accepted publickey for root from 192.168.202.28 port 57580 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:04:53 oleg228-client systemd-logind[1015]: New session 6 of user root. Nov 18 18:04:53 oleg228-client systemd[1]: Started Session 6 of user root. Nov 18 18:04:53 oleg228-client sshd[6550]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:04:54 oleg228-client sshd[6563]: Received disconnect from 192.168.202.28 port 57580:11: disconnected by user Nov 18 18:04:54 oleg228-client sshd[6563]: Disconnected from user root 192.168.202.28 port 57580 Nov 18 18:04:54 oleg228-client sshd[6550]: pam_unix(sshd:session): session closed for user root Nov 18 18:04:54 oleg228-client systemd-logind[1015]: Session 6 logged out. Waiting for processes to exit. Nov 18 18:04:54 oleg228-client systemd[1]: session-6.scope: Succeeded. Nov 18 18:04:54 oleg228-client systemd-logind[1015]: Removed session 6. Nov 18 18:05:04 oleg228-client systemd-udevd[6741]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:05:11 oleg228-client sshd[6860]: Accepted publickey for root from 192.168.202.28 port 38696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:11 oleg228-client systemd-logind[1015]: New session 7 of user root. Nov 18 18:05:11 oleg228-client systemd[1]: Started Session 7 of user root. Nov 18 18:05:11 oleg228-client sshd[6860]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:12 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc80e3800: disconnect after 23s idle Nov 18 18:05:14 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing check_logdir /tmp/testlogs/ Nov 18 18:05:14 oleg228-client sshd[6873]: Received disconnect from 192.168.202.28 port 38696:11: disconnected by user Nov 18 18:05:14 oleg228-client sshd[6873]: Disconnected from user root 192.168.202.28 port 38696 Nov 18 18:05:14 oleg228-client sshd[6860]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:14 oleg228-client systemd[1]: session-7.scope: Succeeded. Nov 18 18:05:14 oleg228-client systemd-logind[1015]: Session 7 logged out. Waiting for processes to exit. Nov 18 18:05:14 oleg228-client systemd-logind[1015]: Removed session 7. Nov 18 18:05:16 oleg228-client sshd[7123]: Accepted publickey for root from 192.168.202.28 port 38698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:16 oleg228-client systemd-logind[1015]: New session 8 of user root. Nov 18 18:05:16 oleg228-client systemd[1]: Started Session 8 of user root. Nov 18 18:05:16 oleg228-client sshd[7123]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:19 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing yml_node Nov 18 18:05:21 oleg228-client sshd[7136]: Received disconnect from 192.168.202.28 port 38698:11: disconnected by user Nov 18 18:05:21 oleg228-client sshd[7136]: Disconnected from user root 192.168.202.28 port 38698 Nov 18 18:05:21 oleg228-client sshd[7123]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:21 oleg228-client systemd[1]: session-8.scope: Succeeded. Nov 18 18:05:21 oleg228-client systemd-logind[1015]: Session 8 logged out. Waiting for processes to exit. Nov 18 18:05:21 oleg228-client systemd-logind[1015]: Removed session 8. Nov 18 18:05:24 oleg228-client sshd[7706]: Accepted publickey for root from 192.168.202.28 port 47196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:24 oleg228-client systemd[1]: Started Session 9 of user root. Nov 18 18:05:24 oleg228-client systemd-logind[1015]: New session 9 of user root. Nov 18 18:05:24 oleg228-client sshd[7706]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:25 oleg228-client kernel: Lustre: DEBUG MARKER: Client: 2.16.61.43 Nov 18 18:05:25 oleg228-client sshd[7719]: Received disconnect from 192.168.202.28 port 47196:11: disconnected by user Nov 18 18:05:25 oleg228-client sshd[7719]: Disconnected from user root 192.168.202.28 port 47196 Nov 18 18:05:25 oleg228-client sshd[7706]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:25 oleg228-client systemd[1]: session-9.scope: Succeeded. Nov 18 18:05:25 oleg228-client systemd-logind[1015]: Session 9 logged out. Waiting for processes to exit. Nov 18 18:05:25 oleg228-client systemd-logind[1015]: Removed session 9. Nov 18 18:05:27 oleg228-client sshd[7862]: Accepted publickey for root from 192.168.202.28 port 47202 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:27 oleg228-client systemd[1]: Started Session 10 of user root. Nov 18 18:05:27 oleg228-client systemd-logind[1015]: New session 10 of user root. Nov 18 18:05:27 oleg228-client sshd[7862]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:28 oleg228-client kernel: Lustre: DEBUG MARKER: MDS: 2.16.61.43 Nov 18 18:05:28 oleg228-client sshd[7875]: Received disconnect from 192.168.202.28 port 47202:11: disconnected by user Nov 18 18:05:28 oleg228-client sshd[7875]: Disconnected from user root 192.168.202.28 port 47202 Nov 18 18:05:28 oleg228-client sshd[7862]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:28 oleg228-client systemd-logind[1015]: Session 10 logged out. Waiting for processes to exit. Nov 18 18:05:28 oleg228-client systemd[1]: session-10.scope: Succeeded. Nov 18 18:05:28 oleg228-client systemd-logind[1015]: Removed session 10. Nov 18 18:05:30 oleg228-client sshd[8019]: Accepted publickey for root from 192.168.202.28 port 47206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:30 oleg228-client systemd[1]: Started Session 11 of user root. Nov 18 18:05:30 oleg228-client systemd-logind[1015]: New session 11 of user root. Nov 18 18:05:30 oleg228-client sshd[8019]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:31 oleg228-client kernel: Lustre: DEBUG MARKER: OSS: 2.16.61.43 Nov 18 18:05:31 oleg228-client sshd[8032]: Received disconnect from 192.168.202.28 port 47206:11: disconnected by user Nov 18 18:05:31 oleg228-client sshd[8032]: Disconnected from user root 192.168.202.28 port 47206 Nov 18 18:05:31 oleg228-client sshd[8019]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:31 oleg228-client systemd[1]: session-11.scope: Succeeded. Nov 18 18:05:31 oleg228-client systemd-logind[1015]: Session 11 logged out. Waiting for processes to exit. Nov 18 18:05:31 oleg228-client systemd-logind[1015]: Removed session 11. Nov 18 18:05:31 oleg228-client sshd[8166]: Accepted publickey for root from 192.168.202.28 port 59818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:32 oleg228-client systemd-logind[1015]: New session 12 of user root. Nov 18 18:05:32 oleg228-client systemd[1]: Started Session 12 of user root. Nov 18 18:05:32 oleg228-client sshd[8166]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:32 oleg228-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Tue Nov 18 18:05:31 EST 2025 Nov 18 18:05:32 oleg228-client sshd[8179]: Received disconnect from 192.168.202.28 port 59818:11: disconnected by user Nov 18 18:05:32 oleg228-client sshd[8179]: Disconnected from user root 192.168.202.28 port 59818 Nov 18 18:05:32 oleg228-client sshd[8166]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:32 oleg228-client systemd[1]: session-12.scope: Succeeded. Nov 18 18:05:32 oleg228-client systemd-logind[1015]: Session 12 logged out. Waiting for processes to exit. Nov 18 18:05:32 oleg228-client systemd-logind[1015]: Removed session 12. Nov 18 18:05:49 oleg228-client sshd[8696]: Accepted publickey for root from 192.168.202.28 port 58478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:49 oleg228-client systemd-logind[1015]: New session 13 of user root. Nov 18 18:05:49 oleg228-client systemd[1]: Started Session 13 of user root. Nov 18 18:05:49 oleg228-client sshd[8696]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:50 oleg228-client kernel: Lustre: DEBUG MARKER: excepting tests: 136 Nov 18 18:05:50 oleg228-client sshd[8709]: Received disconnect from 192.168.202.28 port 58478:11: disconnected by user Nov 18 18:05:50 oleg228-client sshd[8709]: Disconnected from user root 192.168.202.28 port 58478 Nov 18 18:05:50 oleg228-client sshd[8696]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:50 oleg228-client systemd[1]: session-13.scope: Succeeded. Nov 18 18:05:50 oleg228-client systemd-logind[1015]: Session 13 logged out. Waiting for processes to exit. Nov 18 18:05:50 oleg228-client systemd-logind[1015]: Removed session 13. Nov 18 18:05:51 oleg228-client sshd[8883]: Accepted publickey for root from 192.168.202.28 port 45340 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:52 oleg228-client systemd-logind[1015]: New session 14 of user root. Nov 18 18:05:52 oleg228-client systemd[1]: Started Session 14 of user root. Nov 18 18:05:52 oleg228-client sshd[8883]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:52 oleg228-client kernel: Lustre: DEBUG MARKER: === recovery-small: start setup 18:05:50 (1763507150) === Nov 18 18:05:52 oleg228-client sshd[8896]: Received disconnect from 192.168.202.28 port 45340:11: disconnected by user Nov 18 18:05:52 oleg228-client sshd[8896]: Disconnected from user root 192.168.202.28 port 45340 Nov 18 18:05:52 oleg228-client sshd[8883]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:52 oleg228-client systemd[1]: session-14.scope: Succeeded. Nov 18 18:05:52 oleg228-client systemd-logind[1015]: Session 14 logged out. Waiting for processes to exit. Nov 18 18:05:52 oleg228-client systemd-logind[1015]: Removed session 14. Nov 18 18:05:56 oleg228-client sshd[9132]: Accepted publickey for root from 192.168.202.28 port 45348 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:05:56 oleg228-client systemd-logind[1015]: New session 15 of user root. Nov 18 18:05:56 oleg228-client systemd[1]: Started Session 15 of user root. Nov 18 18:05:56 oleg228-client sshd[9132]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:05:56 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing check_config_client /mnt/lustre Nov 18 18:05:56 oleg228-client sshd[9145]: Received disconnect from 192.168.202.28 port 45348:11: disconnected by user Nov 18 18:05:56 oleg228-client sshd[9145]: Disconnected from user root 192.168.202.28 port 45348 Nov 18 18:05:56 oleg228-client sshd[9132]: pam_unix(sshd:session): session closed for user root Nov 18 18:05:57 oleg228-client systemd[1]: session-15.scope: Succeeded. Nov 18 18:05:57 oleg228-client systemd-logind[1015]: Session 15 logged out. Waiting for processes to exit. Nov 18 18:05:57 oleg228-client systemd-logind[1015]: Removed session 15. Nov 18 18:06:17 oleg228-client sshd[9870]: Accepted publickey for root from 192.168.202.28 port 36784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:06:17 oleg228-client systemd-logind[1015]: New session 16 of user root. Nov 18 18:06:17 oleg228-client systemd[1]: Started Session 16 of user root. Nov 18 18:06:17 oleg228-client sshd[9870]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:06:17 oleg228-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Nov 18 18:06:17 oleg228-client sshd[9883]: Received disconnect from 192.168.202.28 port 36784:11: disconnected by user Nov 18 18:06:17 oleg228-client sshd[9883]: Disconnected from user root 192.168.202.28 port 36784 Nov 18 18:06:17 oleg228-client sshd[9870]: pam_unix(sshd:session): session closed for user root Nov 18 18:06:18 oleg228-client systemd-logind[1015]: Session 16 logged out. Waiting for processes to exit. Nov 18 18:06:18 oleg228-client systemd[1]: session-16.scope: Succeeded. Nov 18 18:06:18 oleg228-client systemd-logind[1015]: Removed session 16. Nov 18 18:06:19 oleg228-client sshd[10004]: Accepted publickey for root from 192.168.202.28 port 36796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:06:19 oleg228-client systemd-logind[1015]: New session 17 of user root. Nov 18 18:06:19 oleg228-client systemd[1]: Started Session 17 of user root. Nov 18 18:06:19 oleg228-client sshd[10004]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:06:19 oleg228-client sshd[10017]: Received disconnect from 192.168.202.28 port 36796:11: disconnected by user Nov 18 18:06:19 oleg228-client sshd[10017]: Disconnected from user root 192.168.202.28 port 36796 Nov 18 18:06:19 oleg228-client sshd[10004]: pam_unix(sshd:session): session closed for user root Nov 18 18:06:19 oleg228-client systemd[1]: session-17.scope: Succeeded. Nov 18 18:06:19 oleg228-client systemd-logind[1015]: Session 17 logged out. Waiting for processes to exit. Nov 18 18:06:19 oleg228-client systemd-logind[1015]: Removed session 17. Nov 18 18:06:28 oleg228-client sshd[10464]: Accepted publickey for root from 192.168.202.28 port 38526 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:06:29 oleg228-client systemd[1]: Started Session 18 of user root. Nov 18 18:06:29 oleg228-client systemd-logind[1015]: New session 18 of user root. Nov 18 18:06:29 oleg228-client sshd[10464]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:06:29 oleg228-client sshd[10477]: Received disconnect from 192.168.202.28 port 38526:11: disconnected by user Nov 18 18:06:29 oleg228-client sshd[10477]: Disconnected from user root 192.168.202.28 port 38526 Nov 18 18:06:29 oleg228-client sshd[10464]: pam_unix(sshd:session): session closed for user root Nov 18 18:06:29 oleg228-client systemd[1]: session-18.scope: Succeeded. Nov 18 18:06:29 oleg228-client systemd-logind[1015]: Session 18 logged out. Waiting for processes to exit. Nov 18 18:06:29 oleg228-client systemd-logind[1015]: Removed session 18. Nov 18 18:06:31 oleg228-client sshd[10603]: Accepted publickey for root from 192.168.202.28 port 33490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:06:31 oleg228-client systemd[1]: Started Session 19 of user root. Nov 18 18:06:31 oleg228-client systemd-logind[1015]: New session 19 of user root. Nov 18 18:06:31 oleg228-client sshd[10603]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:06:31 oleg228-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish setup 18:06:29 (1763507189) === Nov 18 18:06:31 oleg228-client sshd[10616]: Received disconnect from 192.168.202.28 port 33490:11: disconnected by user Nov 18 18:06:31 oleg228-client sshd[10616]: Disconnected from user root 192.168.202.28 port 33490 Nov 18 18:06:31 oleg228-client sshd[10603]: pam_unix(sshd:session): session closed for user root Nov 18 18:06:31 oleg228-client systemd[1]: session-19.scope: Succeeded. Nov 18 18:06:31 oleg228-client systemd-logind[1015]: Session 19 logged out. Waiting for processes to exit. Nov 18 18:06:31 oleg228-client systemd-logind[1015]: Removed session 19. Nov 18 18:06:32 oleg228-client sshd[10758]: Accepted publickey for root from 192.168.202.28 port 33496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:06:32 oleg228-client systemd[1]: Started Session 20 of user root. Nov 18 18:06:32 oleg228-client systemd-logind[1015]: New session 20 of user root. Nov 18 18:06:32 oleg228-client sshd[10758]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:06:33 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 1: create, chmod, stat: drop req, drop rep ========================================================== 18:06:31 (1763507191) Nov 18 18:06:33 oleg228-client sshd[10772]: Received disconnect from 192.168.202.28 port 33496:11: disconnected by user Nov 18 18:06:33 oleg228-client sshd[10772]: Disconnected from user root 192.168.202.28 port 33496 Nov 18 18:06:33 oleg228-client sshd[10758]: pam_unix(sshd:session): session closed for user root Nov 18 18:06:33 oleg228-client systemd[1]: session-20.scope: Succeeded. Nov 18 18:06:33 oleg228-client systemd-logind[1015]: Session 20 logged out. Waiting for processes to exit. Nov 18 18:06:33 oleg228-client systemd-logind[1015]: Removed session 20. Nov 18 18:06:50 oleg228-client kernel: Lustre: 10820:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507194/real 1763507194] req@ffff9ccbc4f7b480 x1849171034259072/t0(0) o700->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:30/10 lens 264/248 e 0 to 1 dl 1763507210 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Nov 18 18:06:50 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:06:50 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:07:10 oleg228-client kernel: Lustre: 10841:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507214/real 1763507214] req@ffff9ccbc9af1f80 x1849171034261376/t0(0) o36->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 520/576 e 0 to 1 dl 1763507230 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 Nov 18 18:07:10 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:07:10 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:07:29 oleg228-client kernel: Lustre: 10868:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507233/real 1763507233] req@ffff9ccbc3851f80 x1849171034263168/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763507249 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:0 Nov 18 18:07:29 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:07:29 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:07:48 oleg228-client kernel: Lustre: 10889:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507252/real 1763507252] req@ffff9ccbc4f7ad80 x1849171034265984/t0(0) o36->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 488/512 e 0 to 1 dl 1763507268 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'tchmod.0' uid:0 gid:0 projid:4294967295 Nov 18 18:07:48 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:07:48 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:08:09 oleg228-client kernel: Lustre: 10932:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507273/real 1763507273] req@ffff9ccbc8b8f100 x1849171034267904/t0(0) o34->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 472/728 e 0 to 1 dl 1763507289 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'statone.0' uid:0 gid:0 projid:0 Nov 18 18:08:09 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:08:09 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:08:11 oleg228-client sshd[11030]: Accepted publickey for root from 192.168.202.28 port 42828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:08:11 oleg228-client systemd[1]: Started Session 21 of user root. Nov 18 18:08:11 oleg228-client systemd-logind[1015]: New session 21 of user root. Nov 18 18:08:11 oleg228-client sshd[11030]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:08:12 oleg228-client sshd[11043]: Received disconnect from 192.168.202.28 port 42828:11: disconnected by user Nov 18 18:08:12 oleg228-client sshd[11043]: Disconnected from user root 192.168.202.28 port 42828 Nov 18 18:08:12 oleg228-client sshd[11030]: pam_unix(sshd:session): session closed for user root Nov 18 18:08:12 oleg228-client systemd[1]: session-21.scope: Succeeded. Nov 18 18:08:12 oleg228-client systemd-logind[1015]: Session 21 logged out. Waiting for processes to exit. Nov 18 18:08:12 oleg228-client systemd-logind[1015]: Removed session 21. Nov 18 18:08:13 oleg228-client sshd[11171]: Accepted publickey for root from 192.168.202.28 port 42840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:08:13 oleg228-client systemd-logind[1015]: New session 22 of user root. Nov 18 18:08:13 oleg228-client systemd[1]: Started Session 22 of user root. Nov 18 18:08:13 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:08:13 oleg228-client sshd[11171]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:08:13 oleg228-client sshd[11185]: Received disconnect from 192.168.202.28 port 42840:11: disconnected by user Nov 18 18:08:13 oleg228-client sshd[11185]: Disconnected from user root 192.168.202.28 port 42840 Nov 18 18:08:13 oleg228-client sshd[11171]: pam_unix(sshd:session): session closed for user root Nov 18 18:08:13 oleg228-client systemd[1]: session-22.scope: Succeeded. Nov 18 18:08:13 oleg228-client systemd-logind[1015]: Session 22 logged out. Waiting for processes to exit. Nov 18 18:08:13 oleg228-client systemd-logind[1015]: Removed session 22. Nov 18 18:08:14 oleg228-client sshd[11318]: Accepted publickey for root from 192.168.202.28 port 42854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:08:15 oleg228-client systemd-logind[1015]: New session 23 of user root. Nov 18 18:08:15 oleg228-client systemd[1]: Started Session 23 of user root. Nov 18 18:08:15 oleg228-client sshd[11318]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:08:15 oleg228-client sshd[11331]: Received disconnect from 192.168.202.28 port 42854:11: disconnected by user Nov 18 18:08:15 oleg228-client sshd[11331]: Disconnected from user root 192.168.202.28 port 42854 Nov 18 18:08:15 oleg228-client sshd[11318]: pam_unix(sshd:session): session closed for user root Nov 18 18:08:15 oleg228-client systemd[1]: session-23.scope: Succeeded. Nov 18 18:08:15 oleg228-client systemd-logind[1015]: Session 23 logged out. Waiting for processes to exit. Nov 18 18:08:15 oleg228-client systemd-logind[1015]: Removed session 23. Nov 18 18:08:17 oleg228-client sshd[11474]: Accepted publickey for root from 192.168.202.28 port 42868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:08:17 oleg228-client systemd-logind[1015]: New session 24 of user root. Nov 18 18:08:17 oleg228-client systemd[1]: Started Session 24 of user root. Nov 18 18:08:17 oleg228-client sshd[11474]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:08:17 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 4: open: drop req, drop rep ======= 18:08:16 (1763507296) Nov 18 18:08:17 oleg228-client sshd[11487]: Received disconnect from 192.168.202.28 port 42868:11: disconnected by user Nov 18 18:08:17 oleg228-client sshd[11487]: Disconnected from user root 192.168.202.28 port 42868 Nov 18 18:08:17 oleg228-client sshd[11474]: pam_unix(sshd:session): session closed for user root Nov 18 18:08:18 oleg228-client systemd[1]: session-24.scope: Succeeded. Nov 18 18:08:18 oleg228-client systemd-logind[1015]: Session 24 logged out. Waiting for processes to exit. Nov 18 18:08:18 oleg228-client systemd-logind[1015]: Removed session 24. Nov 18 18:08:35 oleg228-client kernel: Lustre: 11543:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507299/real 1763507299] req@ffff9ccbc3850a80 x1849171034270848/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763507315 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 Nov 18 18:08:35 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:08:35 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:08:54 oleg228-client kernel: Lustre: 11565:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507318/real 1763507318] req@ffff9ccbc9af0a80 x1849171034274944/t0(0) o35->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:23/10 lens 392/624 e 0 to 1 dl 1763507334 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 Nov 18 18:08:54 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:08:54 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:08:58 oleg228-client sshd[11663]: Accepted publickey for root from 192.168.202.28 port 41852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:08:58 oleg228-client systemd-logind[1015]: New session 25 of user root. Nov 18 18:08:58 oleg228-client systemd[1]: Started Session 25 of user root. Nov 18 18:08:58 oleg228-client sshd[11663]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:08:58 oleg228-client sshd[11676]: Received disconnect from 192.168.202.28 port 41852:11: disconnected by user Nov 18 18:08:58 oleg228-client sshd[11676]: Disconnected from user root 192.168.202.28 port 41852 Nov 18 18:08:58 oleg228-client sshd[11663]: pam_unix(sshd:session): session closed for user root Nov 18 18:08:59 oleg228-client systemd-logind[1015]: Session 25 logged out. Waiting for processes to exit. Nov 18 18:08:59 oleg228-client systemd[1]: session-25.scope: Succeeded. Nov 18 18:08:59 oleg228-client systemd-logind[1015]: Removed session 25. Nov 18 18:09:00 oleg228-client sshd[11804]: Accepted publickey for root from 192.168.202.28 port 41860 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:00 oleg228-client systemd-logind[1015]: New session 26 of user root. Nov 18 18:09:00 oleg228-client systemd[1]: Started Session 26 of user root. Nov 18 18:09:00 oleg228-client sshd[11804]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:01 oleg228-client sshd[11817]: Received disconnect from 192.168.202.28 port 41860:11: disconnected by user Nov 18 18:09:01 oleg228-client sshd[11817]: Disconnected from user root 192.168.202.28 port 41860 Nov 18 18:09:01 oleg228-client sshd[11804]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:01 oleg228-client systemd[1]: session-26.scope: Succeeded. Nov 18 18:09:01 oleg228-client systemd-logind[1015]: Session 26 logged out. Waiting for processes to exit. Nov 18 18:09:01 oleg228-client systemd-logind[1015]: Removed session 26. Nov 18 18:09:02 oleg228-client sshd[11950]: Accepted publickey for root from 192.168.202.28 port 39582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:02 oleg228-client systemd-logind[1015]: New session 27 of user root. Nov 18 18:09:02 oleg228-client systemd[1]: Started Session 27 of user root. Nov 18 18:09:02 oleg228-client sshd[11950]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:03 oleg228-client sshd[11963]: Received disconnect from 192.168.202.28 port 39582:11: disconnected by user Nov 18 18:09:03 oleg228-client sshd[11963]: Disconnected from user root 192.168.202.28 port 39582 Nov 18 18:09:03 oleg228-client sshd[11950]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:03 oleg228-client systemd[1]: session-27.scope: Succeeded. Nov 18 18:09:03 oleg228-client systemd-logind[1015]: Session 27 logged out. Waiting for processes to exit. Nov 18 18:09:03 oleg228-client systemd-logind[1015]: Removed session 27. Nov 18 18:09:04 oleg228-client sshd[12105]: Accepted publickey for root from 192.168.202.28 port 39588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:04 oleg228-client systemd-logind[1015]: New session 28 of user root. Nov 18 18:09:04 oleg228-client systemd[1]: Started Session 28 of user root. Nov 18 18:09:04 oleg228-client sshd[12105]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:05 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 5: rename: drop req, drop rep ===== 18:09:03 (1763507343) Nov 18 18:09:05 oleg228-client sshd[12118]: Received disconnect from 192.168.202.28 port 39588:11: disconnected by user Nov 18 18:09:05 oleg228-client sshd[12118]: Disconnected from user root 192.168.202.28 port 39588 Nov 18 18:09:05 oleg228-client sshd[12105]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:05 oleg228-client systemd[1]: session-28.scope: Succeeded. Nov 18 18:09:05 oleg228-client systemd-logind[1015]: Session 28 logged out. Waiting for processes to exit. Nov 18 18:09:05 oleg228-client systemd-logind[1015]: Removed session 28. Nov 18 18:09:41 oleg228-client kernel: Lustre: 12195:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507365/real 1763507365] req@ffff9ccbc9af0a80 x1849171034283008/t0(0) o36->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:13/10 lens 552/624 e 0 to 1 dl 1763507381 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:4294967295 Nov 18 18:09:41 oleg228-client kernel: Lustre: 12195:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message Nov 18 18:09:41 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:09:41 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:09:41 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:09:41 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:09:45 oleg228-client sshd[12306]: Accepted publickey for root from 192.168.202.28 port 45382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:45 oleg228-client systemd-logind[1015]: New session 29 of user root. Nov 18 18:09:45 oleg228-client systemd[1]: Started Session 29 of user root. Nov 18 18:09:45 oleg228-client sshd[12306]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:45 oleg228-client sshd[12319]: Received disconnect from 192.168.202.28 port 45382:11: disconnected by user Nov 18 18:09:45 oleg228-client sshd[12319]: Disconnected from user root 192.168.202.28 port 45382 Nov 18 18:09:45 oleg228-client sshd[12306]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:45 oleg228-client systemd[1]: session-29.scope: Succeeded. Nov 18 18:09:45 oleg228-client systemd-logind[1015]: Session 29 logged out. Waiting for processes to exit. Nov 18 18:09:45 oleg228-client systemd-logind[1015]: Removed session 29. Nov 18 18:09:46 oleg228-client sshd[12445]: Accepted publickey for root from 192.168.202.28 port 45398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:46 oleg228-client systemd-logind[1015]: New session 30 of user root. Nov 18 18:09:46 oleg228-client systemd[1]: Started Session 30 of user root. Nov 18 18:09:46 oleg228-client sshd[12445]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:47 oleg228-client sshd[12458]: Received disconnect from 192.168.202.28 port 45398:11: disconnected by user Nov 18 18:09:47 oleg228-client sshd[12458]: Disconnected from user root 192.168.202.28 port 45398 Nov 18 18:09:47 oleg228-client sshd[12445]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:47 oleg228-client systemd[1]: session-30.scope: Succeeded. Nov 18 18:09:47 oleg228-client systemd-logind[1015]: Session 30 logged out. Waiting for processes to exit. Nov 18 18:09:47 oleg228-client systemd-logind[1015]: Removed session 30. Nov 18 18:09:48 oleg228-client sshd[12591]: Accepted publickey for root from 192.168.202.28 port 45410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:48 oleg228-client systemd-logind[1015]: New session 31 of user root. Nov 18 18:09:48 oleg228-client systemd[1]: Started Session 31 of user root. Nov 18 18:09:48 oleg228-client sshd[12591]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:48 oleg228-client sshd[12604]: Received disconnect from 192.168.202.28 port 45410:11: disconnected by user Nov 18 18:09:48 oleg228-client sshd[12604]: Disconnected from user root 192.168.202.28 port 45410 Nov 18 18:09:48 oleg228-client sshd[12591]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:48 oleg228-client systemd[1]: session-31.scope: Succeeded. Nov 18 18:09:48 oleg228-client systemd-logind[1015]: Session 31 logged out. Waiting for processes to exit. Nov 18 18:09:48 oleg228-client systemd-logind[1015]: Removed session 31. Nov 18 18:09:50 oleg228-client sshd[12746]: Accepted publickey for root from 192.168.202.28 port 45416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:09:50 oleg228-client systemd-logind[1015]: New session 32 of user root. Nov 18 18:09:50 oleg228-client systemd[1]: Started Session 32 of user root. Nov 18 18:09:50 oleg228-client sshd[12746]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:09:50 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 6: link, unlink: drop req, drop rep ========================================================== 18:09:48 (1763507388) Nov 18 18:09:50 oleg228-client sshd[12759]: Received disconnect from 192.168.202.28 port 45416:11: disconnected by user Nov 18 18:09:50 oleg228-client sshd[12759]: Disconnected from user root 192.168.202.28 port 45416 Nov 18 18:09:50 oleg228-client sshd[12746]: pam_unix(sshd:session): session closed for user root Nov 18 18:09:50 oleg228-client systemd[1]: session-32.scope: Succeeded. Nov 18 18:09:50 oleg228-client systemd-logind[1015]: Session 32 logged out. Waiting for processes to exit. Nov 18 18:09:50 oleg228-client systemd-logind[1015]: Removed session 32. Nov 18 18:10:13 oleg228-client kernel: Lustre: lustre-OST0001-osc-ffff9ccbc80e3800: disconnect after 24s idle Nov 18 18:10:13 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:11:02 oleg228-client kernel: Lustre: 12882:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507446/real 1763507446] req@ffff9ccbc8b8dc00 x1849171034297728/t0(0) o36->lustre-MDT0000-mdc-ffff9ccbc80e3800@192.168.202.128@tcp:12/10 lens 504/624 e 0 to 1 dl 1763507462 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'unlink.0' uid:0 gid:0 projid:4294967295 Nov 18 18:11:02 oleg228-client kernel: Lustre: 12882:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Nov 18 18:11:02 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:11:02 oleg228-client kernel: Lustre: Skipped 3 previous similar messages Nov 18 18:11:02 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:11:02 oleg228-client kernel: Lustre: Skipped 3 previous similar messages Nov 18 18:11:04 oleg228-client sshd[12986]: Accepted publickey for root from 192.168.202.28 port 49758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:04 oleg228-client systemd[1]: Started Session 33 of user root. Nov 18 18:11:04 oleg228-client systemd-logind[1015]: New session 33 of user root. Nov 18 18:11:04 oleg228-client sshd[12986]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:04 oleg228-client sshd[12999]: Received disconnect from 192.168.202.28 port 49758:11: disconnected by user Nov 18 18:11:04 oleg228-client sshd[12999]: Disconnected from user root 192.168.202.28 port 49758 Nov 18 18:11:04 oleg228-client sshd[12986]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:04 oleg228-client systemd[1]: session-33.scope: Succeeded. Nov 18 18:11:04 oleg228-client systemd-logind[1015]: Session 33 logged out. Waiting for processes to exit. Nov 18 18:11:04 oleg228-client systemd-logind[1015]: Removed session 33. Nov 18 18:11:05 oleg228-client sshd[13125]: Accepted publickey for root from 192.168.202.28 port 49762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:05 oleg228-client systemd-logind[1015]: New session 34 of user root. Nov 18 18:11:05 oleg228-client systemd[1]: Started Session 34 of user root. Nov 18 18:11:05 oleg228-client sshd[13125]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:06 oleg228-client sshd[13138]: Received disconnect from 192.168.202.28 port 49762:11: disconnected by user Nov 18 18:11:06 oleg228-client sshd[13138]: Disconnected from user root 192.168.202.28 port 49762 Nov 18 18:11:06 oleg228-client sshd[13125]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:06 oleg228-client systemd-logind[1015]: Session 34 logged out. Waiting for processes to exit. Nov 18 18:11:06 oleg228-client systemd[1]: session-34.scope: Succeeded. Nov 18 18:11:06 oleg228-client systemd-logind[1015]: Removed session 34. Nov 18 18:11:07 oleg228-client sshd[13271]: Accepted publickey for root from 192.168.202.28 port 49774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:07 oleg228-client systemd-logind[1015]: New session 35 of user root. Nov 18 18:11:07 oleg228-client systemd[1]: Started Session 35 of user root. Nov 18 18:11:07 oleg228-client sshd[13271]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:07 oleg228-client sshd[13284]: Received disconnect from 192.168.202.28 port 49774:11: disconnected by user Nov 18 18:11:07 oleg228-client sshd[13284]: Disconnected from user root 192.168.202.28 port 49774 Nov 18 18:11:07 oleg228-client sshd[13271]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:07 oleg228-client systemd[1]: session-35.scope: Succeeded. Nov 18 18:11:07 oleg228-client systemd-logind[1015]: Session 35 logged out. Waiting for processes to exit. Nov 18 18:11:07 oleg228-client systemd-logind[1015]: Removed session 35. Nov 18 18:11:08 oleg228-client sshd[13427]: Accepted publickey for root from 192.168.202.28 port 49780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:08 oleg228-client systemd-logind[1015]: New session 36 of user root. Nov 18 18:11:08 oleg228-client systemd[1]: Started Session 36 of user root. Nov 18 18:11:08 oleg228-client sshd[13427]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:09 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 8: touch: drop rep (bug 1423) ===== 18:11:07 (1763507467) Nov 18 18:11:09 oleg228-client sshd[13440]: Received disconnect from 192.168.202.28 port 49780:11: disconnected by user Nov 18 18:11:09 oleg228-client sshd[13440]: Disconnected from user root 192.168.202.28 port 49780 Nov 18 18:11:09 oleg228-client sshd[13427]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:09 oleg228-client systemd[1]: session-36.scope: Succeeded. Nov 18 18:11:09 oleg228-client systemd-logind[1015]: Session 36 logged out. Waiting for processes to exit. Nov 18 18:11:09 oleg228-client systemd-logind[1015]: Removed session 36. Nov 18 18:11:28 oleg228-client sshd[13582]: Accepted publickey for root from 192.168.202.28 port 40016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:28 oleg228-client systemd[1]: Started Session 37 of user root. Nov 18 18:11:28 oleg228-client systemd-logind[1015]: New session 37 of user root. Nov 18 18:11:28 oleg228-client sshd[13582]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:29 oleg228-client sshd[13595]: Received disconnect from 192.168.202.28 port 40016:11: disconnected by user Nov 18 18:11:29 oleg228-client sshd[13595]: Disconnected from user root 192.168.202.28 port 40016 Nov 18 18:11:29 oleg228-client sshd[13582]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:29 oleg228-client systemd[1]: session-37.scope: Succeeded. Nov 18 18:11:29 oleg228-client systemd-logind[1015]: Session 37 logged out. Waiting for processes to exit. Nov 18 18:11:29 oleg228-client systemd-logind[1015]: Removed session 37. Nov 18 18:11:30 oleg228-client sshd[13721]: Accepted publickey for root from 192.168.202.28 port 40024 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:30 oleg228-client systemd[1]: Started Session 38 of user root. Nov 18 18:11:30 oleg228-client systemd-logind[1015]: New session 38 of user root. Nov 18 18:11:30 oleg228-client sshd[13721]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:30 oleg228-client sshd[13734]: Received disconnect from 192.168.202.28 port 40024:11: disconnected by user Nov 18 18:11:30 oleg228-client sshd[13734]: Disconnected from user root 192.168.202.28 port 40024 Nov 18 18:11:30 oleg228-client sshd[13721]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:31 oleg228-client systemd-logind[1015]: Session 38 logged out. Waiting for processes to exit. Nov 18 18:11:31 oleg228-client systemd[1]: session-38.scope: Succeeded. Nov 18 18:11:31 oleg228-client systemd-logind[1015]: Removed session 38. Nov 18 18:11:32 oleg228-client sshd[13867]: Accepted publickey for root from 192.168.202.28 port 47304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:32 oleg228-client systemd-logind[1015]: New session 39 of user root. Nov 18 18:11:32 oleg228-client systemd[1]: Started Session 39 of user root. Nov 18 18:11:32 oleg228-client sshd[13867]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:32 oleg228-client sshd[13880]: Received disconnect from 192.168.202.28 port 47304:11: disconnected by user Nov 18 18:11:32 oleg228-client sshd[13880]: Disconnected from user root 192.168.202.28 port 47304 Nov 18 18:11:32 oleg228-client sshd[13867]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:32 oleg228-client systemd[1]: session-39.scope: Succeeded. Nov 18 18:11:32 oleg228-client systemd-logind[1015]: Session 39 logged out. Waiting for processes to exit. Nov 18 18:11:32 oleg228-client systemd-logind[1015]: Removed session 39. Nov 18 18:11:34 oleg228-client sshd[14022]: Accepted publickey for root from 192.168.202.28 port 47318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:34 oleg228-client systemd-logind[1015]: New session 40 of user root. Nov 18 18:11:34 oleg228-client systemd[1]: Started Session 40 of user root. Nov 18 18:11:34 oleg228-client sshd[14022]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:34 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 9: pause bulk on OST (bug 1420) === 18:11:33 (1763507493) Nov 18 18:11:34 oleg228-client sshd[14036]: Received disconnect from 192.168.202.28 port 47318:11: disconnected by user Nov 18 18:11:34 oleg228-client sshd[14036]: Disconnected from user root 192.168.202.28 port 47318 Nov 18 18:11:34 oleg228-client sshd[14022]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:34 oleg228-client systemd-logind[1015]: Session 40 logged out. Waiting for processes to exit. Nov 18 18:11:34 oleg228-client systemd[1]: session-40.scope: Succeeded. Nov 18 18:11:34 oleg228-client systemd-logind[1015]: Removed session 40. Nov 18 18:11:45 oleg228-client sshd[14261]: Accepted publickey for root from 192.168.202.28 port 54246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:46 oleg228-client systemd-logind[1015]: New session 41 of user root. Nov 18 18:11:46 oleg228-client systemd[1]: Started Session 41 of user root. Nov 18 18:11:46 oleg228-client sshd[14261]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:46 oleg228-client sshd[14275]: Received disconnect from 192.168.202.28 port 54246:11: disconnected by user Nov 18 18:11:46 oleg228-client sshd[14275]: Disconnected from user root 192.168.202.28 port 54246 Nov 18 18:11:46 oleg228-client sshd[14261]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:46 oleg228-client systemd[1]: session-41.scope: Succeeded. Nov 18 18:11:46 oleg228-client systemd-logind[1015]: Session 41 logged out. Waiting for processes to exit. Nov 18 18:11:46 oleg228-client systemd-logind[1015]: Removed session 41. Nov 18 18:11:47 oleg228-client sshd[14402]: Accepted publickey for root from 192.168.202.28 port 54248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:47 oleg228-client systemd-logind[1015]: New session 42 of user root. Nov 18 18:11:47 oleg228-client systemd[1]: Started Session 42 of user root. Nov 18 18:11:47 oleg228-client sshd[14402]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:48 oleg228-client sshd[14415]: Received disconnect from 192.168.202.28 port 54248:11: disconnected by user Nov 18 18:11:48 oleg228-client sshd[14415]: Disconnected from user root 192.168.202.28 port 54248 Nov 18 18:11:48 oleg228-client sshd[14402]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:48 oleg228-client systemd[1]: session-42.scope: Succeeded. Nov 18 18:11:48 oleg228-client systemd-logind[1015]: Session 42 logged out. Waiting for processes to exit. Nov 18 18:11:48 oleg228-client systemd-logind[1015]: Removed session 42. Nov 18 18:11:49 oleg228-client sshd[14548]: Accepted publickey for root from 192.168.202.28 port 54258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:49 oleg228-client systemd[1]: Started Session 43 of user root. Nov 18 18:11:49 oleg228-client systemd-logind[1015]: New session 43 of user root. Nov 18 18:11:49 oleg228-client sshd[14548]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:50 oleg228-client sshd[14561]: Received disconnect from 192.168.202.28 port 54258:11: disconnected by user Nov 18 18:11:50 oleg228-client sshd[14561]: Disconnected from user root 192.168.202.28 port 54258 Nov 18 18:11:50 oleg228-client sshd[14548]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:50 oleg228-client systemd-logind[1015]: Session 43 logged out. Waiting for processes to exit. Nov 18 18:11:50 oleg228-client systemd[1]: session-43.scope: Succeeded. Nov 18 18:11:50 oleg228-client systemd-logind[1015]: Removed session 43. Nov 18 18:11:51 oleg228-client sshd[14704]: Accepted publickey for root from 192.168.202.28 port 42656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:11:51 oleg228-client systemd-logind[1015]: New session 44 of user root. Nov 18 18:11:51 oleg228-client systemd[1]: Started Session 44 of user root. Nov 18 18:11:51 oleg228-client sshd[14704]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:11:52 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10a: finish request on server after client eviction (bug 1521) ========================================================== 18:11:50 (1763507510) Nov 18 18:11:52 oleg228-client sshd[14717]: Received disconnect from 192.168.202.28 port 42656:11: disconnected by user Nov 18 18:11:52 oleg228-client sshd[14717]: Disconnected from user root 192.168.202.28 port 42656 Nov 18 18:11:52 oleg228-client sshd[14704]: pam_unix(sshd:session): session closed for user root Nov 18 18:11:52 oleg228-client systemd-logind[1015]: Session 44 logged out. Waiting for processes to exit. Nov 18 18:11:52 oleg228-client systemd[1]: session-44.scope: Succeeded. Nov 18 18:11:52 oleg228-client systemd-logind[1015]: Removed session 44. Nov 18 18:11:53 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:11:55 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:09 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:11 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:12 oleg228-client kernel: Lustre: lustre-OST0001-osc-ffff9ccbc80e3800: disconnect after 23s idle Nov 18 18:12:25 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:27 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:41 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:43 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:12:57 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:00 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:13 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:15 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:29 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:31 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:13:45 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e3800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:13:45 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:13:45 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:13:45 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e3800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 18:13:45 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:13:45 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:13:49 oleg228-client sshd[14960]: Accepted publickey for root from 192.168.202.28 port 55866 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:13:49 oleg228-client systemd[1]: Started Session 45 of user root. Nov 18 18:13:49 oleg228-client systemd-logind[1015]: New session 45 of user root. Nov 18 18:13:49 oleg228-client sshd[14960]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:13:49 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc80e3800: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:13:49 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc80e3800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:13:49 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc80e3800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:13:49 oleg228-client sshd[14973]: Received disconnect from 192.168.202.28 port 55866:11: disconnected by user Nov 18 18:13:49 oleg228-client sshd[14973]: Disconnected from user root 192.168.202.28 port 55866 Nov 18 18:13:49 oleg228-client sshd[14960]: pam_unix(sshd:session): session closed for user root Nov 18 18:13:50 oleg228-client systemd[1]: session-45.scope: Succeeded. Nov 18 18:13:50 oleg228-client systemd-logind[1015]: Session 45 logged out. Waiting for processes to exit. Nov 18 18:13:50 oleg228-client systemd-logind[1015]: Removed session 45. Nov 18 18:13:51 oleg228-client sshd[15101]: Accepted publickey for root from 192.168.202.28 port 45178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:13:51 oleg228-client systemd[1]: Started Session 46 of user root. Nov 18 18:13:51 oleg228-client systemd-logind[1015]: New session 46 of user root. Nov 18 18:13:51 oleg228-client sshd[15101]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:13:51 oleg228-client sshd[15114]: Received disconnect from 192.168.202.28 port 45178:11: disconnected by user Nov 18 18:13:51 oleg228-client sshd[15114]: Disconnected from user root 192.168.202.28 port 45178 Nov 18 18:13:51 oleg228-client sshd[15101]: pam_unix(sshd:session): session closed for user root Nov 18 18:13:51 oleg228-client systemd[1]: session-46.scope: Succeeded. Nov 18 18:13:51 oleg228-client systemd-logind[1015]: Session 46 logged out. Waiting for processes to exit. Nov 18 18:13:51 oleg228-client systemd-logind[1015]: Removed session 46. Nov 18 18:13:52 oleg228-client sshd[15247]: Accepted publickey for root from 192.168.202.28 port 45184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:13:52 oleg228-client systemd-logind[1015]: New session 47 of user root. Nov 18 18:13:52 oleg228-client systemd[1]: Started Session 47 of user root. Nov 18 18:13:52 oleg228-client sshd[15247]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:13:53 oleg228-client sshd[15260]: Received disconnect from 192.168.202.28 port 45184:11: disconnected by user Nov 18 18:13:53 oleg228-client sshd[15260]: Disconnected from user root 192.168.202.28 port 45184 Nov 18 18:13:53 oleg228-client sshd[15247]: pam_unix(sshd:session): session closed for user root Nov 18 18:13:53 oleg228-client systemd-logind[1015]: Session 47 logged out. Waiting for processes to exit. Nov 18 18:13:53 oleg228-client systemd[1]: session-47.scope: Succeeded. Nov 18 18:13:53 oleg228-client systemd-logind[1015]: Removed session 47. Nov 18 18:13:54 oleg228-client sshd[15403]: Accepted publickey for root from 192.168.202.28 port 45188 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:13:54 oleg228-client systemd-logind[1015]: New session 48 of user root. Nov 18 18:13:54 oleg228-client systemd[1]: Started Session 48 of user root. Nov 18 18:13:54 oleg228-client sshd[15403]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:13:55 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10b: re-send BL AST =============== 18:13:53 (1763507633) Nov 18 18:13:55 oleg228-client sshd[15416]: Received disconnect from 192.168.202.28 port 45188:11: disconnected by user Nov 18 18:13:55 oleg228-client sshd[15416]: Disconnected from user root 192.168.202.28 port 45188 Nov 18 18:13:55 oleg228-client sshd[15403]: pam_unix(sshd:session): session closed for user root Nov 18 18:13:55 oleg228-client systemd-logind[1015]: Session 48 logged out. Waiting for processes to exit. Nov 18 18:13:55 oleg228-client systemd[1]: session-48.scope: Succeeded. Nov 18 18:13:55 oleg228-client systemd-logind[1015]: Removed session 48. Nov 18 18:14:10 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc80e3800: disconnect after 21s idle Nov 18 18:14:13 oleg228-client sshd[15612]: Accepted publickey for root from 192.168.202.28 port 40072 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:13 oleg228-client systemd-logind[1015]: New session 49 of user root. Nov 18 18:14:13 oleg228-client systemd[1]: Started Session 49 of user root. Nov 18 18:14:13 oleg228-client sshd[15612]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:13 oleg228-client sshd[15625]: Received disconnect from 192.168.202.28 port 40072:11: disconnected by user Nov 18 18:14:13 oleg228-client sshd[15625]: Disconnected from user root 192.168.202.28 port 40072 Nov 18 18:14:13 oleg228-client sshd[15612]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:13 oleg228-client systemd[1]: session-49.scope: Succeeded. Nov 18 18:14:13 oleg228-client systemd-logind[1015]: Session 49 logged out. Waiting for processes to exit. Nov 18 18:14:13 oleg228-client systemd-logind[1015]: Removed session 49. Nov 18 18:14:14 oleg228-client sshd[15751]: Accepted publickey for root from 192.168.202.28 port 40086 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:14 oleg228-client systemd[1]: Started Session 50 of user root. Nov 18 18:14:14 oleg228-client sshd[15751]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:14 oleg228-client systemd-logind[1015]: New session 50 of user root. Nov 18 18:14:15 oleg228-client sshd[15764]: Received disconnect from 192.168.202.28 port 40086:11: disconnected by user Nov 18 18:14:15 oleg228-client sshd[15764]: Disconnected from user root 192.168.202.28 port 40086 Nov 18 18:14:15 oleg228-client sshd[15751]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:15 oleg228-client systemd[1]: session-50.scope: Succeeded. Nov 18 18:14:15 oleg228-client systemd-logind[1015]: Session 50 logged out. Waiting for processes to exit. Nov 18 18:14:15 oleg228-client systemd-logind[1015]: Removed session 50. Nov 18 18:14:16 oleg228-client sshd[15898]: Accepted publickey for root from 192.168.202.28 port 40090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:16 oleg228-client systemd-logind[1015]: New session 51 of user root. Nov 18 18:14:16 oleg228-client systemd[1]: Started Session 51 of user root. Nov 18 18:14:16 oleg228-client sshd[15898]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:16 oleg228-client sshd[15911]: Received disconnect from 192.168.202.28 port 40090:11: disconnected by user Nov 18 18:14:16 oleg228-client sshd[15911]: Disconnected from user root 192.168.202.28 port 40090 Nov 18 18:14:16 oleg228-client sshd[15898]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:16 oleg228-client systemd-logind[1015]: Session 51 logged out. Waiting for processes to exit. Nov 18 18:14:16 oleg228-client systemd[1]: session-51.scope: Succeeded. Nov 18 18:14:16 oleg228-client systemd-logind[1015]: Removed session 51. Nov 18 18:14:17 oleg228-client sshd[16053]: Accepted publickey for root from 192.168.202.28 port 40100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:17 oleg228-client systemd-logind[1015]: New session 52 of user root. Nov 18 18:14:17 oleg228-client systemd[1]: Started Session 52 of user root. Nov 18 18:14:17 oleg228-client sshd[16053]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:17 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10c: re-send BL AST vs reconnect race (LU-5569) ========================================================== 18:14:17 (1763507657) Nov 18 18:14:17 oleg228-client sshd[16066]: Received disconnect from 192.168.202.28 port 40100:11: disconnected by user Nov 18 18:14:17 oleg228-client sshd[16066]: Disconnected from user root 192.168.202.28 port 40100 Nov 18 18:14:18 oleg228-client sshd[16053]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:18 oleg228-client systemd-logind[1015]: Session 52 logged out. Waiting for processes to exit. Nov 18 18:14:18 oleg228-client systemd[1]: session-52.scope: Succeeded. Nov 18 18:14:18 oleg228-client systemd-logind[1015]: Removed session 52. Nov 18 18:14:20 oleg228-client sshd[16255]: Accepted publickey for root from 192.168.202.28 port 40108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:20 oleg228-client systemd-logind[1015]: New session 53 of user root. Nov 18 18:14:20 oleg228-client systemd[1]: Started Session 53 of user root. Nov 18 18:14:20 oleg228-client sshd[16255]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:20 oleg228-client sshd[16268]: Received disconnect from 192.168.202.28 port 40108:11: disconnected by user Nov 18 18:14:20 oleg228-client sshd[16268]: Disconnected from user root 192.168.202.28 port 40108 Nov 18 18:14:20 oleg228-client sshd[16255]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:20 oleg228-client systemd[1]: session-53.scope: Succeeded. Nov 18 18:14:20 oleg228-client systemd-logind[1015]: Session 53 logged out. Waiting for processes to exit. Nov 18 18:14:20 oleg228-client systemd-logind[1015]: Removed session 53. Nov 18 18:14:21 oleg228-client sshd[16394]: Accepted publickey for root from 192.168.202.28 port 53420 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:21 oleg228-client systemd-logind[1015]: New session 54 of user root. Nov 18 18:14:21 oleg228-client systemd[1]: Started Session 54 of user root. Nov 18 18:14:21 oleg228-client sshd[16394]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:22 oleg228-client sshd[16407]: Received disconnect from 192.168.202.28 port 53420:11: disconnected by user Nov 18 18:14:22 oleg228-client sshd[16407]: Disconnected from user root 192.168.202.28 port 53420 Nov 18 18:14:22 oleg228-client sshd[16394]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:22 oleg228-client systemd[1]: session-54.scope: Succeeded. Nov 18 18:14:22 oleg228-client systemd-logind[1015]: Session 54 logged out. Waiting for processes to exit. Nov 18 18:14:22 oleg228-client systemd-logind[1015]: Removed session 54. Nov 18 18:14:23 oleg228-client sshd[16541]: Accepted publickey for root from 192.168.202.28 port 53430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:23 oleg228-client systemd-logind[1015]: New session 55 of user root. Nov 18 18:14:23 oleg228-client systemd[1]: Started Session 55 of user root. Nov 18 18:14:23 oleg228-client sshd[16541]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:23 oleg228-client sshd[16554]: Received disconnect from 192.168.202.28 port 53430:11: disconnected by user Nov 18 18:14:23 oleg228-client sshd[16554]: Disconnected from user root 192.168.202.28 port 53430 Nov 18 18:14:23 oleg228-client sshd[16541]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:23 oleg228-client systemd[1]: session-55.scope: Succeeded. Nov 18 18:14:23 oleg228-client systemd-logind[1015]: Session 55 logged out. Waiting for processes to exit. Nov 18 18:14:23 oleg228-client systemd-logind[1015]: Removed session 55. Nov 18 18:14:24 oleg228-client sshd[16697]: Accepted publickey for root from 192.168.202.28 port 53438 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:24 oleg228-client systemd-logind[1015]: New session 56 of user root. Nov 18 18:14:24 oleg228-client systemd[1]: Started Session 56 of user root. Nov 18 18:14:24 oleg228-client sshd[16697]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:24 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10d: test failed blocking ast ===== 18:14:23 (1763507663) Nov 18 18:14:24 oleg228-client sshd[16710]: Received disconnect from 192.168.202.28 port 53438:11: disconnected by user Nov 18 18:14:24 oleg228-client sshd[16710]: Disconnected from user root 192.168.202.28 port 53438 Nov 18 18:14:24 oleg228-client sshd[16697]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:24 oleg228-client systemd[1]: session-56.scope: Succeeded. Nov 18 18:14:24 oleg228-client systemd-logind[1015]: Session 56 logged out. Waiting for processes to exit. Nov 18 18:14:24 oleg228-client systemd-logind[1015]: Removed session 56. Nov 18 18:14:27 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 18:14:27 oleg228-client kernel: LustreError: 16770:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc80e3800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 18:14:27 oleg228-client kernel: LustreError: 16770:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 18:14:27 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 18:14:27 oleg228-client systemd-udevd[16814]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:14:27 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 18:14:27 oleg228-client systemd-udevd[16858]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:14:29 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:14:29 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:14:29 oleg228-client kernel: Lustre: 2406:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.128@tcp:/lustre/fid: [0x200000404:0x1:0x0]/ may get corrupted (rc -108) Nov 18 18:14:30 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 18:14:30 oleg228-client kernel: LustreError: 16974:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc8b5c000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 18:14:30 oleg228-client kernel: LustreError: 16974:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 18:14:30 oleg228-client kernel: LustreError: 16974:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 18:14:30 oleg228-client kernel: LustreError: 16974:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages Nov 18 18:14:30 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 18:14:31 oleg228-client sshd[17062]: Accepted publickey for root from 192.168.202.28 port 45426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:31 oleg228-client systemd-logind[1015]: New session 57 of user root. Nov 18 18:14:31 oleg228-client systemd[1]: Started Session 57 of user root. Nov 18 18:14:31 oleg228-client sshd[17062]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:32 oleg228-client sshd[17075]: Received disconnect from 192.168.202.28 port 45426:11: disconnected by user Nov 18 18:14:32 oleg228-client sshd[17075]: Disconnected from user root 192.168.202.28 port 45426 Nov 18 18:14:32 oleg228-client sshd[17062]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:32 oleg228-client systemd-logind[1015]: Session 57 logged out. Waiting for processes to exit. Nov 18 18:14:32 oleg228-client systemd[1]: session-57.scope: Succeeded. Nov 18 18:14:32 oleg228-client systemd-logind[1015]: Removed session 57. Nov 18 18:14:32 oleg228-client sshd[17201]: Accepted publickey for root from 192.168.202.28 port 45432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:32 oleg228-client systemd-logind[1015]: New session 58 of user root. Nov 18 18:14:32 oleg228-client systemd[1]: Started Session 58 of user root. Nov 18 18:14:32 oleg228-client sshd[17201]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:33 oleg228-client sshd[17214]: Received disconnect from 192.168.202.28 port 45432:11: disconnected by user Nov 18 18:14:33 oleg228-client sshd[17214]: Disconnected from user root 192.168.202.28 port 45432 Nov 18 18:14:33 oleg228-client sshd[17201]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:33 oleg228-client systemd-logind[1015]: Session 58 logged out. Waiting for processes to exit. Nov 18 18:14:33 oleg228-client systemd[1]: session-58.scope: Succeeded. Nov 18 18:14:33 oleg228-client systemd-logind[1015]: Removed session 58. Nov 18 18:14:34 oleg228-client sshd[17347]: Accepted publickey for root from 192.168.202.28 port 45440 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:34 oleg228-client systemd[1]: Started Session 59 of user root. Nov 18 18:14:34 oleg228-client systemd-logind[1015]: New session 59 of user root. Nov 18 18:14:34 oleg228-client sshd[17347]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:34 oleg228-client sshd[17360]: Received disconnect from 192.168.202.28 port 45440:11: disconnected by user Nov 18 18:14:34 oleg228-client sshd[17360]: Disconnected from user root 192.168.202.28 port 45440 Nov 18 18:14:34 oleg228-client sshd[17347]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:34 oleg228-client systemd-logind[1015]: Session 59 logged out. Waiting for processes to exit. Nov 18 18:14:34 oleg228-client systemd[1]: session-59.scope: Succeeded. Nov 18 18:14:34 oleg228-client systemd-logind[1015]: Removed session 59. Nov 18 18:14:35 oleg228-client sshd[17502]: Accepted publickey for root from 192.168.202.28 port 45448 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:36 oleg228-client systemd[1]: Started Session 60 of user root. Nov 18 18:14:36 oleg228-client systemd-logind[1015]: New session 60 of user root. Nov 18 18:14:36 oleg228-client sshd[17502]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:36 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 10e: re-send BL AST vs reconnect race 2 ========================================================== 18:14:35 (1763507675) Nov 18 18:14:36 oleg228-client sshd[17515]: Received disconnect from 192.168.202.28 port 45448:11: disconnected by user Nov 18 18:14:36 oleg228-client sshd[17515]: Disconnected from user root 192.168.202.28 port 45448 Nov 18 18:14:36 oleg228-client sshd[17502]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:36 oleg228-client systemd[1]: session-60.scope: Succeeded. Nov 18 18:14:36 oleg228-client systemd-logind[1015]: Session 60 logged out. Waiting for processes to exit. Nov 18 18:14:36 oleg228-client systemd-logind[1015]: Removed session 60. Nov 18 18:14:37 oleg228-client sshd[17643]: Accepted publickey for root from 192.168.202.28 port 45452 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:37 oleg228-client systemd-logind[1015]: New session 61 of user root. Nov 18 18:14:37 oleg228-client systemd[1]: Started Session 61 of user root. Nov 18 18:14:37 oleg228-client sshd[17643]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:37 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_10e need two clients Nov 18 18:14:37 oleg228-client sshd[17656]: Received disconnect from 192.168.202.28 port 45452:11: disconnected by user Nov 18 18:14:37 oleg228-client sshd[17656]: Disconnected from user root 192.168.202.28 port 45452 Nov 18 18:14:37 oleg228-client sshd[17643]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:37 oleg228-client systemd[1]: session-61.scope: Succeeded. Nov 18 18:14:37 oleg228-client systemd-logind[1015]: Session 61 logged out. Waiting for processes to exit. Nov 18 18:14:38 oleg228-client systemd-logind[1015]: Removed session 61. Nov 18 18:14:39 oleg228-client sshd[17798]: Accepted publickey for root from 192.168.202.28 port 45468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:39 oleg228-client systemd-logind[1015]: New session 62 of user root. Nov 18 18:14:39 oleg228-client systemd[1]: Started Session 62 of user root. Nov 18 18:14:39 oleg228-client sshd[17798]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:39 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 11: wake up a thread waiting for completion after eviction (b=2460) ========================================================== 18:14:38 (1763507678) Nov 18 18:14:39 oleg228-client sshd[17811]: Received disconnect from 192.168.202.28 port 45468:11: disconnected by user Nov 18 18:14:39 oleg228-client sshd[17811]: Disconnected from user root 192.168.202.28 port 45468 Nov 18 18:14:39 oleg228-client sshd[17798]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:39 oleg228-client systemd[1]: session-62.scope: Succeeded. Nov 18 18:14:39 oleg228-client systemd-logind[1015]: Session 62 logged out. Waiting for processes to exit. Nov 18 18:14:39 oleg228-client systemd-logind[1015]: Removed session 62. Nov 18 18:14:58 oleg228-client sshd[17920]: Accepted publickey for root from 192.168.202.28 port 55242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:58 oleg228-client systemd-logind[1015]: New session 63 of user root. Nov 18 18:14:58 oleg228-client systemd[1]: Started Session 63 of user root. Nov 18 18:14:58 oleg228-client sshd[17920]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:58 oleg228-client sshd[17933]: Received disconnect from 192.168.202.28 port 55242:11: disconnected by user Nov 18 18:14:58 oleg228-client sshd[17933]: Disconnected from user root 192.168.202.28 port 55242 Nov 18 18:14:58 oleg228-client sshd[17920]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:58 oleg228-client systemd-logind[1015]: Session 63 logged out. Waiting for processes to exit. Nov 18 18:14:58 oleg228-client systemd[1]: session-63.scope: Succeeded. Nov 18 18:14:58 oleg228-client systemd-logind[1015]: Removed session 63. Nov 18 18:14:59 oleg228-client sshd[18052]: Accepted publickey for root from 192.168.202.28 port 55258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:14:59 oleg228-client systemd-logind[1015]: New session 64 of user root. Nov 18 18:14:59 oleg228-client systemd[1]: Started Session 64 of user root. Nov 18 18:14:59 oleg228-client sshd[18052]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:14:59 oleg228-client sshd[18065]: Received disconnect from 192.168.202.28 port 55258:11: disconnected by user Nov 18 18:14:59 oleg228-client sshd[18065]: Disconnected from user root 192.168.202.28 port 55258 Nov 18 18:14:59 oleg228-client sshd[18052]: pam_unix(sshd:session): session closed for user root Nov 18 18:14:59 oleg228-client systemd[1]: session-64.scope: Succeeded. Nov 18 18:14:59 oleg228-client systemd-logind[1015]: Session 64 logged out. Waiting for processes to exit. Nov 18 18:14:59 oleg228-client systemd-logind[1015]: Removed session 64. Nov 18 18:15:01 oleg228-client sshd[18191]: Accepted publickey for root from 192.168.202.28 port 43756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:01 oleg228-client systemd[1]: Started Session 65 of user root. Nov 18 18:15:01 oleg228-client systemd-logind[1015]: New session 65 of user root. Nov 18 18:15:01 oleg228-client sshd[18191]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:01 oleg228-client sshd[18204]: Received disconnect from 192.168.202.28 port 43756:11: disconnected by user Nov 18 18:15:01 oleg228-client sshd[18204]: Disconnected from user root 192.168.202.28 port 43756 Nov 18 18:15:01 oleg228-client sshd[18191]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:01 oleg228-client systemd-logind[1015]: Session 65 logged out. Waiting for processes to exit. Nov 18 18:15:01 oleg228-client systemd[1]: session-65.scope: Succeeded. Nov 18 18:15:01 oleg228-client systemd-logind[1015]: Removed session 65. Nov 18 18:15:02 oleg228-client sshd[18337]: Accepted publickey for root from 192.168.202.28 port 43764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:02 oleg228-client systemd-logind[1015]: New session 66 of user root. Nov 18 18:15:02 oleg228-client systemd[1]: Started Session 66 of user root. Nov 18 18:15:02 oleg228-client sshd[18337]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:02 oleg228-client sshd[18350]: Received disconnect from 192.168.202.28 port 43764:11: disconnected by user Nov 18 18:15:02 oleg228-client sshd[18350]: Disconnected from user root 192.168.202.28 port 43764 Nov 18 18:15:02 oleg228-client sshd[18337]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:02 oleg228-client systemd[1]: session-66.scope: Succeeded. Nov 18 18:15:02 oleg228-client systemd-logind[1015]: Session 66 logged out. Waiting for processes to exit. Nov 18 18:15:02 oleg228-client systemd-logind[1015]: Removed session 66. Nov 18 18:15:03 oleg228-client sshd[18492]: Accepted publickey for root from 192.168.202.28 port 43776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:03 oleg228-client systemd-logind[1015]: New session 67 of user root. Nov 18 18:15:03 oleg228-client systemd[1]: Started Session 67 of user root. Nov 18 18:15:03 oleg228-client sshd[18492]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:03 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 12: recover from timed out resend in ptlrpcd (b=2494) ========================================================== 18:15:02 (1763507702) Nov 18 18:15:03 oleg228-client sshd[18505]: Received disconnect from 192.168.202.28 port 43776:11: disconnected by user Nov 18 18:15:03 oleg228-client sshd[18505]: Disconnected from user root 192.168.202.28 port 43776 Nov 18 18:15:03 oleg228-client kernel: Lustre: DEBUG MARKER: multiop /mnt/lustre/f12.recovery-small OS_c Nov 18 18:15:03 oleg228-client sshd[18492]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:04 oleg228-client systemd[1]: session-67.scope: Succeeded. Nov 18 18:15:04 oleg228-client systemd-logind[1015]: Session 67 logged out. Waiting for processes to exit. Nov 18 18:15:04 oleg228-client systemd-logind[1015]: Removed session 67. Nov 18 18:15:20 oleg228-client kernel: Lustre: 18553:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507704/real 1763507704] req@ffff9ccbc4f78700 x1849171034373504/t0(0) o35->lustre-MDT0000-mdc-ffff9ccbc551f800@192.168.202.128@tcp:23/10 lens 392/624 e 0 to 1 dl 1763507720 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 Nov 18 18:15:20 oleg228-client kernel: Lustre: 18553:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message Nov 18 18:15:22 oleg228-client sshd[18570]: Accepted publickey for root from 192.168.202.28 port 59680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:22 oleg228-client systemd-logind[1015]: New session 68 of user root. Nov 18 18:15:22 oleg228-client systemd[1]: Started Session 68 of user root. Nov 18 18:15:22 oleg228-client sshd[18570]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:23 oleg228-client sshd[18584]: Received disconnect from 192.168.202.28 port 59680:11: disconnected by user Nov 18 18:15:23 oleg228-client sshd[18584]: Disconnected from user root 192.168.202.28 port 59680 Nov 18 18:15:23 oleg228-client sshd[18570]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:23 oleg228-client systemd[1]: session-68.scope: Succeeded. Nov 18 18:15:23 oleg228-client systemd-logind[1015]: Session 68 logged out. Waiting for processes to exit. Nov 18 18:15:23 oleg228-client systemd-logind[1015]: Removed session 68. Nov 18 18:15:24 oleg228-client sshd[18703]: Accepted publickey for root from 192.168.202.28 port 59686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:24 oleg228-client systemd-logind[1015]: New session 69 of user root. Nov 18 18:15:24 oleg228-client systemd[1]: Started Session 69 of user root. Nov 18 18:15:24 oleg228-client sshd[18703]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:24 oleg228-client sshd[18716]: Received disconnect from 192.168.202.28 port 59686:11: disconnected by user Nov 18 18:15:24 oleg228-client sshd[18716]: Disconnected from user root 192.168.202.28 port 59686 Nov 18 18:15:24 oleg228-client sshd[18703]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:24 oleg228-client systemd[1]: session-69.scope: Succeeded. Nov 18 18:15:24 oleg228-client systemd-logind[1015]: Session 69 logged out. Waiting for processes to exit. Nov 18 18:15:24 oleg228-client systemd-logind[1015]: Removed session 69. Nov 18 18:15:26 oleg228-client sshd[18842]: Accepted publickey for root from 192.168.202.28 port 59696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:26 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:15:26 oleg228-client systemd[1]: Started Session 70 of user root. Nov 18 18:15:26 oleg228-client systemd-logind[1015]: New session 70 of user root. Nov 18 18:15:26 oleg228-client sshd[18842]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:27 oleg228-client sshd[18856]: Received disconnect from 192.168.202.28 port 59696:11: disconnected by user Nov 18 18:15:27 oleg228-client sshd[18856]: Disconnected from user root 192.168.202.28 port 59696 Nov 18 18:15:27 oleg228-client sshd[18842]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:27 oleg228-client systemd[1]: session-70.scope: Succeeded. Nov 18 18:15:27 oleg228-client systemd-logind[1015]: Session 70 logged out. Waiting for processes to exit. Nov 18 18:15:27 oleg228-client systemd-logind[1015]: Removed session 70. Nov 18 18:15:29 oleg228-client sshd[18989]: Accepted publickey for root from 192.168.202.28 port 59706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:29 oleg228-client systemd[1]: Started Session 71 of user root. Nov 18 18:15:29 oleg228-client systemd-logind[1015]: New session 71 of user root. Nov 18 18:15:29 oleg228-client sshd[18989]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:29 oleg228-client sshd[19002]: Received disconnect from 192.168.202.28 port 59706:11: disconnected by user Nov 18 18:15:29 oleg228-client sshd[19002]: Disconnected from user root 192.168.202.28 port 59706 Nov 18 18:15:29 oleg228-client sshd[18989]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:29 oleg228-client systemd-logind[1015]: Session 71 logged out. Waiting for processes to exit. Nov 18 18:15:29 oleg228-client systemd[1]: session-71.scope: Succeeded. Nov 18 18:15:29 oleg228-client systemd-logind[1015]: Removed session 71. Nov 18 18:15:47 oleg228-client sshd[19156]: Accepted publickey for root from 192.168.202.28 port 36522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:15:47 oleg228-client systemd-logind[1015]: New session 72 of user root. Nov 18 18:15:47 oleg228-client systemd[1]: Started Session 72 of user root. Nov 18 18:15:47 oleg228-client sshd[19156]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:15:47 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 13: mdc_readpage restart test (bug 1138) ========================================================== 18:15:46 (1763507746) Nov 18 18:15:47 oleg228-client sshd[19169]: Received disconnect from 192.168.202.28 port 36522:11: disconnected by user Nov 18 18:15:47 oleg228-client sshd[19169]: Disconnected from user root 192.168.202.28 port 36522 Nov 18 18:15:47 oleg228-client sshd[19156]: pam_unix(sshd:session): session closed for user root Nov 18 18:15:48 oleg228-client systemd[1]: session-72.scope: Succeeded. Nov 18 18:15:48 oleg228-client systemd-logind[1015]: Session 72 logged out. Waiting for processes to exit. Nov 18 18:15:48 oleg228-client systemd-logind[1015]: Removed session 72. Nov 18 18:16:06 oleg228-client sshd[19314]: Accepted publickey for root from 192.168.202.28 port 57118 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:06 oleg228-client systemd[1]: Started Session 73 of user root. Nov 18 18:16:06 oleg228-client systemd-logind[1015]: New session 73 of user root. Nov 18 18:16:06 oleg228-client sshd[19314]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:06 oleg228-client sshd[19327]: Received disconnect from 192.168.202.28 port 57118:11: disconnected by user Nov 18 18:16:06 oleg228-client sshd[19327]: Disconnected from user root 192.168.202.28 port 57118 Nov 18 18:16:06 oleg228-client sshd[19314]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:06 oleg228-client systemd-logind[1015]: Session 73 logged out. Waiting for processes to exit. Nov 18 18:16:06 oleg228-client systemd[1]: session-73.scope: Succeeded. Nov 18 18:16:06 oleg228-client systemd-logind[1015]: Removed session 73. Nov 18 18:16:07 oleg228-client sshd[19453]: Accepted publickey for root from 192.168.202.28 port 57128 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:07 oleg228-client systemd-logind[1015]: New session 74 of user root. Nov 18 18:16:07 oleg228-client systemd[1]: Started Session 74 of user root. Nov 18 18:16:07 oleg228-client sshd[19453]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:07 oleg228-client sshd[19466]: Received disconnect from 192.168.202.28 port 57128:11: disconnected by user Nov 18 18:16:07 oleg228-client sshd[19466]: Disconnected from user root 192.168.202.28 port 57128 Nov 18 18:16:07 oleg228-client sshd[19453]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:08 oleg228-client systemd[1]: Starting Cleanup of Temporary Directories... Nov 18 18:16:08 oleg228-client systemd[1]: session-74.scope: Succeeded. Nov 18 18:16:08 oleg228-client systemd-logind[1015]: Session 74 logged out. Waiting for processes to exit. Nov 18 18:16:08 oleg228-client systemd-logind[1015]: Removed session 74. Nov 18 18:16:08 oleg228-client systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 18 18:16:08 oleg228-client systemd[1]: Started Cleanup of Temporary Directories. Nov 18 18:16:08 oleg228-client sshd[19601]: Accepted publickey for root from 192.168.202.28 port 57132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:09 oleg228-client systemd-logind[1015]: New session 75 of user root. Nov 18 18:16:09 oleg228-client systemd[1]: Started Session 75 of user root. Nov 18 18:16:09 oleg228-client sshd[19601]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:09 oleg228-client sshd[19614]: Received disconnect from 192.168.202.28 port 57132:11: disconnected by user Nov 18 18:16:09 oleg228-client sshd[19614]: Disconnected from user root 192.168.202.28 port 57132 Nov 18 18:16:09 oleg228-client sshd[19601]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:09 oleg228-client systemd-logind[1015]: Session 75 logged out. Waiting for processes to exit. Nov 18 18:16:09 oleg228-client systemd[1]: session-75.scope: Succeeded. Nov 18 18:16:09 oleg228-client systemd-logind[1015]: Removed session 75. Nov 18 18:16:10 oleg228-client sshd[19756]: Accepted publickey for root from 192.168.202.28 port 57148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:10 oleg228-client systemd-logind[1015]: New session 76 of user root. Nov 18 18:16:10 oleg228-client systemd[1]: Started Session 76 of user root. Nov 18 18:16:10 oleg228-client sshd[19756]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:10 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 14: mdc_readpage resend test (bug 1138) ========================================================== 18:16:09 (1763507769) Nov 18 18:16:10 oleg228-client sshd[19769]: Received disconnect from 192.168.202.28 port 57148:11: disconnected by user Nov 18 18:16:10 oleg228-client sshd[19769]: Disconnected from user root 192.168.202.28 port 57148 Nov 18 18:16:10 oleg228-client sshd[19756]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:10 oleg228-client systemd[1]: session-76.scope: Succeeded. Nov 18 18:16:10 oleg228-client systemd-logind[1015]: Session 76 logged out. Waiting for processes to exit. Nov 18 18:16:10 oleg228-client systemd-logind[1015]: Removed session 76. Nov 18 18:16:13 oleg228-client sshd[19910]: Accepted publickey for root from 192.168.202.28 port 34426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:13 oleg228-client systemd-logind[1015]: New session 77 of user root. Nov 18 18:16:13 oleg228-client systemd[1]: Started Session 77 of user root. Nov 18 18:16:13 oleg228-client sshd[19910]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:14 oleg228-client sshd[19923]: Received disconnect from 192.168.202.28 port 34426:11: disconnected by user Nov 18 18:16:14 oleg228-client sshd[19923]: Disconnected from user root 192.168.202.28 port 34426 Nov 18 18:16:14 oleg228-client sshd[19910]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:14 oleg228-client systemd[1]: session-77.scope: Succeeded. Nov 18 18:16:14 oleg228-client systemd-logind[1015]: Session 77 logged out. Waiting for processes to exit. Nov 18 18:16:14 oleg228-client systemd-logind[1015]: Removed session 77. Nov 18 18:16:14 oleg228-client sshd[20049]: Accepted publickey for root from 192.168.202.28 port 34428 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:14 oleg228-client systemd[1]: Started Session 78 of user root. Nov 18 18:16:14 oleg228-client systemd-logind[1015]: New session 78 of user root. Nov 18 18:16:14 oleg228-client sshd[20049]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:15 oleg228-client sshd[20062]: Received disconnect from 192.168.202.28 port 34428:11: disconnected by user Nov 18 18:16:15 oleg228-client sshd[20062]: Disconnected from user root 192.168.202.28 port 34428 Nov 18 18:16:15 oleg228-client sshd[20049]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:15 oleg228-client systemd-logind[1015]: Session 78 logged out. Waiting for processes to exit. Nov 18 18:16:15 oleg228-client systemd[1]: session-78.scope: Succeeded. Nov 18 18:16:15 oleg228-client systemd-logind[1015]: Removed session 78. Nov 18 18:16:16 oleg228-client sshd[20195]: Accepted publickey for root from 192.168.202.28 port 34442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:16 oleg228-client systemd-logind[1015]: New session 79 of user root. Nov 18 18:16:16 oleg228-client systemd[1]: Started Session 79 of user root. Nov 18 18:16:16 oleg228-client sshd[20195]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:16 oleg228-client sshd[20208]: Received disconnect from 192.168.202.28 port 34442:11: disconnected by user Nov 18 18:16:16 oleg228-client sshd[20208]: Disconnected from user root 192.168.202.28 port 34442 Nov 18 18:16:16 oleg228-client sshd[20195]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:16 oleg228-client systemd[1]: session-79.scope: Succeeded. Nov 18 18:16:16 oleg228-client systemd-logind[1015]: Session 79 logged out. Waiting for processes to exit. Nov 18 18:16:16 oleg228-client systemd-logind[1015]: Removed session 79. Nov 18 18:16:17 oleg228-client sshd[20351]: Accepted publickey for root from 192.168.202.28 port 34456 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:17 oleg228-client systemd-logind[1015]: New session 80 of user root. Nov 18 18:16:17 oleg228-client systemd[1]: Started Session 80 of user root. Nov 18 18:16:17 oleg228-client sshd[20351]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:17 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 15: failed open (-ENOMEM) ========= 18:16:16 (1763507776) Nov 18 18:16:17 oleg228-client sshd[20364]: Received disconnect from 192.168.202.28 port 34456:11: disconnected by user Nov 18 18:16:17 oleg228-client sshd[20364]: Disconnected from user root 192.168.202.28 port 34456 Nov 18 18:16:17 oleg228-client sshd[20351]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:17 oleg228-client systemd[1]: session-80.scope: Succeeded. Nov 18 18:16:17 oleg228-client systemd-logind[1015]: Session 80 logged out. Waiting for processes to exit. Nov 18 18:16:18 oleg228-client systemd-logind[1015]: Removed session 80. Nov 18 18:16:19 oleg228-client sshd[20494]: Accepted publickey for root from 192.168.202.28 port 34472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:19 oleg228-client systemd-logind[1015]: New session 81 of user root. Nov 18 18:16:19 oleg228-client systemd[1]: Started Session 81 of user root. Nov 18 18:16:19 oleg228-client sshd[20494]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:19 oleg228-client sshd[20507]: Received disconnect from 192.168.202.28 port 34472:11: disconnected by user Nov 18 18:16:19 oleg228-client sshd[20507]: Disconnected from user root 192.168.202.28 port 34472 Nov 18 18:16:19 oleg228-client sshd[20494]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:19 oleg228-client systemd-logind[1015]: Session 81 logged out. Waiting for processes to exit. Nov 18 18:16:19 oleg228-client systemd[1]: session-81.scope: Succeeded. Nov 18 18:16:19 oleg228-client systemd-logind[1015]: Removed session 81. Nov 18 18:16:20 oleg228-client sshd[20633]: Accepted publickey for root from 192.168.202.28 port 34488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:20 oleg228-client systemd-logind[1015]: New session 82 of user root. Nov 18 18:16:20 oleg228-client systemd[1]: Started Session 82 of user root. Nov 18 18:16:20 oleg228-client sshd[20633]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:20 oleg228-client sshd[20646]: Received disconnect from 192.168.202.28 port 34488:11: disconnected by user Nov 18 18:16:20 oleg228-client sshd[20646]: Disconnected from user root 192.168.202.28 port 34488 Nov 18 18:16:20 oleg228-client sshd[20633]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:20 oleg228-client systemd-logind[1015]: Session 82 logged out. Waiting for processes to exit. Nov 18 18:16:20 oleg228-client systemd[1]: session-82.scope: Succeeded. Nov 18 18:16:20 oleg228-client systemd-logind[1015]: Removed session 82. Nov 18 18:16:21 oleg228-client sshd[20779]: Accepted publickey for root from 192.168.202.28 port 41178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:21 oleg228-client systemd-logind[1015]: New session 83 of user root. Nov 18 18:16:21 oleg228-client systemd[1]: Started Session 83 of user root. Nov 18 18:16:21 oleg228-client sshd[20779]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:21 oleg228-client sshd[20792]: Received disconnect from 192.168.202.28 port 41178:11: disconnected by user Nov 18 18:16:22 oleg228-client sshd[20792]: Disconnected from user root 192.168.202.28 port 41178 Nov 18 18:16:22 oleg228-client sshd[20779]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:22 oleg228-client systemd[1]: session-83.scope: Succeeded. Nov 18 18:16:22 oleg228-client systemd-logind[1015]: Session 83 logged out. Waiting for processes to exit. Nov 18 18:16:22 oleg228-client systemd-logind[1015]: Removed session 83. Nov 18 18:16:23 oleg228-client sshd[20937]: Accepted publickey for root from 192.168.202.28 port 41182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:16:23 oleg228-client systemd-logind[1015]: New session 84 of user root. Nov 18 18:16:23 oleg228-client systemd[1]: Started Session 84 of user root. Nov 18 18:16:23 oleg228-client sshd[20937]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:16:23 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 16: timeout bulk put, don't evict client (2732) ========================================================== 18:16:22 (1763507782) Nov 18 18:16:23 oleg228-client sshd[20950]: Received disconnect from 192.168.202.28 port 41182:11: disconnected by user Nov 18 18:16:23 oleg228-client sshd[20950]: Disconnected from user root 192.168.202.28 port 41182 Nov 18 18:16:23 oleg228-client sshd[20937]: pam_unix(sshd:session): session closed for user root Nov 18 18:16:23 oleg228-client systemd[1]: session-84.scope: Succeeded. Nov 18 18:16:23 oleg228-client systemd-logind[1015]: Session 84 logged out. Waiting for processes to exit. Nov 18 18:16:23 oleg228-client systemd-logind[1015]: Removed session 84. Nov 18 18:17:03 oleg228-client sshd[21159]: Accepted publickey for root from 192.168.202.28 port 36330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:03 oleg228-client systemd[1]: Started Session 85 of user root. Nov 18 18:17:03 oleg228-client systemd-logind[1015]: New session 85 of user root. Nov 18 18:17:03 oleg228-client sshd[21159]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:03 oleg228-client sshd[21172]: Received disconnect from 192.168.202.28 port 36330:11: disconnected by user Nov 18 18:17:03 oleg228-client sshd[21172]: Disconnected from user root 192.168.202.28 port 36330 Nov 18 18:17:03 oleg228-client sshd[21159]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:03 oleg228-client systemd[1]: session-85.scope: Succeeded. Nov 18 18:17:03 oleg228-client systemd-logind[1015]: Session 85 logged out. Waiting for processes to exit. Nov 18 18:17:03 oleg228-client systemd-logind[1015]: Removed session 85. Nov 18 18:17:04 oleg228-client sshd[21298]: Accepted publickey for root from 192.168.202.28 port 36338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:04 oleg228-client systemd[1]: Started Session 86 of user root. Nov 18 18:17:04 oleg228-client systemd-logind[1015]: New session 86 of user root. Nov 18 18:17:04 oleg228-client sshd[21298]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:05 oleg228-client sshd[21311]: Received disconnect from 192.168.202.28 port 36338:11: disconnected by user Nov 18 18:17:05 oleg228-client sshd[21311]: Disconnected from user root 192.168.202.28 port 36338 Nov 18 18:17:05 oleg228-client sshd[21298]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:05 oleg228-client systemd[1]: session-86.scope: Succeeded. Nov 18 18:17:05 oleg228-client systemd-logind[1015]: Session 86 logged out. Waiting for processes to exit. Nov 18 18:17:05 oleg228-client systemd-logind[1015]: Removed session 86. Nov 18 18:17:06 oleg228-client sshd[21445]: Accepted publickey for root from 192.168.202.28 port 36352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:06 oleg228-client systemd[1]: Started Session 87 of user root. Nov 18 18:17:06 oleg228-client systemd-logind[1015]: New session 87 of user root. Nov 18 18:17:06 oleg228-client sshd[21445]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:06 oleg228-client sshd[21458]: Received disconnect from 192.168.202.28 port 36352:11: disconnected by user Nov 18 18:17:06 oleg228-client sshd[21458]: Disconnected from user root 192.168.202.28 port 36352 Nov 18 18:17:06 oleg228-client sshd[21445]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:06 oleg228-client systemd[1]: session-87.scope: Succeeded. Nov 18 18:17:06 oleg228-client systemd-logind[1015]: Session 87 logged out. Waiting for processes to exit. Nov 18 18:17:06 oleg228-client systemd-logind[1015]: Removed session 87. Nov 18 18:17:07 oleg228-client sshd[21600]: Accepted publickey for root from 192.168.202.28 port 36354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:07 oleg228-client systemd-logind[1015]: New session 88 of user root. Nov 18 18:17:07 oleg228-client systemd[1]: Started Session 88 of user root. Nov 18 18:17:07 oleg228-client sshd[21600]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:07 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17a: timeout bulk get, don't evict client (2732) ========================================================== 18:17:06 (1763507826) Nov 18 18:17:07 oleg228-client sshd[21613]: Received disconnect from 192.168.202.28 port 36354:11: disconnected by user Nov 18 18:17:07 oleg228-client sshd[21613]: Disconnected from user root 192.168.202.28 port 36354 Nov 18 18:17:07 oleg228-client sshd[21600]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:07 oleg228-client systemd-logind[1015]: Session 88 logged out. Waiting for processes to exit. Nov 18 18:17:07 oleg228-client systemd[1]: session-88.scope: Succeeded. Nov 18 18:17:07 oleg228-client systemd-logind[1015]: Removed session 88. Nov 18 18:17:54 oleg228-client sshd[21954]: Accepted publickey for root from 192.168.202.28 port 47500 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:54 oleg228-client systemd[1]: Started Session 89 of user root. Nov 18 18:17:54 oleg228-client systemd-logind[1015]: New session 89 of user root. Nov 18 18:17:54 oleg228-client sshd[21954]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:54 oleg228-client sshd[21968]: Received disconnect from 192.168.202.28 port 47500:11: disconnected by user Nov 18 18:17:54 oleg228-client sshd[21968]: Disconnected from user root 192.168.202.28 port 47500 Nov 18 18:17:54 oleg228-client sshd[21954]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:55 oleg228-client systemd-logind[1015]: Session 89 logged out. Waiting for processes to exit. Nov 18 18:17:55 oleg228-client systemd[1]: session-89.scope: Succeeded. Nov 18 18:17:55 oleg228-client systemd-logind[1015]: Removed session 89. Nov 18 18:17:55 oleg228-client sshd[22094]: Accepted publickey for root from 192.168.202.28 port 47514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:55 oleg228-client systemd[1]: Started Session 90 of user root. Nov 18 18:17:55 oleg228-client systemd-logind[1015]: New session 90 of user root. Nov 18 18:17:55 oleg228-client sshd[22094]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:55 oleg228-client sshd[22107]: Received disconnect from 192.168.202.28 port 47514:11: disconnected by user Nov 18 18:17:56 oleg228-client sshd[22107]: Disconnected from user root 192.168.202.28 port 47514 Nov 18 18:17:56 oleg228-client sshd[22094]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:56 oleg228-client systemd-logind[1015]: Session 90 logged out. Waiting for processes to exit. Nov 18 18:17:56 oleg228-client systemd[1]: session-90.scope: Succeeded. Nov 18 18:17:56 oleg228-client systemd-logind[1015]: Removed session 90. Nov 18 18:17:56 oleg228-client sshd[22240]: Accepted publickey for root from 192.168.202.28 port 47526 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:56 oleg228-client systemd-logind[1015]: New session 91 of user root. Nov 18 18:17:56 oleg228-client systemd[1]: Started Session 91 of user root. Nov 18 18:17:56 oleg228-client sshd[22240]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:57 oleg228-client sshd[22253]: Received disconnect from 192.168.202.28 port 47526:11: disconnected by user Nov 18 18:17:57 oleg228-client sshd[22253]: Disconnected from user root 192.168.202.28 port 47526 Nov 18 18:17:57 oleg228-client sshd[22240]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:57 oleg228-client systemd[1]: session-91.scope: Succeeded. Nov 18 18:17:57 oleg228-client systemd-logind[1015]: Session 91 logged out. Waiting for processes to exit. Nov 18 18:17:57 oleg228-client systemd-logind[1015]: Removed session 91. Nov 18 18:17:57 oleg228-client sshd[22396]: Accepted publickey for root from 192.168.202.28 port 47534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:57 oleg228-client systemd-logind[1015]: New session 92 of user root. Nov 18 18:17:57 oleg228-client systemd[1]: Started Session 92 of user root. Nov 18 18:17:57 oleg228-client sshd[22396]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:58 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 17b: timeout bulk get, dont evict client (3582) ========================================================== 18:17:57 (1763507877) Nov 18 18:17:58 oleg228-client sshd[22409]: Received disconnect from 192.168.202.28 port 47534:11: disconnected by user Nov 18 18:17:58 oleg228-client sshd[22409]: Disconnected from user root 192.168.202.28 port 47534 Nov 18 18:17:58 oleg228-client sshd[22396]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:58 oleg228-client systemd-logind[1015]: Session 92 logged out. Waiting for processes to exit. Nov 18 18:17:58 oleg228-client systemd[1]: session-92.scope: Succeeded. Nov 18 18:17:58 oleg228-client systemd-logind[1015]: Removed session 92. Nov 18 18:17:58 oleg228-client sshd[22534]: Accepted publickey for root from 192.168.202.28 port 47538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:17:59 oleg228-client systemd[1]: Started Session 93 of user root. Nov 18 18:17:59 oleg228-client systemd-logind[1015]: New session 93 of user root. Nov 18 18:17:59 oleg228-client sshd[22534]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:17:59 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_17b Needs multiple clients Nov 18 18:17:59 oleg228-client sshd[22547]: Received disconnect from 192.168.202.28 port 47538:11: disconnected by user Nov 18 18:17:59 oleg228-client sshd[22547]: Disconnected from user root 192.168.202.28 port 47538 Nov 18 18:17:59 oleg228-client sshd[22534]: pam_unix(sshd:session): session closed for user root Nov 18 18:17:59 oleg228-client systemd[1]: session-93.scope: Succeeded. Nov 18 18:17:59 oleg228-client systemd-logind[1015]: Session 93 logged out. Waiting for processes to exit. Nov 18 18:17:59 oleg228-client systemd-logind[1015]: Removed session 93. Nov 18 18:18:00 oleg228-client sshd[22688]: Accepted publickey for root from 192.168.202.28 port 47554 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:00 oleg228-client systemd[1]: Started Session 94 of user root. Nov 18 18:18:00 oleg228-client systemd-logind[1015]: New session 94 of user root. Nov 18 18:18:00 oleg228-client sshd[22688]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:00 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18a: manual ost invalidate clears page cache immediately ========================================================== 18:17:59 (1763507879) Nov 18 18:18:00 oleg228-client sshd[22701]: Received disconnect from 192.168.202.28 port 47554:11: disconnected by user Nov 18 18:18:00 oleg228-client sshd[22701]: Disconnected from user root 192.168.202.28 port 47554 Nov 18 18:18:00 oleg228-client sshd[22688]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:00 oleg228-client systemd[1]: session-94.scope: Succeeded. Nov 18 18:18:00 oleg228-client systemd-logind[1015]: Session 94 logged out. Waiting for processes to exit. Nov 18 18:18:00 oleg228-client systemd-logind[1015]: Removed session 94. Nov 18 18:18:01 oleg228-client kernel: Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request Nov 18 18:18:01 oleg228-client kernel: LustreError: lustre-OST0001-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0001; in progress operations using this service will fail. Nov 18 18:18:02 oleg228-client sshd[22868]: Accepted publickey for root from 192.168.202.28 port 60664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:02 oleg228-client systemd[1]: Started Session 95 of user root. Nov 18 18:18:02 oleg228-client systemd-logind[1015]: New session 95 of user root. Nov 18 18:18:02 oleg228-client sshd[22868]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:02 oleg228-client sshd[22881]: Received disconnect from 192.168.202.28 port 60664:11: disconnected by user Nov 18 18:18:02 oleg228-client sshd[22881]: Disconnected from user root 192.168.202.28 port 60664 Nov 18 18:18:02 oleg228-client sshd[22868]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:02 oleg228-client systemd-logind[1015]: Session 95 logged out. Waiting for processes to exit. Nov 18 18:18:02 oleg228-client systemd[1]: session-95.scope: Succeeded. Nov 18 18:18:02 oleg228-client systemd-logind[1015]: Removed session 95. Nov 18 18:18:03 oleg228-client sshd[23007]: Accepted publickey for root from 192.168.202.28 port 60676 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:03 oleg228-client systemd-logind[1015]: New session 96 of user root. Nov 18 18:18:03 oleg228-client systemd[1]: Started Session 96 of user root. Nov 18 18:18:03 oleg228-client sshd[23007]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:03 oleg228-client sshd[23020]: Received disconnect from 192.168.202.28 port 60676:11: disconnected by user Nov 18 18:18:03 oleg228-client sshd[23020]: Disconnected from user root 192.168.202.28 port 60676 Nov 18 18:18:03 oleg228-client sshd[23007]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:03 oleg228-client systemd[1]: session-96.scope: Succeeded. Nov 18 18:18:03 oleg228-client systemd-logind[1015]: Session 96 logged out. Waiting for processes to exit. Nov 18 18:18:03 oleg228-client systemd-logind[1015]: Removed session 96. Nov 18 18:18:04 oleg228-client sshd[23153]: Accepted publickey for root from 192.168.202.28 port 60688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:04 oleg228-client systemd-logind[1015]: New session 97 of user root. Nov 18 18:18:04 oleg228-client systemd[1]: Started Session 97 of user root. Nov 18 18:18:04 oleg228-client sshd[23153]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:05 oleg228-client sshd[23166]: Received disconnect from 192.168.202.28 port 60688:11: disconnected by user Nov 18 18:18:05 oleg228-client sshd[23166]: Disconnected from user root 192.168.202.28 port 60688 Nov 18 18:18:05 oleg228-client sshd[23153]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:05 oleg228-client systemd-logind[1015]: Session 97 logged out. Waiting for processes to exit. Nov 18 18:18:05 oleg228-client systemd[1]: session-97.scope: Succeeded. Nov 18 18:18:05 oleg228-client systemd-logind[1015]: Removed session 97. Nov 18 18:18:05 oleg228-client sshd[23308]: Accepted publickey for root from 192.168.202.28 port 60692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:06 oleg228-client systemd[1]: Started Session 98 of user root. Nov 18 18:18:06 oleg228-client systemd-logind[1015]: New session 98 of user root. Nov 18 18:18:06 oleg228-client sshd[23308]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18b: eviction and reconnect clears page cache (2766) ========================================================== 18:18:05 (1763507885) Nov 18 18:18:06 oleg228-client sshd[23321]: Received disconnect from 192.168.202.28 port 60692:11: disconnected by user Nov 18 18:18:06 oleg228-client sshd[23321]: Disconnected from user root 192.168.202.28 port 60692 Nov 18 18:18:06 oleg228-client sshd[23308]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:06 oleg228-client systemd[1]: session-98.scope: Succeeded. Nov 18 18:18:06 oleg228-client systemd-logind[1015]: Session 98 logged out. Waiting for processes to exit. Nov 18 18:18:06 oleg228-client systemd-logind[1015]: Removed session 98. Nov 18 18:18:08 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:18:30 oleg228-client sshd[23526]: Accepted publickey for root from 192.168.202.28 port 57092 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:30 oleg228-client systemd-logind[1015]: New session 99 of user root. Nov 18 18:18:30 oleg228-client systemd[1]: Started Session 99 of user root. Nov 18 18:18:30 oleg228-client sshd[23526]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:31 oleg228-client sshd[23539]: Received disconnect from 192.168.202.28 port 57092:11: disconnected by user Nov 18 18:18:31 oleg228-client sshd[23539]: Disconnected from user root 192.168.202.28 port 57092 Nov 18 18:18:31 oleg228-client sshd[23526]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:31 oleg228-client systemd[1]: session-99.scope: Succeeded. Nov 18 18:18:31 oleg228-client systemd-logind[1015]: Session 99 logged out. Waiting for processes to exit. Nov 18 18:18:31 oleg228-client systemd-logind[1015]: Removed session 99. Nov 18 18:18:32 oleg228-client sshd[23665]: Accepted publickey for root from 192.168.202.28 port 57100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:32 oleg228-client systemd[1]: Started Session 100 of user root. Nov 18 18:18:32 oleg228-client systemd-logind[1015]: New session 100 of user root. Nov 18 18:18:32 oleg228-client sshd[23665]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:32 oleg228-client sshd[23678]: Received disconnect from 192.168.202.28 port 57100:11: disconnected by user Nov 18 18:18:32 oleg228-client sshd[23678]: Disconnected from user root 192.168.202.28 port 57100 Nov 18 18:18:32 oleg228-client sshd[23665]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:33 oleg228-client systemd[1]: session-100.scope: Succeeded. Nov 18 18:18:33 oleg228-client systemd-logind[1015]: Session 100 logged out. Waiting for processes to exit. Nov 18 18:18:33 oleg228-client systemd-logind[1015]: Removed session 100. Nov 18 18:18:33 oleg228-client sshd[23811]: Accepted publickey for root from 192.168.202.28 port 57104 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:33 oleg228-client systemd[1]: Started Session 101 of user root. Nov 18 18:18:33 oleg228-client systemd-logind[1015]: New session 101 of user root. Nov 18 18:18:33 oleg228-client sshd[23811]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:33 oleg228-client sshd[23824]: Received disconnect from 192.168.202.28 port 57104:11: disconnected by user Nov 18 18:18:33 oleg228-client sshd[23824]: Disconnected from user root 192.168.202.28 port 57104 Nov 18 18:18:34 oleg228-client sshd[23811]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:34 oleg228-client systemd[1]: session-101.scope: Succeeded. Nov 18 18:18:34 oleg228-client systemd-logind[1015]: Session 101 logged out. Waiting for processes to exit. Nov 18 18:18:34 oleg228-client systemd-logind[1015]: Removed session 101. Nov 18 18:18:35 oleg228-client sshd[23966]: Accepted publickey for root from 192.168.202.28 port 57106 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:35 oleg228-client systemd-logind[1015]: New session 102 of user root. Nov 18 18:18:35 oleg228-client systemd[1]: Started Session 102 of user root. Nov 18 18:18:35 oleg228-client sshd[23966]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:35 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 18c: Dropped connect reply after eviction handing (14755) ========================================================== 18:18:34 (1763507914) Nov 18 18:18:35 oleg228-client sshd[23979]: Received disconnect from 192.168.202.28 port 57106:11: disconnected by user Nov 18 18:18:35 oleg228-client sshd[23979]: Disconnected from user root 192.168.202.28 port 57106 Nov 18 18:18:35 oleg228-client sshd[23966]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:35 oleg228-client systemd[1]: session-102.scope: Succeeded. Nov 18 18:18:35 oleg228-client systemd-logind[1015]: Session 102 logged out. Waiting for processes to exit. Nov 18 18:18:35 oleg228-client systemd-logind[1015]: Removed session 102. Nov 18 18:18:38 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: operation ost_statfs to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:18:48 oleg228-client kernel: Lustre: Evicted from lustre-OST0000_UUID (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25c876e7 to 0x2622672b25c87830 Nov 18 18:18:48 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:18:51 oleg228-client sshd[24193]: Accepted publickey for root from 192.168.202.28 port 36656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:51 oleg228-client systemd-logind[1015]: New session 103 of user root. Nov 18 18:18:51 oleg228-client systemd[1]: Started Session 103 of user root. Nov 18 18:18:51 oleg228-client sshd[24193]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:52 oleg228-client sshd[24206]: Received disconnect from 192.168.202.28 port 36656:11: disconnected by user Nov 18 18:18:52 oleg228-client sshd[24206]: Disconnected from user root 192.168.202.28 port 36656 Nov 18 18:18:52 oleg228-client sshd[24193]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:52 oleg228-client systemd-logind[1015]: Session 103 logged out. Waiting for processes to exit. Nov 18 18:18:52 oleg228-client systemd[1]: session-103.scope: Succeeded. Nov 18 18:18:52 oleg228-client systemd-logind[1015]: Removed session 103. Nov 18 18:18:53 oleg228-client sshd[24332]: Accepted publickey for root from 192.168.202.28 port 36662 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:53 oleg228-client systemd[1]: Started Session 104 of user root. Nov 18 18:18:53 oleg228-client systemd-logind[1015]: New session 104 of user root. Nov 18 18:18:53 oleg228-client sshd[24332]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:54 oleg228-client sshd[24345]: Received disconnect from 192.168.202.28 port 36662:11: disconnected by user Nov 18 18:18:54 oleg228-client sshd[24345]: Disconnected from user root 192.168.202.28 port 36662 Nov 18 18:18:54 oleg228-client sshd[24332]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:54 oleg228-client systemd[1]: session-104.scope: Succeeded. Nov 18 18:18:54 oleg228-client systemd-logind[1015]: Session 104 logged out. Waiting for processes to exit. Nov 18 18:18:54 oleg228-client systemd-logind[1015]: Removed session 104. Nov 18 18:18:55 oleg228-client sshd[24478]: Accepted publickey for root from 192.168.202.28 port 36678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:55 oleg228-client systemd[1]: Started Session 105 of user root. Nov 18 18:18:55 oleg228-client systemd-logind[1015]: New session 105 of user root. Nov 18 18:18:55 oleg228-client sshd[24478]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:56 oleg228-client sshd[24492]: Received disconnect from 192.168.202.28 port 36678:11: disconnected by user Nov 18 18:18:56 oleg228-client sshd[24492]: Disconnected from user root 192.168.202.28 port 36678 Nov 18 18:18:56 oleg228-client sshd[24478]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:56 oleg228-client systemd[1]: session-105.scope: Succeeded. Nov 18 18:18:56 oleg228-client systemd-logind[1015]: Session 105 logged out. Waiting for processes to exit. Nov 18 18:18:56 oleg228-client systemd-logind[1015]: Removed session 105. Nov 18 18:18:57 oleg228-client sshd[24634]: Accepted publickey for root from 192.168.202.28 port 36680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:18:57 oleg228-client systemd-logind[1015]: New session 106 of user root. Nov 18 18:18:57 oleg228-client systemd[1]: Started Session 106 of user root. Nov 18 18:18:57 oleg228-client sshd[24634]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:18:57 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19a: test expired_lock_main on mds (2867) ========================================================== 18:18:56 (1763507936) Nov 18 18:18:57 oleg228-client sshd[24647]: Received disconnect from 192.168.202.28 port 36680:11: disconnected by user Nov 18 18:18:57 oleg228-client sshd[24647]: Disconnected from user root 192.168.202.28 port 36680 Nov 18 18:18:58 oleg228-client sshd[24634]: pam_unix(sshd:session): session closed for user root Nov 18 18:18:58 oleg228-client systemd[1]: session-106.scope: Succeeded. Nov 18 18:18:58 oleg228-client systemd-logind[1015]: Session 106 logged out. Waiting for processes to exit. Nov 18 18:18:58 oleg228-client systemd-logind[1015]: Removed session 106. Nov 18 18:18:58 oleg228-client systemd-udevd[24703]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:18:58 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 18:18:58 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 18:19:48 oleg228-client kernel: Lustre: 2409:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763507972/real 1763507972] req@ffff9ccbc67ee300 x1849171034437632/t0(0) o103->lustre-MDT0000-mdc-ffff9ccbc551f800@192.168.202.128@tcp:17/18 lens 328/224 e 0 to 1 dl 1763507988 ref 1 fl Rpc:XQr/202/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 Nov 18 18:19:48 oleg228-client kernel: Lustre: 2409:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Nov 18 18:20:45 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:20:45 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 18:20:45 oleg228-client kernel: LustreError: 24883:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc551f800: inode [0x200000404:0x1:0x0] mdc close failed: rc = -108 Nov 18 18:20:45 oleg228-client kernel: LustreError: 24882:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 Nov 18 18:20:46 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 18:20:46 oleg228-client kernel: LustreError: 24892:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbd8f55000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 18:20:46 oleg228-client kernel: LustreError: 24892:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 18:20:46 oleg228-client kernel: LustreError: 24892:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 18:20:46 oleg228-client kernel: LustreError: 24892:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 18:20:46 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 18:20:48 oleg228-client sshd[24999]: Accepted publickey for root from 192.168.202.28 port 53988 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:20:48 oleg228-client systemd-logind[1015]: New session 107 of user root. Nov 18 18:20:48 oleg228-client systemd[1]: Started Session 107 of user root. Nov 18 18:20:48 oleg228-client sshd[24999]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:20:48 oleg228-client sshd[25012]: Received disconnect from 192.168.202.28 port 53988:11: disconnected by user Nov 18 18:20:48 oleg228-client sshd[25012]: Disconnected from user root 192.168.202.28 port 53988 Nov 18 18:20:48 oleg228-client sshd[24999]: pam_unix(sshd:session): session closed for user root Nov 18 18:20:48 oleg228-client systemd-logind[1015]: Session 107 logged out. Waiting for processes to exit. Nov 18 18:20:48 oleg228-client systemd[1]: session-107.scope: Succeeded. Nov 18 18:20:48 oleg228-client systemd-logind[1015]: Removed session 107. Nov 18 18:20:49 oleg228-client sshd[25138]: Accepted publickey for root from 192.168.202.28 port 53990 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:20:49 oleg228-client systemd[1]: Started Session 108 of user root. Nov 18 18:20:49 oleg228-client systemd-logind[1015]: New session 108 of user root. Nov 18 18:20:49 oleg228-client sshd[25138]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:20:49 oleg228-client sshd[25151]: Received disconnect from 192.168.202.28 port 53990:11: disconnected by user Nov 18 18:20:49 oleg228-client sshd[25151]: Disconnected from user root 192.168.202.28 port 53990 Nov 18 18:20:49 oleg228-client sshd[25138]: pam_unix(sshd:session): session closed for user root Nov 18 18:20:49 oleg228-client systemd[1]: session-108.scope: Succeeded. Nov 18 18:20:49 oleg228-client systemd-logind[1015]: Session 108 logged out. Waiting for processes to exit. Nov 18 18:20:49 oleg228-client systemd-logind[1015]: Removed session 108. Nov 18 18:20:50 oleg228-client sshd[25285]: Accepted publickey for root from 192.168.202.28 port 54002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:20:50 oleg228-client systemd-logind[1015]: New session 109 of user root. Nov 18 18:20:50 oleg228-client systemd[1]: Started Session 109 of user root. Nov 18 18:20:50 oleg228-client sshd[25285]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:20:51 oleg228-client sshd[25298]: Received disconnect from 192.168.202.28 port 54002:11: disconnected by user Nov 18 18:20:51 oleg228-client sshd[25298]: Disconnected from user root 192.168.202.28 port 54002 Nov 18 18:20:51 oleg228-client sshd[25285]: pam_unix(sshd:session): session closed for user root Nov 18 18:20:51 oleg228-client systemd[1]: session-109.scope: Succeeded. Nov 18 18:20:51 oleg228-client systemd-logind[1015]: Session 109 logged out. Waiting for processes to exit. Nov 18 18:20:51 oleg228-client systemd-logind[1015]: Removed session 109. Nov 18 18:20:52 oleg228-client sshd[25441]: Accepted publickey for root from 192.168.202.28 port 52304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:20:52 oleg228-client systemd-logind[1015]: New session 110 of user root. Nov 18 18:20:52 oleg228-client systemd[1]: Started Session 110 of user root. Nov 18 18:20:52 oleg228-client sshd[25441]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:20:52 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19b: test expired_lock_main on ost (2867) ========================================================== 18:20:51 (1763508051) Nov 18 18:20:52 oleg228-client sshd[25454]: Received disconnect from 192.168.202.28 port 52304:11: disconnected by user Nov 18 18:20:52 oleg228-client sshd[25454]: Disconnected from user root 192.168.202.28 port 52304 Nov 18 18:20:52 oleg228-client sshd[25441]: pam_unix(sshd:session): session closed for user root Nov 18 18:20:52 oleg228-client systemd-logind[1015]: Session 110 logged out. Waiting for processes to exit. Nov 18 18:20:52 oleg228-client systemd[1]: session-110.scope: Succeeded. Nov 18 18:20:52 oleg228-client systemd-logind[1015]: Removed session 110. Nov 18 18:20:52 oleg228-client systemd-udevd[25510]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:20:53 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 18:22:30 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc551f800: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:22:30 oleg228-client kernel: Lustre: Skipped 20 previous similar messages Nov 18 18:22:30 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc551f800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:22:30 oleg228-client kernel: Lustre: Skipped 16 previous similar messages Nov 18 18:22:35 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:22:37 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 18:22:38 oleg228-client kernel: LustreError: 25693:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc76f1800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 18:22:38 oleg228-client kernel: LustreError: 25693:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 18:22:38 oleg228-client kernel: LustreError: 25693:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 18:22:38 oleg228-client kernel: LustreError: 25693:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 18:22:38 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 18:22:39 oleg228-client sshd[25806]: Accepted publickey for root from 192.168.202.28 port 43704 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:39 oleg228-client systemd[1]: Started Session 111 of user root. Nov 18 18:22:39 oleg228-client systemd-logind[1015]: New session 111 of user root. Nov 18 18:22:39 oleg228-client sshd[25806]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:39 oleg228-client sshd[25819]: Received disconnect from 192.168.202.28 port 43704:11: disconnected by user Nov 18 18:22:40 oleg228-client sshd[25819]: Disconnected from user root 192.168.202.28 port 43704 Nov 18 18:22:40 oleg228-client sshd[25806]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:40 oleg228-client systemd[1]: session-111.scope: Succeeded. Nov 18 18:22:40 oleg228-client systemd-logind[1015]: Session 111 logged out. Waiting for processes to exit. Nov 18 18:22:40 oleg228-client systemd-logind[1015]: Removed session 111. Nov 18 18:22:41 oleg228-client sshd[25946]: Accepted publickey for root from 192.168.202.28 port 45276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:41 oleg228-client systemd-logind[1015]: New session 112 of user root. Nov 18 18:22:41 oleg228-client systemd[1]: Started Session 112 of user root. Nov 18 18:22:41 oleg228-client sshd[25946]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:41 oleg228-client sshd[25959]: Received disconnect from 192.168.202.28 port 45276:11: disconnected by user Nov 18 18:22:41 oleg228-client sshd[25959]: Disconnected from user root 192.168.202.28 port 45276 Nov 18 18:22:41 oleg228-client sshd[25946]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:41 oleg228-client systemd[1]: session-112.scope: Succeeded. Nov 18 18:22:41 oleg228-client systemd-logind[1015]: Session 112 logged out. Waiting for processes to exit. Nov 18 18:22:41 oleg228-client systemd-logind[1015]: Removed session 112. Nov 18 18:22:42 oleg228-client sshd[26092]: Accepted publickey for root from 192.168.202.28 port 45282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:42 oleg228-client systemd[1]: Started Session 113 of user root. Nov 18 18:22:42 oleg228-client systemd-logind[1015]: New session 113 of user root. Nov 18 18:22:42 oleg228-client sshd[26092]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:42 oleg228-client sshd[26105]: Received disconnect from 192.168.202.28 port 45282:11: disconnected by user Nov 18 18:22:42 oleg228-client sshd[26105]: Disconnected from user root 192.168.202.28 port 45282 Nov 18 18:22:42 oleg228-client sshd[26092]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:42 oleg228-client systemd[1]: session-113.scope: Succeeded. Nov 18 18:22:42 oleg228-client systemd-logind[1015]: Session 113 logged out. Waiting for processes to exit. Nov 18 18:22:42 oleg228-client systemd-logind[1015]: Removed session 113. Nov 18 18:22:44 oleg228-client sshd[26247]: Accepted publickey for root from 192.168.202.28 port 45284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:44 oleg228-client systemd-logind[1015]: New session 114 of user root. Nov 18 18:22:44 oleg228-client systemd[1]: Started Session 114 of user root. Nov 18 18:22:44 oleg228-client sshd[26247]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:44 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 19c: check reconnect and lock resend do not trigger expired_lock_main ========================================================== 18:22:43 (1763508163) Nov 18 18:22:44 oleg228-client sshd[26260]: Received disconnect from 192.168.202.28 port 45284:11: disconnected by user Nov 18 18:22:44 oleg228-client sshd[26260]: Disconnected from user root 192.168.202.28 port 45284 Nov 18 18:22:44 oleg228-client sshd[26247]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:44 oleg228-client systemd-logind[1015]: Session 114 logged out. Waiting for processes to exit. Nov 18 18:22:44 oleg228-client systemd[1]: session-114.scope: Succeeded. Nov 18 18:22:44 oleg228-client systemd-logind[1015]: Removed session 114. Nov 18 18:22:44 oleg228-client systemd-udevd[26322]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 18:22:44 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 18:22:49 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 18:22:49 oleg228-client kernel: LustreError: 26371:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc7bdc800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 18:22:49 oleg228-client kernel: LustreError: 26371:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 18:22:49 oleg228-client kernel: LustreError: 26371:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 18:22:49 oleg228-client kernel: LustreError: 26371:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 18:22:49 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 18:22:55 oleg228-client sshd[26470]: Accepted publickey for root from 192.168.202.28 port 48614 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:55 oleg228-client systemd[1]: Started Session 115 of user root. Nov 18 18:22:55 oleg228-client systemd-logind[1015]: New session 115 of user root. Nov 18 18:22:55 oleg228-client sshd[26470]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:55 oleg228-client sshd[26483]: Received disconnect from 192.168.202.28 port 48614:11: disconnected by user Nov 18 18:22:55 oleg228-client sshd[26483]: Disconnected from user root 192.168.202.28 port 48614 Nov 18 18:22:55 oleg228-client sshd[26470]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:55 oleg228-client systemd[1]: session-115.scope: Succeeded. Nov 18 18:22:55 oleg228-client systemd-logind[1015]: Session 115 logged out. Waiting for processes to exit. Nov 18 18:22:55 oleg228-client systemd-logind[1015]: Removed session 115. Nov 18 18:22:56 oleg228-client sshd[26610]: Accepted publickey for root from 192.168.202.28 port 48628 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:56 oleg228-client systemd-logind[1015]: New session 116 of user root. Nov 18 18:22:56 oleg228-client systemd[1]: Started Session 116 of user root. Nov 18 18:22:56 oleg228-client sshd[26610]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:56 oleg228-client sshd[26623]: Received disconnect from 192.168.202.28 port 48628:11: disconnected by user Nov 18 18:22:56 oleg228-client sshd[26623]: Disconnected from user root 192.168.202.28 port 48628 Nov 18 18:22:56 oleg228-client sshd[26610]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:56 oleg228-client systemd[1]: session-116.scope: Succeeded. Nov 18 18:22:56 oleg228-client systemd-logind[1015]: Session 116 logged out. Waiting for processes to exit. Nov 18 18:22:56 oleg228-client systemd-logind[1015]: Removed session 116. Nov 18 18:22:57 oleg228-client sshd[26756]: Accepted publickey for root from 192.168.202.28 port 48644 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:57 oleg228-client systemd-logind[1015]: New session 117 of user root. Nov 18 18:22:57 oleg228-client systemd[1]: Started Session 117 of user root. Nov 18 18:22:57 oleg228-client sshd[26756]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:57 oleg228-client sshd[26769]: Received disconnect from 192.168.202.28 port 48644:11: disconnected by user Nov 18 18:22:57 oleg228-client sshd[26769]: Disconnected from user root 192.168.202.28 port 48644 Nov 18 18:22:57 oleg228-client sshd[26756]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:57 oleg228-client systemd[1]: session-117.scope: Succeeded. Nov 18 18:22:57 oleg228-client systemd-logind[1015]: Session 117 logged out. Waiting for processes to exit. Nov 18 18:22:57 oleg228-client systemd-logind[1015]: Removed session 117. Nov 18 18:22:58 oleg228-client sshd[26911]: Accepted publickey for root from 192.168.202.28 port 48646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:22:58 oleg228-client systemd-logind[1015]: New session 118 of user root. Nov 18 18:22:58 oleg228-client systemd[1]: Started Session 118 of user root. Nov 18 18:22:58 oleg228-client sshd[26911]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:22:58 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:22:59 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20a: ldlm_handle_enqueue error (should return error) ========================================================== 18:22:58 (1763508178) Nov 18 18:22:59 oleg228-client sshd[26925]: Received disconnect from 192.168.202.28 port 48646:11: disconnected by user Nov 18 18:22:59 oleg228-client sshd[26925]: Disconnected from user root 192.168.202.28 port 48646 Nov 18 18:22:59 oleg228-client sshd[26911]: pam_unix(sshd:session): session closed for user root Nov 18 18:22:59 oleg228-client systemd[1]: session-118.scope: Succeeded. Nov 18 18:22:59 oleg228-client systemd-logind[1015]: Session 118 logged out. Waiting for processes to exit. Nov 18 18:22:59 oleg228-client systemd-logind[1015]: Removed session 118. Nov 18 18:23:00 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -12 Nov 18 18:23:01 oleg228-client sshd[27095]: Accepted publickey for root from 192.168.202.28 port 51744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:01 oleg228-client systemd[1]: Started Session 119 of user root. Nov 18 18:23:01 oleg228-client systemd-logind[1015]: New session 119 of user root. Nov 18 18:23:01 oleg228-client sshd[27095]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:01 oleg228-client sshd[27108]: Received disconnect from 192.168.202.28 port 51744:11: disconnected by user Nov 18 18:23:01 oleg228-client sshd[27108]: Disconnected from user root 192.168.202.28 port 51744 Nov 18 18:23:01 oleg228-client sshd[27095]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:02 oleg228-client systemd[1]: session-119.scope: Succeeded. Nov 18 18:23:02 oleg228-client systemd-logind[1015]: Session 119 logged out. Waiting for processes to exit. Nov 18 18:23:02 oleg228-client systemd-logind[1015]: Removed session 119. Nov 18 18:23:02 oleg228-client sshd[27235]: Accepted publickey for root from 192.168.202.28 port 51746 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:03 oleg228-client systemd-logind[1015]: New session 120 of user root. Nov 18 18:23:03 oleg228-client systemd[1]: Started Session 120 of user root. Nov 18 18:23:03 oleg228-client sshd[27235]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:03 oleg228-client sshd[27248]: Received disconnect from 192.168.202.28 port 51746:11: disconnected by user Nov 18 18:23:03 oleg228-client sshd[27248]: Disconnected from user root 192.168.202.28 port 51746 Nov 18 18:23:03 oleg228-client sshd[27235]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:03 oleg228-client systemd-logind[1015]: Session 120 logged out. Waiting for processes to exit. Nov 18 18:23:03 oleg228-client systemd[1]: session-120.scope: Succeeded. Nov 18 18:23:03 oleg228-client systemd-logind[1015]: Removed session 120. Nov 18 18:23:04 oleg228-client sshd[27382]: Accepted publickey for root from 192.168.202.28 port 51756 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:04 oleg228-client systemd-logind[1015]: New session 121 of user root. Nov 18 18:23:04 oleg228-client systemd[1]: Started Session 121 of user root. Nov 18 18:23:04 oleg228-client sshd[27382]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:04 oleg228-client sshd[27395]: Received disconnect from 192.168.202.28 port 51756:11: disconnected by user Nov 18 18:23:04 oleg228-client sshd[27395]: Disconnected from user root 192.168.202.28 port 51756 Nov 18 18:23:04 oleg228-client sshd[27382]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:05 oleg228-client systemd[1]: session-121.scope: Succeeded. Nov 18 18:23:05 oleg228-client systemd-logind[1015]: Session 121 logged out. Waiting for processes to exit. Nov 18 18:23:05 oleg228-client systemd-logind[1015]: Removed session 121. Nov 18 18:23:06 oleg228-client sshd[27537]: Accepted publickey for root from 192.168.202.28 port 51758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:06 oleg228-client systemd-logind[1015]: New session 122 of user root. Nov 18 18:23:06 oleg228-client systemd[1]: Started Session 122 of user root. Nov 18 18:23:06 oleg228-client sshd[27537]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 20b: ldlm_handle_enqueue error (should return error) ========================================================== 18:23:05 (1763508185) Nov 18 18:23:06 oleg228-client sshd[27550]: Received disconnect from 192.168.202.28 port 51758:11: disconnected by user Nov 18 18:23:06 oleg228-client sshd[27550]: Disconnected from user root 192.168.202.28 port 51758 Nov 18 18:23:06 oleg228-client sshd[27537]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:06 oleg228-client systemd[1]: session-122.scope: Succeeded. Nov 18 18:23:06 oleg228-client systemd-logind[1015]: Session 122 logged out. Waiting for processes to exit. Nov 18 18:23:06 oleg228-client systemd-logind[1015]: Removed session 122. Nov 18 18:23:08 oleg228-client sshd[27718]: Accepted publickey for root from 192.168.202.28 port 51762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:08 oleg228-client systemd-logind[1015]: New session 123 of user root. Nov 18 18:23:08 oleg228-client systemd[1]: Started Session 123 of user root. Nov 18 18:23:09 oleg228-client sshd[27718]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:09 oleg228-client sshd[27731]: Received disconnect from 192.168.202.28 port 51762:11: disconnected by user Nov 18 18:23:09 oleg228-client sshd[27731]: Disconnected from user root 192.168.202.28 port 51762 Nov 18 18:23:09 oleg228-client sshd[27718]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:09 oleg228-client systemd[1]: session-123.scope: Succeeded. Nov 18 18:23:09 oleg228-client systemd-logind[1015]: Session 123 logged out. Waiting for processes to exit. Nov 18 18:23:09 oleg228-client systemd-logind[1015]: Removed session 123. Nov 18 18:23:10 oleg228-client sshd[27857]: Accepted publickey for root from 192.168.202.28 port 51774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:10 oleg228-client systemd-logind[1015]: New session 124 of user root. Nov 18 18:23:10 oleg228-client systemd[1]: Started Session 124 of user root. Nov 18 18:23:10 oleg228-client sshd[27857]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:10 oleg228-client sshd[27870]: Received disconnect from 192.168.202.28 port 51774:11: disconnected by user Nov 18 18:23:10 oleg228-client sshd[27870]: Disconnected from user root 192.168.202.28 port 51774 Nov 18 18:23:10 oleg228-client sshd[27857]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:10 oleg228-client systemd[1]: session-124.scope: Succeeded. Nov 18 18:23:10 oleg228-client systemd-logind[1015]: Session 124 logged out. Waiting for processes to exit. Nov 18 18:23:10 oleg228-client systemd-logind[1015]: Removed session 124. Nov 18 18:23:11 oleg228-client sshd[28003]: Accepted publickey for root from 192.168.202.28 port 51782 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:11 oleg228-client systemd[1]: Started Session 125 of user root. Nov 18 18:23:11 oleg228-client systemd-logind[1015]: New session 125 of user root. Nov 18 18:23:11 oleg228-client sshd[28003]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:11 oleg228-client sshd[28017]: Received disconnect from 192.168.202.28 port 51782:11: disconnected by user Nov 18 18:23:11 oleg228-client sshd[28017]: Disconnected from user root 192.168.202.28 port 51782 Nov 18 18:23:11 oleg228-client sshd[28003]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:11 oleg228-client systemd[1]: session-125.scope: Succeeded. Nov 18 18:23:11 oleg228-client systemd-logind[1015]: Session 125 logged out. Waiting for processes to exit. Nov 18 18:23:11 oleg228-client systemd-logind[1015]: Removed session 125. Nov 18 18:23:13 oleg228-client sshd[28159]: Accepted publickey for root from 192.168.202.28 port 51796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:13 oleg228-client systemd-logind[1015]: New session 126 of user root. Nov 18 18:23:13 oleg228-client systemd[1]: Started Session 126 of user root. Nov 18 18:23:13 oleg228-client sshd[28159]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:13 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21a: drop close request while close and open are both in flight ========================================================== 18:23:12 (1763508192) Nov 18 18:23:13 oleg228-client sshd[28172]: Received disconnect from 192.168.202.28 port 51796:11: disconnected by user Nov 18 18:23:13 oleg228-client sshd[28172]: Disconnected from user root 192.168.202.28 port 51796 Nov 18 18:23:13 oleg228-client sshd[28159]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:13 oleg228-client systemd[1]: session-126.scope: Succeeded. Nov 18 18:23:13 oleg228-client systemd-logind[1015]: Session 126 logged out. Waiting for processes to exit. Nov 18 18:23:13 oleg228-client systemd-logind[1015]: Removed session 126. Nov 18 18:23:35 oleg228-client sshd[28344]: Accepted publickey for root from 192.168.202.28 port 36534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:35 oleg228-client systemd-logind[1015]: New session 127 of user root. Nov 18 18:23:35 oleg228-client systemd[1]: Started Session 127 of user root. Nov 18 18:23:35 oleg228-client sshd[28344]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:36 oleg228-client sshd[28357]: Received disconnect from 192.168.202.28 port 36534:11: disconnected by user Nov 18 18:23:36 oleg228-client sshd[28357]: Disconnected from user root 192.168.202.28 port 36534 Nov 18 18:23:36 oleg228-client sshd[28344]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:36 oleg228-client systemd[1]: session-127.scope: Succeeded. Nov 18 18:23:36 oleg228-client systemd-logind[1015]: Session 127 logged out. Waiting for processes to exit. Nov 18 18:23:36 oleg228-client systemd-logind[1015]: Removed session 127. Nov 18 18:23:37 oleg228-client sshd[28483]: Accepted publickey for root from 192.168.202.28 port 36544 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:37 oleg228-client systemd[1]: Started Session 128 of user root. Nov 18 18:23:37 oleg228-client systemd-logind[1015]: New session 128 of user root. Nov 18 18:23:37 oleg228-client sshd[28483]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:37 oleg228-client sshd[28496]: Received disconnect from 192.168.202.28 port 36544:11: disconnected by user Nov 18 18:23:37 oleg228-client sshd[28496]: Disconnected from user root 192.168.202.28 port 36544 Nov 18 18:23:37 oleg228-client sshd[28483]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:37 oleg228-client systemd[1]: session-128.scope: Succeeded. Nov 18 18:23:37 oleg228-client systemd-logind[1015]: Session 128 logged out. Waiting for processes to exit. Nov 18 18:23:37 oleg228-client systemd-logind[1015]: Removed session 128. Nov 18 18:23:38 oleg228-client sshd[28629]: Accepted publickey for root from 192.168.202.28 port 36558 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:38 oleg228-client systemd-logind[1015]: New session 129 of user root. Nov 18 18:23:38 oleg228-client systemd[1]: Started Session 129 of user root. Nov 18 18:23:38 oleg228-client sshd[28629]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:38 oleg228-client sshd[28642]: Received disconnect from 192.168.202.28 port 36558:11: disconnected by user Nov 18 18:23:38 oleg228-client sshd[28642]: Disconnected from user root 192.168.202.28 port 36558 Nov 18 18:23:38 oleg228-client sshd[28629]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:38 oleg228-client systemd[1]: session-129.scope: Succeeded. Nov 18 18:23:38 oleg228-client systemd-logind[1015]: Session 129 logged out. Waiting for processes to exit. Nov 18 18:23:38 oleg228-client systemd-logind[1015]: Removed session 129. Nov 18 18:23:40 oleg228-client sshd[28785]: Accepted publickey for root from 192.168.202.28 port 36564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:23:40 oleg228-client systemd-logind[1015]: New session 130 of user root. Nov 18 18:23:40 oleg228-client systemd[1]: Started Session 130 of user root. Nov 18 18:23:40 oleg228-client sshd[28785]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:23:40 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21b: drop open request while close and open are both in flight ========================================================== 18:23:39 (1763508219) Nov 18 18:23:40 oleg228-client sshd[28798]: Received disconnect from 192.168.202.28 port 36564:11: disconnected by user Nov 18 18:23:40 oleg228-client sshd[28798]: Disconnected from user root 192.168.202.28 port 36564 Nov 18 18:23:40 oleg228-client sshd[28785]: pam_unix(sshd:session): session closed for user root Nov 18 18:23:40 oleg228-client systemd-logind[1015]: Session 130 logged out. Waiting for processes to exit. Nov 18 18:23:40 oleg228-client systemd[1]: session-130.scope: Succeeded. Nov 18 18:23:40 oleg228-client systemd-logind[1015]: Removed session 130. Nov 18 18:26:01 oleg228-client sshd[28973]: Accepted publickey for root from 192.168.202.28 port 43674 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:01 oleg228-client systemd[1]: Started Session 131 of user root. Nov 18 18:26:01 oleg228-client systemd-logind[1015]: New session 131 of user root. Nov 18 18:26:01 oleg228-client sshd[28973]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:02 oleg228-client sshd[28986]: Received disconnect from 192.168.202.28 port 43674:11: disconnected by user Nov 18 18:26:02 oleg228-client sshd[28986]: Disconnected from user root 192.168.202.28 port 43674 Nov 18 18:26:02 oleg228-client sshd[28973]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:02 oleg228-client systemd[1]: session-131.scope: Succeeded. Nov 18 18:26:02 oleg228-client systemd-logind[1015]: Session 131 logged out. Waiting for processes to exit. Nov 18 18:26:02 oleg228-client systemd-logind[1015]: Removed session 131. Nov 18 18:26:04 oleg228-client sshd[29112]: Accepted publickey for root from 192.168.202.28 port 43686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:04 oleg228-client systemd[1]: Started Session 132 of user root. Nov 18 18:26:04 oleg228-client systemd-logind[1015]: New session 132 of user root. Nov 18 18:26:04 oleg228-client sshd[29112]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:04 oleg228-client sshd[29125]: Received disconnect from 192.168.202.28 port 43686:11: disconnected by user Nov 18 18:26:04 oleg228-client sshd[29125]: Disconnected from user root 192.168.202.28 port 43686 Nov 18 18:26:04 oleg228-client sshd[29112]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:05 oleg228-client systemd[1]: session-132.scope: Succeeded. Nov 18 18:26:05 oleg228-client systemd-logind[1015]: Session 132 logged out. Waiting for processes to exit. Nov 18 18:26:05 oleg228-client systemd-logind[1015]: Removed session 132. Nov 18 18:26:06 oleg228-client sshd[29258]: Accepted publickey for root from 192.168.202.28 port 43690 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:06 oleg228-client systemd-logind[1015]: New session 133 of user root. Nov 18 18:26:06 oleg228-client systemd[1]: Started Session 133 of user root. Nov 18 18:26:06 oleg228-client sshd[29258]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:06 oleg228-client sshd[29271]: Received disconnect from 192.168.202.28 port 43690:11: disconnected by user Nov 18 18:26:06 oleg228-client sshd[29271]: Disconnected from user root 192.168.202.28 port 43690 Nov 18 18:26:06 oleg228-client sshd[29258]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:06 oleg228-client systemd[1]: session-133.scope: Succeeded. Nov 18 18:26:06 oleg228-client systemd-logind[1015]: Session 133 logged out. Waiting for processes to exit. Nov 18 18:26:06 oleg228-client systemd-logind[1015]: Removed session 133. Nov 18 18:26:08 oleg228-client sshd[29414]: Accepted publickey for root from 192.168.202.28 port 43692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:08 oleg228-client systemd-logind[1015]: New session 134 of user root. Nov 18 18:26:08 oleg228-client systemd[1]: Started Session 134 of user root. Nov 18 18:26:08 oleg228-client sshd[29414]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:08 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21c: drop both request while close and open are both in flight ========================================================== 18:26:06 (1763508366) Nov 18 18:26:08 oleg228-client sshd[29427]: Received disconnect from 192.168.202.28 port 43692:11: disconnected by user Nov 18 18:26:08 oleg228-client sshd[29427]: Disconnected from user root 192.168.202.28 port 43692 Nov 18 18:26:08 oleg228-client sshd[29414]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:08 oleg228-client systemd[1]: session-134.scope: Succeeded. Nov 18 18:26:08 oleg228-client systemd-logind[1015]: Session 134 logged out. Waiting for processes to exit. Nov 18 18:26:08 oleg228-client systemd-logind[1015]: Removed session 134. Nov 18 18:26:33 oleg228-client sshd[29600]: Accepted publickey for root from 192.168.202.28 port 35998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:33 oleg228-client systemd-logind[1015]: New session 135 of user root. Nov 18 18:26:33 oleg228-client systemd[1]: Started Session 135 of user root. Nov 18 18:26:33 oleg228-client sshd[29600]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:33 oleg228-client sshd[29613]: Received disconnect from 192.168.202.28 port 35998:11: disconnected by user Nov 18 18:26:33 oleg228-client sshd[29613]: Disconnected from user root 192.168.202.28 port 35998 Nov 18 18:26:33 oleg228-client sshd[29600]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:33 oleg228-client systemd[1]: session-135.scope: Succeeded. Nov 18 18:26:33 oleg228-client systemd-logind[1015]: Session 135 logged out. Waiting for processes to exit. Nov 18 18:26:33 oleg228-client systemd-logind[1015]: Removed session 135. Nov 18 18:26:34 oleg228-client sshd[29739]: Accepted publickey for root from 192.168.202.28 port 36006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:34 oleg228-client systemd-logind[1015]: New session 136 of user root. Nov 18 18:26:34 oleg228-client systemd[1]: Started Session 136 of user root. Nov 18 18:26:34 oleg228-client sshd[29739]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:34 oleg228-client sshd[29752]: Received disconnect from 192.168.202.28 port 36006:11: disconnected by user Nov 18 18:26:34 oleg228-client sshd[29752]: Disconnected from user root 192.168.202.28 port 36006 Nov 18 18:26:34 oleg228-client sshd[29739]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:35 oleg228-client systemd[1]: session-136.scope: Succeeded. Nov 18 18:26:35 oleg228-client systemd-logind[1015]: Session 136 logged out. Waiting for processes to exit. Nov 18 18:26:35 oleg228-client systemd-logind[1015]: Removed session 136. Nov 18 18:26:35 oleg228-client sshd[29886]: Accepted publickey for root from 192.168.202.28 port 36020 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:35 oleg228-client systemd[1]: Started Session 137 of user root. Nov 18 18:26:35 oleg228-client systemd-logind[1015]: New session 137 of user root. Nov 18 18:26:35 oleg228-client sshd[29886]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:36 oleg228-client sshd[29899]: Received disconnect from 192.168.202.28 port 36020:11: disconnected by user Nov 18 18:26:36 oleg228-client sshd[29899]: Disconnected from user root 192.168.202.28 port 36020 Nov 18 18:26:36 oleg228-client sshd[29886]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:36 oleg228-client systemd[1]: session-137.scope: Succeeded. Nov 18 18:26:36 oleg228-client systemd-logind[1015]: Session 137 logged out. Waiting for processes to exit. Nov 18 18:26:36 oleg228-client systemd-logind[1015]: Removed session 137. Nov 18 18:26:37 oleg228-client sshd[30042]: Accepted publickey for root from 192.168.202.28 port 36026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:26:37 oleg228-client systemd-logind[1015]: New session 138 of user root. Nov 18 18:26:37 oleg228-client systemd[1]: Started Session 138 of user root. Nov 18 18:26:37 oleg228-client sshd[30042]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:26:37 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21d: drop close reply while close and open are both in flight ========================================================== 18:26:36 (1763508396) Nov 18 18:26:37 oleg228-client sshd[30055]: Received disconnect from 192.168.202.28 port 36026:11: disconnected by user Nov 18 18:26:38 oleg228-client sshd[30055]: Disconnected from user root 192.168.202.28 port 36026 Nov 18 18:26:38 oleg228-client sshd[30042]: pam_unix(sshd:session): session closed for user root Nov 18 18:26:38 oleg228-client systemd-logind[1015]: Session 138 logged out. Waiting for processes to exit. Nov 18 18:26:38 oleg228-client systemd[1]: session-138.scope: Succeeded. Nov 18 18:26:38 oleg228-client systemd-logind[1015]: Removed session 138. Nov 18 18:27:01 oleg228-client sshd[30227]: Accepted publickey for root from 192.168.202.28 port 35464 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:01 oleg228-client systemd-logind[1015]: New session 139 of user root. Nov 18 18:27:01 oleg228-client systemd[1]: Started Session 139 of user root. Nov 18 18:27:01 oleg228-client sshd[30227]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:01 oleg228-client sshd[30240]: Received disconnect from 192.168.202.28 port 35464:11: disconnected by user Nov 18 18:27:01 oleg228-client sshd[30240]: Disconnected from user root 192.168.202.28 port 35464 Nov 18 18:27:01 oleg228-client sshd[30227]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:01 oleg228-client systemd[1]: session-139.scope: Succeeded. Nov 18 18:27:01 oleg228-client systemd-logind[1015]: Session 139 logged out. Waiting for processes to exit. Nov 18 18:27:01 oleg228-client systemd-logind[1015]: Removed session 139. Nov 18 18:27:03 oleg228-client sshd[30366]: Accepted publickey for root from 192.168.202.28 port 35478 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:03 oleg228-client systemd-logind[1015]: New session 140 of user root. Nov 18 18:27:03 oleg228-client systemd[1]: Started Session 140 of user root. Nov 18 18:27:03 oleg228-client sshd[30366]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:03 oleg228-client sshd[30379]: Received disconnect from 192.168.202.28 port 35478:11: disconnected by user Nov 18 18:27:03 oleg228-client sshd[30379]: Disconnected from user root 192.168.202.28 port 35478 Nov 18 18:27:03 oleg228-client sshd[30366]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:03 oleg228-client systemd-logind[1015]: Session 140 logged out. Waiting for processes to exit. Nov 18 18:27:03 oleg228-client systemd[1]: session-140.scope: Succeeded. Nov 18 18:27:03 oleg228-client systemd-logind[1015]: Removed session 140. Nov 18 18:27:04 oleg228-client sshd[30513]: Accepted publickey for root from 192.168.202.28 port 35482 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:04 oleg228-client systemd-logind[1015]: New session 141 of user root. Nov 18 18:27:04 oleg228-client systemd[1]: Started Session 141 of user root. Nov 18 18:27:04 oleg228-client sshd[30513]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:05 oleg228-client sshd[30526]: Received disconnect from 192.168.202.28 port 35482:11: disconnected by user Nov 18 18:27:05 oleg228-client sshd[30526]: Disconnected from user root 192.168.202.28 port 35482 Nov 18 18:27:05 oleg228-client sshd[30513]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:05 oleg228-client systemd[1]: session-141.scope: Succeeded. Nov 18 18:27:05 oleg228-client systemd-logind[1015]: Session 141 logged out. Waiting for processes to exit. Nov 18 18:27:05 oleg228-client systemd-logind[1015]: Removed session 141. Nov 18 18:27:06 oleg228-client sshd[30668]: Accepted publickey for root from 192.168.202.28 port 35498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:06 oleg228-client systemd-logind[1015]: New session 142 of user root. Nov 18 18:27:06 oleg228-client systemd[1]: Started Session 142 of user root. Nov 18 18:27:06 oleg228-client sshd[30668]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:07 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21e: drop open reply while close and open are both in flight ========================================================== 18:27:05 (1763508425) Nov 18 18:27:07 oleg228-client sshd[30681]: Received disconnect from 192.168.202.28 port 35498:11: disconnected by user Nov 18 18:27:07 oleg228-client sshd[30681]: Disconnected from user root 192.168.202.28 port 35498 Nov 18 18:27:07 oleg228-client sshd[30668]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:07 oleg228-client systemd[1]: session-142.scope: Succeeded. Nov 18 18:27:07 oleg228-client systemd-logind[1015]: Session 142 logged out. Waiting for processes to exit. Nov 18 18:27:07 oleg228-client systemd-logind[1015]: Removed session 142. Nov 18 18:27:31 oleg228-client sshd[30838]: Accepted publickey for root from 192.168.202.28 port 55174 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:31 oleg228-client systemd[1]: Started Session 143 of user root. Nov 18 18:27:31 oleg228-client systemd-logind[1015]: New session 143 of user root. Nov 18 18:27:31 oleg228-client sshd[30838]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:32 oleg228-client sshd[30851]: Received disconnect from 192.168.202.28 port 55174:11: disconnected by user Nov 18 18:27:32 oleg228-client sshd[30851]: Disconnected from user root 192.168.202.28 port 55174 Nov 18 18:27:32 oleg228-client sshd[30838]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:32 oleg228-client systemd-logind[1015]: Session 143 logged out. Waiting for processes to exit. Nov 18 18:27:32 oleg228-client systemd[1]: session-143.scope: Succeeded. Nov 18 18:27:32 oleg228-client systemd-logind[1015]: Removed session 143. Nov 18 18:27:34 oleg228-client sshd[30977]: Accepted publickey for root from 192.168.202.28 port 55186 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:34 oleg228-client systemd-logind[1015]: New session 144 of user root. Nov 18 18:27:34 oleg228-client systemd[1]: Started Session 144 of user root. Nov 18 18:27:34 oleg228-client sshd[30977]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:35 oleg228-client sshd[30990]: Received disconnect from 192.168.202.28 port 55186:11: disconnected by user Nov 18 18:27:35 oleg228-client sshd[30990]: Disconnected from user root 192.168.202.28 port 55186 Nov 18 18:27:35 oleg228-client sshd[30977]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:35 oleg228-client systemd[1]: session-144.scope: Succeeded. Nov 18 18:27:35 oleg228-client systemd-logind[1015]: Session 144 logged out. Waiting for processes to exit. Nov 18 18:27:35 oleg228-client systemd-logind[1015]: Removed session 144. Nov 18 18:27:36 oleg228-client sshd[31125]: Accepted publickey for root from 192.168.202.28 port 55192 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:27:36 oleg228-client systemd[1]: Started Session 145 of user root. Nov 18 18:27:36 oleg228-client systemd-logind[1015]: New session 145 of user root. Nov 18 18:27:36 oleg228-client sshd[31125]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:27:37 oleg228-client sshd[31138]: Received disconnect from 192.168.202.28 port 55192:11: disconnected by user Nov 18 18:27:37 oleg228-client sshd[31138]: Disconnected from user root 192.168.202.28 port 55192 Nov 18 18:27:37 oleg228-client sshd[31125]: pam_unix(sshd:session): session closed for user root Nov 18 18:27:37 oleg228-client systemd[1]: session-145.scope: Succeeded. Nov 18 18:27:37 oleg228-client systemd-logind[1015]: Session 145 logged out. Waiting for processes to exit. Nov 18 18:27:37 oleg228-client systemd-logind[1015]: Removed session 145. Nov 18 18:29:26 oleg228-client kernel: Lustre: 30729:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763508428/real 1763508428] req@ffff9ccbc8b8ca80 x1849171034568832/t0(0) o36->lustre-MDT0000-mdc-ffff9ccbc551f800@192.168.202.128@tcp:12/10 lens 488/512 e 0 to 1 dl 1763508566 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 Nov 18 18:29:26 oleg228-client kernel: Lustre: 30729:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 13 previous similar messages Nov 18 18:29:27 oleg228-client sshd[31297]: Accepted publickey for root from 192.168.202.28 port 54888 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:29:28 oleg228-client systemd[1]: Started Session 146 of user root. Nov 18 18:29:28 oleg228-client systemd-logind[1015]: New session 146 of user root. Nov 18 18:29:28 oleg228-client sshd[31297]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:29:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21f: drop both reply while close and open are both in flight ========================================================== 18:29:26 (1763508566) Nov 18 18:29:28 oleg228-client sshd[31310]: Received disconnect from 192.168.202.28 port 54888:11: disconnected by user Nov 18 18:29:28 oleg228-client sshd[31310]: Disconnected from user root 192.168.202.28 port 54888 Nov 18 18:29:28 oleg228-client sshd[31297]: pam_unix(sshd:session): session closed for user root Nov 18 18:29:28 oleg228-client systemd[1]: session-146.scope: Succeeded. Nov 18 18:29:28 oleg228-client systemd-logind[1015]: Session 146 logged out. Waiting for processes to exit. Nov 18 18:29:28 oleg228-client systemd-logind[1015]: Removed session 146. Nov 18 18:29:47 oleg228-client sshd[31482]: Accepted publickey for root from 192.168.202.28 port 44304 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:29:47 oleg228-client systemd[1]: Started Session 147 of user root. Nov 18 18:29:47 oleg228-client systemd-logind[1015]: New session 147 of user root. Nov 18 18:29:47 oleg228-client sshd[31482]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:29:47 oleg228-client sshd[31495]: Received disconnect from 192.168.202.28 port 44304:11: disconnected by user Nov 18 18:29:47 oleg228-client sshd[31495]: Disconnected from user root 192.168.202.28 port 44304 Nov 18 18:29:47 oleg228-client sshd[31482]: pam_unix(sshd:session): session closed for user root Nov 18 18:29:47 oleg228-client systemd[1]: session-147.scope: Succeeded. Nov 18 18:29:47 oleg228-client systemd-logind[1015]: Session 147 logged out. Waiting for processes to exit. Nov 18 18:29:47 oleg228-client systemd-logind[1015]: Removed session 147. Nov 18 18:29:48 oleg228-client sshd[31622]: Accepted publickey for root from 192.168.202.28 port 44316 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:29:48 oleg228-client systemd-logind[1015]: New session 148 of user root. Nov 18 18:29:48 oleg228-client systemd[1]: Started Session 148 of user root. Nov 18 18:29:48 oleg228-client sshd[31622]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:29:48 oleg228-client sshd[31635]: Received disconnect from 192.168.202.28 port 44316:11: disconnected by user Nov 18 18:29:49 oleg228-client sshd[31635]: Disconnected from user root 192.168.202.28 port 44316 Nov 18 18:29:49 oleg228-client sshd[31622]: pam_unix(sshd:session): session closed for user root Nov 18 18:29:49 oleg228-client systemd-logind[1015]: Session 148 logged out. Waiting for processes to exit. Nov 18 18:29:49 oleg228-client systemd[1]: session-148.scope: Succeeded. Nov 18 18:29:49 oleg228-client systemd-logind[1015]: Removed session 148. Nov 18 18:29:49 oleg228-client sshd[31768]: Accepted publickey for root from 192.168.202.28 port 44326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:29:50 oleg228-client systemd-logind[1015]: New session 149 of user root. Nov 18 18:29:50 oleg228-client systemd[1]: Started Session 149 of user root. Nov 18 18:29:50 oleg228-client sshd[31768]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:29:50 oleg228-client sshd[31781]: Received disconnect from 192.168.202.28 port 44326:11: disconnected by user Nov 18 18:29:50 oleg228-client sshd[31781]: Disconnected from user root 192.168.202.28 port 44326 Nov 18 18:29:50 oleg228-client sshd[31768]: pam_unix(sshd:session): session closed for user root Nov 18 18:29:50 oleg228-client systemd[1]: session-149.scope: Succeeded. Nov 18 18:29:50 oleg228-client systemd-logind[1015]: Session 149 logged out. Waiting for processes to exit. Nov 18 18:29:50 oleg228-client systemd-logind[1015]: Removed session 149. Nov 18 18:29:51 oleg228-client sshd[31923]: Accepted publickey for root from 192.168.202.28 port 44036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:29:51 oleg228-client systemd[1]: Started Session 150 of user root. Nov 18 18:29:51 oleg228-client systemd-logind[1015]: New session 150 of user root. Nov 18 18:29:51 oleg228-client sshd[31923]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:29:52 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21g: drop open reply and close request while close and open are both in flight ========================================================== 18:29:50 (1763508590) Nov 18 18:29:52 oleg228-client sshd[31936]: Received disconnect from 192.168.202.28 port 44036:11: disconnected by user Nov 18 18:29:52 oleg228-client sshd[31936]: Disconnected from user root 192.168.202.28 port 44036 Nov 18 18:29:52 oleg228-client sshd[31923]: pam_unix(sshd:session): session closed for user root Nov 18 18:29:52 oleg228-client systemd[1]: session-150.scope: Succeeded. Nov 18 18:29:52 oleg228-client systemd-logind[1015]: Session 150 logged out. Waiting for processes to exit. Nov 18 18:29:52 oleg228-client systemd-logind[1015]: Removed session 150. Nov 18 18:30:12 oleg228-client sshd[32108]: Accepted publickey for root from 192.168.202.28 port 59706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:12 oleg228-client systemd-logind[1015]: New session 151 of user root. Nov 18 18:30:12 oleg228-client systemd[1]: Started Session 151 of user root. Nov 18 18:30:12 oleg228-client sshd[32108]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:12 oleg228-client sshd[32121]: Received disconnect from 192.168.202.28 port 59706:11: disconnected by user Nov 18 18:30:12 oleg228-client sshd[32121]: Disconnected from user root 192.168.202.28 port 59706 Nov 18 18:30:12 oleg228-client sshd[32108]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:12 oleg228-client systemd[1]: session-151.scope: Succeeded. Nov 18 18:30:12 oleg228-client systemd-logind[1015]: Session 151 logged out. Waiting for processes to exit. Nov 18 18:30:12 oleg228-client systemd-logind[1015]: Removed session 151. Nov 18 18:30:13 oleg228-client sshd[32247]: Accepted publickey for root from 192.168.202.28 port 59722 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:13 oleg228-client systemd-logind[1015]: New session 152 of user root. Nov 18 18:30:13 oleg228-client systemd[1]: Started Session 152 of user root. Nov 18 18:30:13 oleg228-client sshd[32247]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:14 oleg228-client sshd[32260]: Received disconnect from 192.168.202.28 port 59722:11: disconnected by user Nov 18 18:30:14 oleg228-client sshd[32260]: Disconnected from user root 192.168.202.28 port 59722 Nov 18 18:30:14 oleg228-client sshd[32247]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:14 oleg228-client systemd[1]: session-152.scope: Succeeded. Nov 18 18:30:14 oleg228-client systemd-logind[1015]: Session 152 logged out. Waiting for processes to exit. Nov 18 18:30:14 oleg228-client systemd-logind[1015]: Removed session 152. Nov 18 18:30:15 oleg228-client sshd[32393]: Accepted publickey for root from 192.168.202.28 port 59730 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:15 oleg228-client systemd-logind[1015]: New session 153 of user root. Nov 18 18:30:15 oleg228-client systemd[1]: Started Session 153 of user root. Nov 18 18:30:15 oleg228-client sshd[32393]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:15 oleg228-client sshd[32406]: Received disconnect from 192.168.202.28 port 59730:11: disconnected by user Nov 18 18:30:15 oleg228-client sshd[32406]: Disconnected from user root 192.168.202.28 port 59730 Nov 18 18:30:15 oleg228-client sshd[32393]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:16 oleg228-client systemd[1]: session-153.scope: Succeeded. Nov 18 18:30:16 oleg228-client systemd-logind[1015]: Session 153 logged out. Waiting for processes to exit. Nov 18 18:30:16 oleg228-client systemd-logind[1015]: Removed session 153. Nov 18 18:30:17 oleg228-client sshd[32549]: Accepted publickey for root from 192.168.202.28 port 59732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:17 oleg228-client systemd-logind[1015]: New session 154 of user root. Nov 18 18:30:17 oleg228-client systemd[1]: Started Session 154 of user root. Nov 18 18:30:17 oleg228-client sshd[32549]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:17 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 21h: drop open request and close reply while close and open are both in flight ========================================================== 18:30:16 (1763508616) Nov 18 18:30:17 oleg228-client sshd[32562]: Received disconnect from 192.168.202.28 port 59732:11: disconnected by user Nov 18 18:30:17 oleg228-client sshd[32562]: Disconnected from user root 192.168.202.28 port 59732 Nov 18 18:30:17 oleg228-client sshd[32549]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:17 oleg228-client systemd[1]: session-154.scope: Succeeded. Nov 18 18:30:17 oleg228-client systemd-logind[1015]: Session 154 logged out. Waiting for processes to exit. Nov 18 18:30:17 oleg228-client systemd-logind[1015]: Removed session 154. Nov 18 18:30:38 oleg228-client sshd[32734]: Accepted publickey for root from 192.168.202.28 port 46048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:38 oleg228-client systemd-logind[1015]: New session 155 of user root. Nov 18 18:30:38 oleg228-client systemd[1]: Started Session 155 of user root. Nov 18 18:30:38 oleg228-client sshd[32734]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:38 oleg228-client sshd[32747]: Received disconnect from 192.168.202.28 port 46048:11: disconnected by user Nov 18 18:30:38 oleg228-client sshd[32747]: Disconnected from user root 192.168.202.28 port 46048 Nov 18 18:30:38 oleg228-client sshd[32734]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:38 oleg228-client systemd[1]: session-155.scope: Succeeded. Nov 18 18:30:38 oleg228-client systemd-logind[1015]: Session 155 logged out. Waiting for processes to exit. Nov 18 18:30:38 oleg228-client systemd-logind[1015]: Removed session 155. Nov 18 18:30:39 oleg228-client sshd[32873]: Accepted publickey for root from 192.168.202.28 port 46060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:39 oleg228-client systemd[1]: Started Session 156 of user root. Nov 18 18:30:39 oleg228-client systemd-logind[1015]: New session 156 of user root. Nov 18 18:30:39 oleg228-client sshd[32873]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:39 oleg228-client sshd[32886]: Received disconnect from 192.168.202.28 port 46060:11: disconnected by user Nov 18 18:30:39 oleg228-client sshd[32886]: Disconnected from user root 192.168.202.28 port 46060 Nov 18 18:30:39 oleg228-client sshd[32873]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:40 oleg228-client systemd-logind[1015]: Session 156 logged out. Waiting for processes to exit. Nov 18 18:30:40 oleg228-client systemd[1]: session-156.scope: Succeeded. Nov 18 18:30:40 oleg228-client systemd-logind[1015]: Removed session 156. Nov 18 18:30:40 oleg228-client sshd[33019]: Accepted publickey for root from 192.168.202.28 port 38056 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:41 oleg228-client systemd[1]: Started Session 157 of user root. Nov 18 18:30:41 oleg228-client systemd-logind[1015]: New session 157 of user root. Nov 18 18:30:41 oleg228-client sshd[33019]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:41 oleg228-client sshd[33032]: Received disconnect from 192.168.202.28 port 38056:11: disconnected by user Nov 18 18:30:41 oleg228-client sshd[33032]: Disconnected from user root 192.168.202.28 port 38056 Nov 18 18:30:41 oleg228-client sshd[33019]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:41 oleg228-client systemd[1]: session-157.scope: Succeeded. Nov 18 18:30:41 oleg228-client systemd-logind[1015]: Session 157 logged out. Waiting for processes to exit. Nov 18 18:30:41 oleg228-client systemd-logind[1015]: Removed session 157. Nov 18 18:30:42 oleg228-client sshd[33174]: Accepted publickey for root from 192.168.202.28 port 38064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:30:42 oleg228-client systemd-logind[1015]: New session 158 of user root. Nov 18 18:30:42 oleg228-client systemd[1]: Started Session 158 of user root. Nov 18 18:30:42 oleg228-client sshd[33174]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:30:43 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 22: drop close request and do mknod ========================================================== 18:30:41 (1763508641) Nov 18 18:30:43 oleg228-client sshd[33187]: Received disconnect from 192.168.202.28 port 38064:11: disconnected by user Nov 18 18:30:43 oleg228-client sshd[33187]: Disconnected from user root 192.168.202.28 port 38064 Nov 18 18:30:43 oleg228-client sshd[33174]: pam_unix(sshd:session): session closed for user root Nov 18 18:30:43 oleg228-client systemd-logind[1015]: Session 158 logged out. Waiting for processes to exit. Nov 18 18:30:43 oleg228-client systemd[1]: session-158.scope: Succeeded. Nov 18 18:30:43 oleg228-client systemd-logind[1015]: Removed session 158. Nov 18 18:31:01 oleg228-client sshd[33339]: Accepted publickey for root from 192.168.202.28 port 43750 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:01 oleg228-client systemd-logind[1015]: New session 159 of user root. Nov 18 18:31:01 oleg228-client systemd[1]: Started Session 159 of user root. Nov 18 18:31:01 oleg228-client sshd[33339]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:01 oleg228-client sshd[33352]: Received disconnect from 192.168.202.28 port 43750:11: disconnected by user Nov 18 18:31:01 oleg228-client sshd[33352]: Disconnected from user root 192.168.202.28 port 43750 Nov 18 18:31:01 oleg228-client sshd[33339]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:01 oleg228-client systemd[1]: session-159.scope: Succeeded. Nov 18 18:31:01 oleg228-client systemd-logind[1015]: Session 159 logged out. Waiting for processes to exit. Nov 18 18:31:01 oleg228-client systemd-logind[1015]: Removed session 159. Nov 18 18:31:03 oleg228-client sshd[33478]: Accepted publickey for root from 192.168.202.28 port 43752 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:03 oleg228-client systemd-logind[1015]: New session 160 of user root. Nov 18 18:31:03 oleg228-client systemd[1]: Started Session 160 of user root. Nov 18 18:31:03 oleg228-client sshd[33478]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:03 oleg228-client sshd[33493]: Received disconnect from 192.168.202.28 port 43752:11: disconnected by user Nov 18 18:31:03 oleg228-client sshd[33493]: Disconnected from user root 192.168.202.28 port 43752 Nov 18 18:31:03 oleg228-client sshd[33478]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:03 oleg228-client systemd-logind[1015]: Session 160 logged out. Waiting for processes to exit. Nov 18 18:31:03 oleg228-client systemd[1]: session-160.scope: Succeeded. Nov 18 18:31:03 oleg228-client systemd-logind[1015]: Removed session 160. Nov 18 18:31:04 oleg228-client sshd[33626]: Accepted publickey for root from 192.168.202.28 port 43764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:04 oleg228-client systemd-logind[1015]: New session 161 of user root. Nov 18 18:31:04 oleg228-client systemd[1]: Started Session 161 of user root. Nov 18 18:31:04 oleg228-client sshd[33626]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:05 oleg228-client sshd[33639]: Received disconnect from 192.168.202.28 port 43764:11: disconnected by user Nov 18 18:31:05 oleg228-client sshd[33639]: Disconnected from user root 192.168.202.28 port 43764 Nov 18 18:31:05 oleg228-client sshd[33626]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:05 oleg228-client systemd-logind[1015]: Session 161 logged out. Waiting for processes to exit. Nov 18 18:31:05 oleg228-client systemd[1]: session-161.scope: Succeeded. Nov 18 18:31:05 oleg228-client systemd-logind[1015]: Removed session 161. Nov 18 18:31:06 oleg228-client sshd[33781]: Accepted publickey for root from 192.168.202.28 port 43774 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:06 oleg228-client systemd-logind[1015]: New session 162 of user root. Nov 18 18:31:06 oleg228-client systemd[1]: Started Session 162 of user root. Nov 18 18:31:06 oleg228-client sshd[33781]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 23: client hang when close a file after mds crash ========================================================== 18:31:05 (1763508665) Nov 18 18:31:06 oleg228-client sshd[33794]: Received disconnect from 192.168.202.28 port 43774:11: disconnected by user Nov 18 18:31:06 oleg228-client sshd[33794]: Disconnected from user root 192.168.202.28 port 43774 Nov 18 18:31:06 oleg228-client sshd[33781]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:07 oleg228-client systemd[1]: session-162.scope: Succeeded. Nov 18 18:31:07 oleg228-client systemd-logind[1015]: Session 162 logged out. Waiting for processes to exit. Nov 18 18:31:07 oleg228-client systemd-logind[1015]: Removed session 162. Nov 18 18:31:36 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:31:36 oleg228-client systemd[1]: Starting dnf makecache... Nov 18 18:31:36 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25c86d16 to 0x2622672b25c89492 Nov 18 18:31:43 oleg228-client sshd[34131]: Accepted publickey for root from 192.168.202.28 port 56088 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:43 oleg228-client systemd[1]: Started Session 163 of user root. Nov 18 18:31:43 oleg228-client sshd[34131]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:43 oleg228-client systemd-logind[1015]: New session 163 of user root. Nov 18 18:31:43 oleg228-client sshd[34144]: Received disconnect from 192.168.202.28 port 56088:11: disconnected by user Nov 18 18:31:43 oleg228-client sshd[34144]: Disconnected from user root 192.168.202.28 port 56088 Nov 18 18:31:43 oleg228-client sshd[34131]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:43 oleg228-client systemd[1]: session-163.scope: Succeeded. Nov 18 18:31:43 oleg228-client systemd-logind[1015]: Session 163 logged out. Waiting for processes to exit. Nov 18 18:31:43 oleg228-client systemd-logind[1015]: Removed session 163. Nov 18 18:31:43 oleg228-client dnf[34052]: Failed determining last makecache time. Nov 18 18:31:44 oleg228-client dnf[34052]: [Errno 30] Read-only file system: '/var/cache/dnf/metadata_lock.pid' Nov 18 18:31:44 oleg228-client dnf[34052]: Failed to store expired repos cache: [Errno 30] Read-only file system: '/var/cache/dnf/expired_repos.json' Nov 18 18:31:45 oleg228-client systemd[1]: dnf-makecache.service: Main process exited, code=exited, status=1/FAILURE Nov 18 18:31:45 oleg228-client systemd[1]: dnf-makecache.service: Failed with result 'exit-code'. Nov 18 18:31:45 oleg228-client systemd[1]: Failed to start dnf makecache. Nov 18 18:31:46 oleg228-client sshd[34368]: Accepted publickey for root from 192.168.202.28 port 56090 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:46 oleg228-client systemd-logind[1015]: New session 164 of user root. Nov 18 18:31:46 oleg228-client systemd[1]: Started Session 164 of user root. Nov 18 18:31:46 oleg228-client sshd[34368]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:46 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 18:31:46 oleg228-client sshd[34381]: Received disconnect from 192.168.202.28 port 56090:11: disconnected by user Nov 18 18:31:46 oleg228-client sshd[34381]: Disconnected from user root 192.168.202.28 port 56090 Nov 18 18:31:46 oleg228-client sshd[34368]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:46 oleg228-client systemd[1]: session-164.scope: Succeeded. Nov 18 18:31:46 oleg228-client systemd-logind[1015]: Session 164 logged out. Waiting for processes to exit. Nov 18 18:31:46 oleg228-client systemd-logind[1015]: Removed session 164. Nov 18 18:31:47 oleg228-client sshd[34525]: Accepted publickey for root from 192.168.202.28 port 56102 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:47 oleg228-client systemd-logind[1015]: New session 165 of user root. Nov 18 18:31:47 oleg228-client systemd[1]: Started Session 165 of user root. Nov 18 18:31:47 oleg228-client sshd[34525]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:48 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 18:31:48 oleg228-client sshd[34538]: Received disconnect from 192.168.202.28 port 56102:11: disconnected by user Nov 18 18:31:48 oleg228-client sshd[34538]: Disconnected from user root 192.168.202.28 port 56102 Nov 18 18:31:48 oleg228-client sshd[34525]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:48 oleg228-client systemd[1]: session-165.scope: Succeeded. Nov 18 18:31:48 oleg228-client systemd-logind[1015]: Session 165 logged out. Waiting for processes to exit. Nov 18 18:31:48 oleg228-client systemd-logind[1015]: Removed session 165. Nov 18 18:31:49 oleg228-client sshd[34579]: Accepted publickey for root from 192.168.202.28 port 56108 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:49 oleg228-client systemd-logind[1015]: New session 166 of user root. Nov 18 18:31:49 oleg228-client systemd[1]: Started Session 166 of user root. Nov 18 18:31:49 oleg228-client sshd[34579]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:50 oleg228-client sshd[34592]: Received disconnect from 192.168.202.28 port 56108:11: disconnected by user Nov 18 18:31:50 oleg228-client sshd[34592]: Disconnected from user root 192.168.202.28 port 56108 Nov 18 18:31:50 oleg228-client sshd[34579]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:50 oleg228-client systemd-logind[1015]: Session 166 logged out. Waiting for processes to exit. Nov 18 18:31:50 oleg228-client systemd[1]: session-166.scope: Succeeded. Nov 18 18:31:50 oleg228-client systemd-logind[1015]: Removed session 166. Nov 18 18:31:51 oleg228-client sshd[34711]: Accepted publickey for root from 192.168.202.28 port 57380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:51 oleg228-client systemd[1]: Started Session 167 of user root. Nov 18 18:31:51 oleg228-client systemd-logind[1015]: New session 167 of user root. Nov 18 18:31:51 oleg228-client sshd[34711]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:51 oleg228-client sshd[34724]: Received disconnect from 192.168.202.28 port 57380:11: disconnected by user Nov 18 18:31:51 oleg228-client sshd[34724]: Disconnected from user root 192.168.202.28 port 57380 Nov 18 18:31:51 oleg228-client sshd[34711]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:51 oleg228-client systemd[1]: session-167.scope: Succeeded. Nov 18 18:31:51 oleg228-client systemd-logind[1015]: Session 167 logged out. Waiting for processes to exit. Nov 18 18:31:51 oleg228-client systemd-logind[1015]: Removed session 167. Nov 18 18:31:52 oleg228-client sshd[34851]: Accepted publickey for root from 192.168.202.28 port 57386 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:52 oleg228-client systemd-logind[1015]: New session 168 of user root. Nov 18 18:31:52 oleg228-client systemd[1]: Started Session 168 of user root. Nov 18 18:31:52 oleg228-client sshd[34851]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:52 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:31:52 oleg228-client sshd[34865]: Received disconnect from 192.168.202.28 port 57386:11: disconnected by user Nov 18 18:31:52 oleg228-client sshd[34865]: Disconnected from user root 192.168.202.28 port 57386 Nov 18 18:31:52 oleg228-client sshd[34851]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:53 oleg228-client systemd[1]: session-168.scope: Succeeded. Nov 18 18:31:53 oleg228-client systemd-logind[1015]: Session 168 logged out. Waiting for processes to exit. Nov 18 18:31:53 oleg228-client systemd-logind[1015]: Removed session 168. Nov 18 18:31:53 oleg228-client sshd[34998]: Accepted publickey for root from 192.168.202.28 port 57394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:53 oleg228-client systemd-logind[1015]: New session 169 of user root. Nov 18 18:31:53 oleg228-client systemd[1]: Started Session 169 of user root. Nov 18 18:31:53 oleg228-client sshd[34998]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:54 oleg228-client sshd[35011]: Received disconnect from 192.168.202.28 port 57394:11: disconnected by user Nov 18 18:31:54 oleg228-client sshd[35011]: Disconnected from user root 192.168.202.28 port 57394 Nov 18 18:31:54 oleg228-client sshd[34998]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:54 oleg228-client systemd-logind[1015]: Session 169 logged out. Waiting for processes to exit. Nov 18 18:31:54 oleg228-client systemd[1]: session-169.scope: Succeeded. Nov 18 18:31:54 oleg228-client systemd-logind[1015]: Removed session 169. Nov 18 18:31:55 oleg228-client sshd[35153]: Accepted publickey for root from 192.168.202.28 port 57402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:55 oleg228-client systemd-logind[1015]: New session 170 of user root. Nov 18 18:31:55 oleg228-client systemd[1]: Started Session 170 of user root. Nov 18 18:31:55 oleg228-client sshd[35153]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:55 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24a: fsync error (should return error) ========================================================== 18:31:54 (1763508714) Nov 18 18:31:55 oleg228-client sshd[35166]: Received disconnect from 192.168.202.28 port 57402:11: disconnected by user Nov 18 18:31:55 oleg228-client sshd[35166]: Disconnected from user root 192.168.202.28 port 57402 Nov 18 18:31:55 oleg228-client sshd[35153]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:55 oleg228-client systemd[1]: session-170.scope: Succeeded. Nov 18 18:31:55 oleg228-client systemd-logind[1015]: Session 170 logged out. Waiting for processes to exit. Nov 18 18:31:55 oleg228-client systemd-logind[1015]: Removed session 170. Nov 18 18:31:57 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: operation ost_write to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:31:57 oleg228-client kernel: LustreError: Skipped 1 previous similar message Nov 18 18:31:57 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:31:57 oleg228-client kernel: Lustre: 2409:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.128@tcp:/lustre/fid: [0x240000402:0x8:0x0]// may get corrupted (rc -5) Nov 18 18:31:58 oleg228-client sshd[35351]: Accepted publickey for root from 192.168.202.28 port 57416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:31:58 oleg228-client systemd-logind[1015]: New session 171 of user root. Nov 18 18:31:58 oleg228-client systemd[1]: Started Session 171 of user root. Nov 18 18:31:58 oleg228-client sshd[35351]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:31:58 oleg228-client sshd[35364]: Received disconnect from 192.168.202.28 port 57416:11: disconnected by user Nov 18 18:31:58 oleg228-client sshd[35364]: Disconnected from user root 192.168.202.28 port 57416 Nov 18 18:31:58 oleg228-client sshd[35351]: pam_unix(sshd:session): session closed for user root Nov 18 18:31:59 oleg228-client systemd[1]: session-171.scope: Succeeded. Nov 18 18:31:59 oleg228-client systemd-logind[1015]: Session 171 logged out. Waiting for processes to exit. Nov 18 18:31:59 oleg228-client systemd-logind[1015]: Removed session 171. Nov 18 18:32:00 oleg228-client sshd[35491]: Accepted publickey for root from 192.168.202.28 port 57418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:00 oleg228-client systemd[1]: Started Session 172 of user root. Nov 18 18:32:00 oleg228-client systemd-logind[1015]: New session 172 of user root. Nov 18 18:32:00 oleg228-client sshd[35491]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:00 oleg228-client sshd[35504]: Received disconnect from 192.168.202.28 port 57418:11: disconnected by user Nov 18 18:32:00 oleg228-client sshd[35504]: Disconnected from user root 192.168.202.28 port 57418 Nov 18 18:32:00 oleg228-client sshd[35491]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:00 oleg228-client systemd-logind[1015]: Session 172 logged out. Waiting for processes to exit. Nov 18 18:32:00 oleg228-client systemd[1]: session-172.scope: Succeeded. Nov 18 18:32:00 oleg228-client systemd-logind[1015]: Removed session 172. Nov 18 18:32:01 oleg228-client sshd[35637]: Accepted publickey for root from 192.168.202.28 port 58276 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:01 oleg228-client systemd-logind[1015]: New session 173 of user root. Nov 18 18:32:01 oleg228-client systemd[1]: Started Session 173 of user root. Nov 18 18:32:01 oleg228-client sshd[35637]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:02 oleg228-client sshd[35650]: Received disconnect from 192.168.202.28 port 58276:11: disconnected by user Nov 18 18:32:02 oleg228-client sshd[35650]: Disconnected from user root 192.168.202.28 port 58276 Nov 18 18:32:02 oleg228-client sshd[35637]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:02 oleg228-client systemd[1]: session-173.scope: Succeeded. Nov 18 18:32:02 oleg228-client systemd-logind[1015]: Session 173 logged out. Waiting for processes to exit. Nov 18 18:32:02 oleg228-client systemd-logind[1015]: Removed session 173. Nov 18 18:32:03 oleg228-client sshd[35792]: Accepted publickey for root from 192.168.202.28 port 58284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:03 oleg228-client systemd[1]: Started Session 174 of user root. Nov 18 18:32:03 oleg228-client systemd-logind[1015]: New session 174 of user root. Nov 18 18:32:03 oleg228-client sshd[35792]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:03 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 24b: test dirty page discard due to client eviction ========================================================== 18:32:02 (1763508722) Nov 18 18:32:03 oleg228-client sshd[35805]: Received disconnect from 192.168.202.28 port 58284:11: disconnected by user Nov 18 18:32:03 oleg228-client sshd[35805]: Disconnected from user root 192.168.202.28 port 58284 Nov 18 18:32:03 oleg228-client sshd[35792]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:04 oleg228-client systemd[1]: session-174.scope: Succeeded. Nov 18 18:32:04 oleg228-client systemd-logind[1015]: Session 174 logged out. Waiting for processes to exit. Nov 18 18:32:04 oleg228-client systemd-logind[1015]: Removed session 174. Nov 18 18:32:05 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 18:32:05 oleg228-client kernel: Lustre: 2407:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.128@tcp:/lustre/fid: [0x240000402:0xb:0x0]// may get corrupted (rc -108) Nov 18 18:32:07 oleg228-client sshd[35997]: Accepted publickey for root from 192.168.202.28 port 58298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:07 oleg228-client systemd-logind[1015]: New session 175 of user root. Nov 18 18:32:07 oleg228-client systemd[1]: Started Session 175 of user root. Nov 18 18:32:07 oleg228-client sshd[35997]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:07 oleg228-client sshd[36010]: Received disconnect from 192.168.202.28 port 58298:11: disconnected by user Nov 18 18:32:07 oleg228-client sshd[36010]: Disconnected from user root 192.168.202.28 port 58298 Nov 18 18:32:07 oleg228-client sshd[35997]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:08 oleg228-client systemd[1]: session-175.scope: Succeeded. Nov 18 18:32:08 oleg228-client systemd-logind[1015]: Session 175 logged out. Waiting for processes to exit. Nov 18 18:32:08 oleg228-client systemd-logind[1015]: Removed session 175. Nov 18 18:32:09 oleg228-client sshd[36136]: Accepted publickey for root from 192.168.202.28 port 58310 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:09 oleg228-client systemd-logind[1015]: New session 176 of user root. Nov 18 18:32:09 oleg228-client systemd[1]: Started Session 176 of user root. Nov 18 18:32:09 oleg228-client sshd[36136]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:09 oleg228-client sshd[36149]: Received disconnect from 192.168.202.28 port 58310:11: disconnected by user Nov 18 18:32:09 oleg228-client sshd[36149]: Disconnected from user root 192.168.202.28 port 58310 Nov 18 18:32:09 oleg228-client sshd[36136]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:09 oleg228-client systemd[1]: session-176.scope: Succeeded. Nov 18 18:32:09 oleg228-client systemd-logind[1015]: Session 176 logged out. Waiting for processes to exit. Nov 18 18:32:09 oleg228-client systemd-logind[1015]: Removed session 176. Nov 18 18:32:10 oleg228-client sshd[36282]: Accepted publickey for root from 192.168.202.28 port 58320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:10 oleg228-client systemd-logind[1015]: New session 177 of user root. Nov 18 18:32:10 oleg228-client systemd[1]: Started Session 177 of user root. Nov 18 18:32:10 oleg228-client sshd[36282]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:11 oleg228-client sshd[36296]: Received disconnect from 192.168.202.28 port 58320:11: disconnected by user Nov 18 18:32:11 oleg228-client sshd[36296]: Disconnected from user root 192.168.202.28 port 58320 Nov 18 18:32:11 oleg228-client sshd[36282]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:11 oleg228-client systemd[1]: session-177.scope: Succeeded. Nov 18 18:32:11 oleg228-client systemd-logind[1015]: Session 177 logged out. Waiting for processes to exit. Nov 18 18:32:11 oleg228-client systemd-logind[1015]: Removed session 177. Nov 18 18:32:12 oleg228-client sshd[36438]: Accepted publickey for root from 192.168.202.28 port 44738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:12 oleg228-client systemd-logind[1015]: New session 178 of user root. Nov 18 18:32:12 oleg228-client systemd[1]: Started Session 178 of user root. Nov 18 18:32:12 oleg228-client sshd[36438]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:13 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26a: evict dead exports =========== 18:32:11 (1763508731) Nov 18 18:32:13 oleg228-client sshd[36451]: Received disconnect from 192.168.202.28 port 44738:11: disconnected by user Nov 18 18:32:13 oleg228-client sshd[36451]: Disconnected from user root 192.168.202.28 port 44738 Nov 18 18:32:13 oleg228-client sshd[36438]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:13 oleg228-client systemd[1]: session-178.scope: Succeeded. Nov 18 18:32:13 oleg228-client systemd-logind[1015]: Session 178 logged out. Waiting for processes to exit. Nov 18 18:32:13 oleg228-client systemd-logind[1015]: Removed session 178. Nov 18 18:32:14 oleg228-client sshd[36671]: Accepted publickey for root from 192.168.202.28 port 44748 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:14 oleg228-client systemd-logind[1015]: New session 179 of user root. Nov 18 18:32:14 oleg228-client systemd[1]: Started Session 179 of user root. Nov 18 18:32:14 oleg228-client sshd[36671]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:14 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26a msg and ost1 are at the same node Nov 18 18:32:14 oleg228-client sshd[36684]: Received disconnect from 192.168.202.28 port 44748:11: disconnected by user Nov 18 18:32:14 oleg228-client sshd[36684]: Disconnected from user root 192.168.202.28 port 44748 Nov 18 18:32:14 oleg228-client sshd[36671]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:15 oleg228-client systemd-logind[1015]: Session 179 logged out. Waiting for processes to exit. Nov 18 18:32:15 oleg228-client systemd[1]: session-179.scope: Succeeded. Nov 18 18:32:15 oleg228-client systemd-logind[1015]: Removed session 179. Nov 18 18:32:16 oleg228-client sshd[36826]: Accepted publickey for root from 192.168.202.28 port 44750 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:16 oleg228-client systemd[1]: Started Session 180 of user root. Nov 18 18:32:16 oleg228-client systemd-logind[1015]: New session 180 of user root. Nov 18 18:32:16 oleg228-client sshd[36826]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:16 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 26b: evict dead exports =========== 18:32:15 (1763508735) Nov 18 18:32:16 oleg228-client sshd[36839]: Received disconnect from 192.168.202.28 port 44750:11: disconnected by user Nov 18 18:32:16 oleg228-client sshd[36839]: Disconnected from user root 192.168.202.28 port 44750 Nov 18 18:32:16 oleg228-client sshd[36826]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:16 oleg228-client systemd[1]: session-180.scope: Succeeded. Nov 18 18:32:16 oleg228-client systemd-logind[1015]: Session 180 logged out. Waiting for processes to exit. Nov 18 18:32:17 oleg228-client systemd-logind[1015]: Removed session 180. Nov 18 18:32:18 oleg228-client sshd[36997]: Accepted publickey for root from 192.168.202.28 port 44764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:18 oleg228-client systemd[1]: Started Session 181 of user root. Nov 18 18:32:18 oleg228-client systemd-logind[1015]: New session 181 of user root. Nov 18 18:32:18 oleg228-client sshd[36997]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:18 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_26b msg and ost1 are at the same node Nov 18 18:32:18 oleg228-client sshd[37011]: Received disconnect from 192.168.202.28 port 44764:11: disconnected by user Nov 18 18:32:18 oleg228-client sshd[37011]: Disconnected from user root 192.168.202.28 port 44764 Nov 18 18:32:18 oleg228-client sshd[36997]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:18 oleg228-client systemd[1]: session-181.scope: Succeeded. Nov 18 18:32:18 oleg228-client systemd-logind[1015]: Session 181 logged out. Waiting for processes to exit. Nov 18 18:32:18 oleg228-client systemd-logind[1015]: Removed session 181. Nov 18 18:32:19 oleg228-client sshd[37152]: Accepted publickey for root from 192.168.202.28 port 44766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:32:19 oleg228-client systemd-logind[1015]: New session 182 of user root. Nov 18 18:32:19 oleg228-client systemd[1]: Started Session 182 of user root. Nov 18 18:32:19 oleg228-client sshd[37152]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:32:20 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 27: fail LOV while using OSC's ==== 18:32:18 (1763508738) Nov 18 18:32:20 oleg228-client sshd[37165]: Received disconnect from 192.168.202.28 port 44766:11: disconnected by user Nov 18 18:32:20 oleg228-client sshd[37165]: Disconnected from user root 192.168.202.28 port 44766 Nov 18 18:32:20 oleg228-client sshd[37152]: pam_unix(sshd:session): session closed for user root Nov 18 18:32:20 oleg228-client systemd[1]: session-182.scope: Succeeded. Nov 18 18:32:20 oleg228-client systemd-logind[1015]: Session 182 logged out. Waiting for processes to exit. Nov 18 18:32:20 oleg228-client systemd-logind[1015]: Removed session 182. Nov 18 18:32:23 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation mds_close to node 192.168.202.128@tcp failed: rc = -19 Nov 18 18:32:23 oleg228-client kernel: LustreError: Skipped 1 previous similar message Nov 18 18:32:43 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:32:43 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25c89492 to 0x2622672b25c8b14f Nov 18 18:32:43 oleg228-client kernel: Lustre: MGC192.168.202.128@tcp: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:32:43 oleg228-client kernel: Lustre: Skipped 13 previous similar messages Nov 18 18:34:35 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -19 Nov 18 18:34:35 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc551f800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:34:35 oleg228-client kernel: Lustre: Skipped 14 previous similar messages Nov 18 18:34:52 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:35:02 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25c8b14f to 0x2622672b25cb2e3a Nov 18 18:35:08 oleg228-client sshd[38213]: Accepted publickey for root from 192.168.202.28 port 38860 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:08 oleg228-client systemd-logind[1015]: New session 183 of user root. Nov 18 18:35:08 oleg228-client systemd[1]: Started Session 183 of user root. Nov 18 18:35:08 oleg228-client sshd[38213]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:35:08 oleg228-client sshd[38226]: Received disconnect from 192.168.202.28 port 38860:11: disconnected by user Nov 18 18:35:08 oleg228-client sshd[38226]: Disconnected from user root 192.168.202.28 port 38860 Nov 18 18:35:08 oleg228-client sshd[38213]: pam_unix(sshd:session): session closed for user root Nov 18 18:35:08 oleg228-client systemd-logind[1015]: Session 183 logged out. Waiting for processes to exit. Nov 18 18:35:08 oleg228-client systemd[1]: session-183.scope: Succeeded. Nov 18 18:35:08 oleg228-client systemd-logind[1015]: Removed session 183. Nov 18 18:35:09 oleg228-client sshd[38353]: Accepted publickey for root from 192.168.202.28 port 38872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:09 oleg228-client systemd-logind[1015]: New session 184 of user root. Nov 18 18:35:09 oleg228-client systemd[1]: Started Session 184 of user root. Nov 18 18:35:09 oleg228-client sshd[38353]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:35:09 oleg228-client sshd[38366]: Received disconnect from 192.168.202.28 port 38872:11: disconnected by user Nov 18 18:35:09 oleg228-client sshd[38366]: Disconnected from user root 192.168.202.28 port 38872 Nov 18 18:35:09 oleg228-client sshd[38353]: pam_unix(sshd:session): session closed for user root Nov 18 18:35:09 oleg228-client systemd[1]: session-184.scope: Succeeded. Nov 18 18:35:09 oleg228-client systemd-logind[1015]: Session 184 logged out. Waiting for processes to exit. Nov 18 18:35:09 oleg228-client systemd-logind[1015]: Removed session 184. Nov 18 18:35:10 oleg228-client sshd[38499]: Accepted publickey for root from 192.168.202.28 port 38874 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:10 oleg228-client systemd-logind[1015]: New session 185 of user root. Nov 18 18:35:10 oleg228-client systemd[1]: Started Session 185 of user root. Nov 18 18:35:10 oleg228-client sshd[38499]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:35:11 oleg228-client sshd[38512]: Received disconnect from 192.168.202.28 port 38874:11: disconnected by user Nov 18 18:35:11 oleg228-client sshd[38512]: Disconnected from user root 192.168.202.28 port 38874 Nov 18 18:35:11 oleg228-client sshd[38499]: pam_unix(sshd:session): session closed for user root Nov 18 18:35:11 oleg228-client systemd[1]: session-185.scope: Succeeded. Nov 18 18:35:11 oleg228-client systemd-logind[1015]: Session 185 logged out. Waiting for processes to exit. Nov 18 18:35:11 oleg228-client systemd-logind[1015]: Removed session 185. Nov 18 18:35:12 oleg228-client sshd[38655]: Accepted publickey for root from 192.168.202.28 port 33586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:12 oleg228-client systemd[1]: Started Session 186 of user root. Nov 18 18:35:12 oleg228-client systemd-logind[1015]: New session 186 of user root. Nov 18 18:35:12 oleg228-client sshd[38655]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:35:12 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 28: handle error adding new clients (bug 6086) ========================================================== 18:35:11 (1763508911) Nov 18 18:35:12 oleg228-client sshd[38668]: Received disconnect from 192.168.202.28 port 33586:11: disconnected by user Nov 18 18:35:12 oleg228-client sshd[38668]: Disconnected from user root 192.168.202.28 port 33586 Nov 18 18:35:12 oleg228-client sshd[38655]: pam_unix(sshd:session): session closed for user root Nov 18 18:35:12 oleg228-client systemd[1]: session-186.scope: Succeeded. Nov 18 18:35:12 oleg228-client systemd-logind[1015]: Session 186 logged out. Waiting for processes to exit. Nov 18 18:35:12 oleg228-client systemd-logind[1015]: Removed session 186. Nov 18 18:35:13 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 18:35:13 oleg228-client kernel: Lustre: Skipped 4 previous similar messages Nov 18 18:35:32 oleg228-client sshd[38762]: Accepted publickey for root from 192.168.202.28 port 56562 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:32 oleg228-client systemd[1]: Started Session 187 of user root. Nov 18 18:35:32 oleg228-client systemd-logind[1015]: New session 187 of user root. Nov 18 18:35:32 oleg228-client sshd[38762]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:35:33 oleg228-client sshd[38775]: Received disconnect from 192.168.202.28 port 56562:11: disconnected by user Nov 18 18:35:33 oleg228-client sshd[38775]: Disconnected from user root 192.168.202.28 port 56562 Nov 18 18:35:33 oleg228-client sshd[38762]: pam_unix(sshd:session): session closed for user root Nov 18 18:35:33 oleg228-client systemd[1]: session-187.scope: Succeeded. Nov 18 18:35:33 oleg228-client systemd-logind[1015]: Session 187 logged out. Waiting for processes to exit. Nov 18 18:35:33 oleg228-client systemd-logind[1015]: Removed session 187. Nov 18 18:35:55 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:35:55 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cb2e3a to 0x2622672b25cb351e Nov 18 18:35:59 oleg228-client sshd[39079]: Accepted publickey for root from 192.168.202.28 port 38394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:35:59 oleg228-client systemd-logind[1015]: New session 188 of user root. Nov 18 18:35:59 oleg228-client systemd[1]: Started Session 188 of user root. Nov 18 18:35:59 oleg228-client sshd[39079]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:00 oleg228-client sshd[39092]: Received disconnect from 192.168.202.28 port 38394:11: disconnected by user Nov 18 18:36:00 oleg228-client sshd[39092]: Disconnected from user root 192.168.202.28 port 38394 Nov 18 18:36:00 oleg228-client sshd[39079]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:00 oleg228-client systemd[1]: session-188.scope: Succeeded. Nov 18 18:36:00 oleg228-client systemd-logind[1015]: Session 188 logged out. Waiting for processes to exit. Nov 18 18:36:00 oleg228-client systemd-logind[1015]: Removed session 188. Nov 18 18:36:02 oleg228-client sshd[39315]: Accepted publickey for root from 192.168.202.28 port 40724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:02 oleg228-client systemd[1]: Started Session 189 of user root. Nov 18 18:36:02 oleg228-client systemd-logind[1015]: New session 189 of user root. Nov 18 18:36:02 oleg228-client sshd[39315]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:03 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 18:36:03 oleg228-client sshd[39328]: Received disconnect from 192.168.202.28 port 40724:11: disconnected by user Nov 18 18:36:03 oleg228-client sshd[39328]: Disconnected from user root 192.168.202.28 port 40724 Nov 18 18:36:03 oleg228-client sshd[39315]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:03 oleg228-client systemd[1]: session-189.scope: Succeeded. Nov 18 18:36:03 oleg228-client systemd-logind[1015]: Session 189 logged out. Waiting for processes to exit. Nov 18 18:36:03 oleg228-client systemd-logind[1015]: Removed session 189. Nov 18 18:36:04 oleg228-client sshd[39471]: Accepted publickey for root from 192.168.202.28 port 40740 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:04 oleg228-client systemd-logind[1015]: New session 190 of user root. Nov 18 18:36:04 oleg228-client systemd[1]: Started Session 190 of user root. Nov 18 18:36:04 oleg228-client sshd[39471]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:04 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 18:36:04 oleg228-client sshd[39484]: Received disconnect from 192.168.202.28 port 40740:11: disconnected by user Nov 18 18:36:04 oleg228-client sshd[39484]: Disconnected from user root 192.168.202.28 port 40740 Nov 18 18:36:04 oleg228-client sshd[39471]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:04 oleg228-client systemd[1]: session-190.scope: Succeeded. Nov 18 18:36:04 oleg228-client systemd-logind[1015]: Session 190 logged out. Waiting for processes to exit. Nov 18 18:36:04 oleg228-client systemd-logind[1015]: Removed session 190. Nov 18 18:36:06 oleg228-client sshd[39525]: Accepted publickey for root from 192.168.202.28 port 40754 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:06 oleg228-client systemd[1]: Started Session 191 of user root. Nov 18 18:36:06 oleg228-client systemd-logind[1015]: New session 191 of user root. Nov 18 18:36:06 oleg228-client sshd[39525]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:06 oleg228-client sshd[39538]: Received disconnect from 192.168.202.28 port 40754:11: disconnected by user Nov 18 18:36:06 oleg228-client sshd[39538]: Disconnected from user root 192.168.202.28 port 40754 Nov 18 18:36:06 oleg228-client sshd[39525]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:06 oleg228-client systemd[1]: session-191.scope: Succeeded. Nov 18 18:36:06 oleg228-client systemd-logind[1015]: Session 191 logged out. Waiting for processes to exit. Nov 18 18:36:06 oleg228-client systemd-logind[1015]: Removed session 191. Nov 18 18:36:07 oleg228-client sshd[39657]: Accepted publickey for root from 192.168.202.28 port 40762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:07 oleg228-client systemd[1]: Started Session 192 of user root. Nov 18 18:36:07 oleg228-client systemd-logind[1015]: New session 192 of user root. Nov 18 18:36:07 oleg228-client sshd[39657]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:07 oleg228-client sshd[39670]: Received disconnect from 192.168.202.28 port 40762:11: disconnected by user Nov 18 18:36:07 oleg228-client sshd[39670]: Disconnected from user root 192.168.202.28 port 40762 Nov 18 18:36:07 oleg228-client sshd[39657]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:07 oleg228-client systemd[1]: session-192.scope: Succeeded. Nov 18 18:36:07 oleg228-client systemd-logind[1015]: Session 192 logged out. Waiting for processes to exit. Nov 18 18:36:07 oleg228-client systemd-logind[1015]: Removed session 192. Nov 18 18:36:08 oleg228-client sshd[39797]: Accepted publickey for root from 192.168.202.28 port 40766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:08 oleg228-client systemd-logind[1015]: New session 193 of user root. Nov 18 18:36:08 oleg228-client systemd[1]: Started Session 193 of user root. Nov 18 18:36:08 oleg228-client sshd[39797]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:09 oleg228-client sshd[39810]: Received disconnect from 192.168.202.28 port 40766:11: disconnected by user Nov 18 18:36:09 oleg228-client sshd[39810]: Disconnected from user root 192.168.202.28 port 40766 Nov 18 18:36:09 oleg228-client sshd[39797]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:09 oleg228-client systemd[1]: session-193.scope: Succeeded. Nov 18 18:36:09 oleg228-client systemd-logind[1015]: Session 193 logged out. Waiting for processes to exit. Nov 18 18:36:09 oleg228-client systemd-logind[1015]: Removed session 193. Nov 18 18:36:10 oleg228-client sshd[39943]: Accepted publickey for root from 192.168.202.28 port 40772 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:10 oleg228-client systemd[1]: Started Session 194 of user root. Nov 18 18:36:10 oleg228-client systemd-logind[1015]: New session 194 of user root. Nov 18 18:36:10 oleg228-client sshd[39943]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:10 oleg228-client sshd[39956]: Received disconnect from 192.168.202.28 port 40772:11: disconnected by user Nov 18 18:36:10 oleg228-client sshd[39956]: Disconnected from user root 192.168.202.28 port 40772 Nov 18 18:36:10 oleg228-client sshd[39943]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:10 oleg228-client systemd[1]: session-194.scope: Succeeded. Nov 18 18:36:10 oleg228-client systemd-logind[1015]: Session 194 logged out. Waiting for processes to exit. Nov 18 18:36:10 oleg228-client systemd-logind[1015]: Removed session 194. Nov 18 18:36:11 oleg228-client sshd[40098]: Accepted publickey for root from 192.168.202.28 port 49036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:11 oleg228-client systemd[1]: Started Session 195 of user root. Nov 18 18:36:11 oleg228-client systemd-logind[1015]: New session 195 of user root. Nov 18 18:36:11 oleg228-client sshd[40098]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:12 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29a: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 18:36:11 (1763508971) Nov 18 18:36:12 oleg228-client sshd[40111]: Received disconnect from 192.168.202.28 port 49036:11: disconnected by user Nov 18 18:36:12 oleg228-client sshd[40111]: Disconnected from user root 192.168.202.28 port 49036 Nov 18 18:36:12 oleg228-client sshd[40098]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:12 oleg228-client systemd[1]: session-195.scope: Succeeded. Nov 18 18:36:12 oleg228-client systemd-logind[1015]: Session 195 logged out. Waiting for processes to exit. Nov 18 18:36:12 oleg228-client systemd-logind[1015]: Removed session 195. Nov 18 18:36:26 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:36:26 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cb351e to 0x2622672b25cb392a Nov 18 18:36:35 oleg228-client sshd[40418]: Accepted publickey for root from 192.168.202.28 port 44996 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:35 oleg228-client systemd-logind[1015]: New session 196 of user root. Nov 18 18:36:35 oleg228-client systemd[1]: Started Session 196 of user root. Nov 18 18:36:35 oleg228-client sshd[40418]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:35 oleg228-client sshd[40431]: Received disconnect from 192.168.202.28 port 44996:11: disconnected by user Nov 18 18:36:35 oleg228-client sshd[40431]: Disconnected from user root 192.168.202.28 port 44996 Nov 18 18:36:35 oleg228-client sshd[40418]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:35 oleg228-client systemd[1]: session-196.scope: Succeeded. Nov 18 18:36:35 oleg228-client systemd-logind[1015]: Session 196 logged out. Waiting for processes to exit. Nov 18 18:36:35 oleg228-client systemd-logind[1015]: Removed session 196. Nov 18 18:36:36 oleg228-client sshd[40470]: Accepted publickey for root from 192.168.202.28 port 45002 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:36 oleg228-client systemd-logind[1015]: New session 197 of user root. Nov 18 18:36:36 oleg228-client systemd[1]: Started Session 197 of user root. Nov 18 18:36:36 oleg228-client sshd[40470]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:37 oleg228-client sshd[40483]: Received disconnect from 192.168.202.28 port 45002:11: disconnected by user Nov 18 18:36:37 oleg228-client sshd[40483]: Disconnected from user root 192.168.202.28 port 45002 Nov 18 18:36:37 oleg228-client sshd[40470]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:37 oleg228-client systemd[1]: session-197.scope: Succeeded. Nov 18 18:36:37 oleg228-client systemd-logind[1015]: Session 197 logged out. Waiting for processes to exit. Nov 18 18:36:37 oleg228-client systemd-logind[1015]: Removed session 197. Nov 18 18:36:45 oleg228-client sshd[40633]: Accepted publickey for root from 192.168.202.28 port 36402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:45 oleg228-client systemd[1]: Started Session 198 of user root. Nov 18 18:36:45 oleg228-client systemd-logind[1015]: New session 198 of user root. Nov 18 18:36:45 oleg228-client sshd[40633]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:46 oleg228-client sshd[40646]: Received disconnect from 192.168.202.28 port 36402:11: disconnected by user Nov 18 18:36:46 oleg228-client sshd[40646]: Disconnected from user root 192.168.202.28 port 36402 Nov 18 18:36:46 oleg228-client sshd[40633]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:46 oleg228-client systemd[1]: session-198.scope: Succeeded. Nov 18 18:36:46 oleg228-client systemd-logind[1015]: Session 198 logged out. Waiting for processes to exit. Nov 18 18:36:46 oleg228-client systemd-logind[1015]: Removed session 198. Nov 18 18:36:50 oleg228-client sshd[40824]: Accepted publickey for root from 192.168.202.28 port 36412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:50 oleg228-client systemd[1]: Started Session 199 of user root. Nov 18 18:36:50 oleg228-client systemd-logind[1015]: New session 199 of user root. Nov 18 18:36:50 oleg228-client sshd[40824]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:50 oleg228-client sshd[40837]: Received disconnect from 192.168.202.28 port 36412:11: disconnected by user Nov 18 18:36:50 oleg228-client sshd[40837]: Disconnected from user root 192.168.202.28 port 36412 Nov 18 18:36:50 oleg228-client sshd[40824]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:51 oleg228-client systemd[1]: session-199.scope: Succeeded. Nov 18 18:36:51 oleg228-client systemd-logind[1015]: Session 199 logged out. Waiting for processes to exit. Nov 18 18:36:51 oleg228-client systemd-logind[1015]: Removed session 199. Nov 18 18:36:52 oleg228-client sshd[40963]: Accepted publickey for root from 192.168.202.28 port 50832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:52 oleg228-client systemd[1]: Started Session 200 of user root. Nov 18 18:36:52 oleg228-client systemd-logind[1015]: New session 200 of user root. Nov 18 18:36:52 oleg228-client sshd[40963]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:52 oleg228-client sshd[40976]: Received disconnect from 192.168.202.28 port 50832:11: disconnected by user Nov 18 18:36:52 oleg228-client sshd[40976]: Disconnected from user root 192.168.202.28 port 50832 Nov 18 18:36:52 oleg228-client sshd[40963]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:52 oleg228-client systemd[1]: session-200.scope: Succeeded. Nov 18 18:36:52 oleg228-client systemd-logind[1015]: Session 200 logged out. Waiting for processes to exit. Nov 18 18:36:52 oleg228-client systemd-logind[1015]: Removed session 200. Nov 18 18:36:53 oleg228-client sshd[41109]: Accepted publickey for root from 192.168.202.28 port 50838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:53 oleg228-client systemd-logind[1015]: New session 201 of user root. Nov 18 18:36:53 oleg228-client systemd[1]: Started Session 201 of user root. Nov 18 18:36:53 oleg228-client sshd[41109]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:53 oleg228-client sshd[41122]: Received disconnect from 192.168.202.28 port 50838:11: disconnected by user Nov 18 18:36:53 oleg228-client sshd[41122]: Disconnected from user root 192.168.202.28 port 50838 Nov 18 18:36:53 oleg228-client sshd[41109]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:53 oleg228-client systemd[1]: session-201.scope: Succeeded. Nov 18 18:36:53 oleg228-client systemd-logind[1015]: Session 201 logged out. Waiting for processes to exit. Nov 18 18:36:53 oleg228-client systemd-logind[1015]: Removed session 201. Nov 18 18:36:54 oleg228-client sshd[41264]: Accepted publickey for root from 192.168.202.28 port 50854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:36:54 oleg228-client systemd-logind[1015]: New session 202 of user root. Nov 18 18:36:54 oleg228-client systemd[1]: Started Session 202 of user root. Nov 18 18:36:54 oleg228-client sshd[41264]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:36:54 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 29b: error adding new clients doesn't cause LBUG (bug 22273) ========================================================== 18:36:53 (1763509013) Nov 18 18:36:54 oleg228-client sshd[41277]: Received disconnect from 192.168.202.28 port 50854:11: disconnected by user Nov 18 18:36:54 oleg228-client sshd[41277]: Disconnected from user root 192.168.202.28 port 50854 Nov 18 18:36:54 oleg228-client sshd[41264]: pam_unix(sshd:session): session closed for user root Nov 18 18:36:54 oleg228-client systemd-logind[1015]: Session 202 logged out. Waiting for processes to exit. Nov 18 18:36:54 oleg228-client systemd[1]: session-202.scope: Succeeded. Nov 18 18:36:54 oleg228-client systemd-logind[1015]: Removed session 202. Nov 18 18:37:14 oleg228-client sshd[41584]: Accepted publickey for root from 192.168.202.28 port 35920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:14 oleg228-client systemd-logind[1015]: New session 203 of user root. Nov 18 18:37:14 oleg228-client systemd[1]: Started Session 203 of user root. Nov 18 18:37:14 oleg228-client sshd[41584]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:15 oleg228-client sshd[41597]: Received disconnect from 192.168.202.28 port 35920:11: disconnected by user Nov 18 18:37:15 oleg228-client sshd[41597]: Disconnected from user root 192.168.202.28 port 35920 Nov 18 18:37:15 oleg228-client sshd[41584]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:15 oleg228-client systemd-logind[1015]: Session 203 logged out. Waiting for processes to exit. Nov 18 18:37:15 oleg228-client systemd[1]: session-203.scope: Succeeded. Nov 18 18:37:15 oleg228-client systemd-logind[1015]: Removed session 203. Nov 18 18:37:16 oleg228-client sshd[41636]: Accepted publickey for root from 192.168.202.28 port 35930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:16 oleg228-client systemd-logind[1015]: New session 204 of user root. Nov 18 18:37:16 oleg228-client systemd[1]: Started Session 204 of user root. Nov 18 18:37:16 oleg228-client sshd[41636]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:16 oleg228-client sshd[41649]: Received disconnect from 192.168.202.28 port 35930:11: disconnected by user Nov 18 18:37:16 oleg228-client sshd[41649]: Disconnected from user root 192.168.202.28 port 35930 Nov 18 18:37:17 oleg228-client sshd[41636]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:17 oleg228-client systemd[1]: session-204.scope: Succeeded. Nov 18 18:37:17 oleg228-client systemd-logind[1015]: Session 204 logged out. Waiting for processes to exit. Nov 18 18:37:17 oleg228-client systemd-logind[1015]: Removed session 204. Nov 18 18:37:26 oleg228-client sshd[41800]: Accepted publickey for root from 192.168.202.28 port 58962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:26 oleg228-client systemd-logind[1015]: New session 205 of user root. Nov 18 18:37:26 oleg228-client systemd[1]: Started Session 205 of user root. Nov 18 18:37:26 oleg228-client sshd[41800]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:26 oleg228-client sshd[41813]: Received disconnect from 192.168.202.28 port 58962:11: disconnected by user Nov 18 18:37:27 oleg228-client sshd[41813]: Disconnected from user root 192.168.202.28 port 58962 Nov 18 18:37:27 oleg228-client sshd[41800]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:27 oleg228-client systemd-logind[1015]: Session 205 logged out. Waiting for processes to exit. Nov 18 18:37:27 oleg228-client systemd[1]: session-205.scope: Succeeded. Nov 18 18:37:27 oleg228-client systemd-logind[1015]: Removed session 205. Nov 18 18:37:27 oleg228-client sshd[41932]: Accepted publickey for root from 192.168.202.28 port 58964 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:28 oleg228-client systemd-logind[1015]: New session 206 of user root. Nov 18 18:37:28 oleg228-client systemd[1]: Started Session 206 of user root. Nov 18 18:37:28 oleg228-client sshd[41932]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:28 oleg228-client sshd[41945]: Received disconnect from 192.168.202.28 port 58964:11: disconnected by user Nov 18 18:37:28 oleg228-client sshd[41945]: Disconnected from user root 192.168.202.28 port 58964 Nov 18 18:37:28 oleg228-client sshd[41932]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:28 oleg228-client systemd[1]: session-206.scope: Succeeded. Nov 18 18:37:28 oleg228-client systemd-logind[1015]: Session 206 logged out. Waiting for processes to exit. Nov 18 18:37:28 oleg228-client systemd-logind[1015]: Removed session 206. Nov 18 18:37:29 oleg228-client sshd[42071]: Accepted publickey for root from 192.168.202.28 port 58972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:29 oleg228-client systemd-logind[1015]: New session 207 of user root. Nov 18 18:37:29 oleg228-client systemd[1]: Started Session 207 of user root. Nov 18 18:37:29 oleg228-client sshd[42071]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:29 oleg228-client sshd[42084]: Received disconnect from 192.168.202.28 port 58972:11: disconnected by user Nov 18 18:37:29 oleg228-client sshd[42084]: Disconnected from user root 192.168.202.28 port 58972 Nov 18 18:37:29 oleg228-client sshd[42071]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:29 oleg228-client systemd[1]: session-207.scope: Succeeded. Nov 18 18:37:29 oleg228-client systemd-logind[1015]: Session 207 logged out. Waiting for processes to exit. Nov 18 18:37:29 oleg228-client systemd-logind[1015]: Removed session 207. Nov 18 18:37:30 oleg228-client sshd[42217]: Accepted publickey for root from 192.168.202.28 port 58978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:30 oleg228-client systemd-logind[1015]: New session 208 of user root. Nov 18 18:37:30 oleg228-client systemd[1]: Started Session 208 of user root. Nov 18 18:37:30 oleg228-client sshd[42217]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:30 oleg228-client sshd[42230]: Received disconnect from 192.168.202.28 port 58978:11: disconnected by user Nov 18 18:37:31 oleg228-client sshd[42230]: Disconnected from user root 192.168.202.28 port 58978 Nov 18 18:37:31 oleg228-client sshd[42217]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:31 oleg228-client systemd[1]: session-208.scope: Succeeded. Nov 18 18:37:31 oleg228-client systemd-logind[1015]: Session 208 logged out. Waiting for processes to exit. Nov 18 18:37:31 oleg228-client systemd-logind[1015]: Removed session 208. Nov 18 18:37:32 oleg228-client sshd[42373]: Accepted publickey for root from 192.168.202.28 port 51918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:37:32 oleg228-client systemd-logind[1015]: New session 209 of user root. Nov 18 18:37:32 oleg228-client systemd[1]: Started Session 209 of user root. Nov 18 18:37:32 oleg228-client sshd[42373]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:37:32 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 50: failover MDS under load ======= 18:37:31 (1763509051) Nov 18 18:37:32 oleg228-client sshd[42386]: Received disconnect from 192.168.202.28 port 51918:11: disconnected by user Nov 18 18:37:32 oleg228-client sshd[42386]: Disconnected from user root 192.168.202.28 port 51918 Nov 18 18:37:32 oleg228-client sshd[42373]: pam_unix(sshd:session): session closed for user root Nov 18 18:37:32 oleg228-client systemd-logind[1015]: Session 209 logged out. Waiting for processes to exit. Nov 18 18:37:32 oleg228-client systemd[1]: session-209.scope: Succeeded. Nov 18 18:37:32 oleg228-client systemd-logind[1015]: Removed session 209. Nov 18 18:37:45 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation mds_reint to node 192.168.202.128@tcp failed: rc = -19 Nov 18 18:37:45 oleg228-client kernel: LustreError: Skipped 1 previous similar message Nov 18 18:38:03 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:38:13 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cb392a to 0x2622672b25cb95ce Nov 18 18:38:19 oleg228-client sshd[42703]: Accepted publickey for root from 192.168.202.28 port 48284 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:38:20 oleg228-client systemd-logind[1015]: New session 210 of user root. Nov 18 18:38:20 oleg228-client systemd[1]: Started Session 210 of user root. Nov 18 18:38:20 oleg228-client sshd[42703]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:38:20 oleg228-client sshd[42716]: Received disconnect from 192.168.202.28 port 48284:11: disconnected by user Nov 18 18:38:20 oleg228-client sshd[42716]: Disconnected from user root 192.168.202.28 port 48284 Nov 18 18:38:20 oleg228-client sshd[42703]: pam_unix(sshd:session): session closed for user root Nov 18 18:38:20 oleg228-client systemd[1]: session-210.scope: Succeeded. Nov 18 18:38:20 oleg228-client systemd-logind[1015]: Session 210 logged out. Waiting for processes to exit. Nov 18 18:38:20 oleg228-client systemd-logind[1015]: Removed session 210. Nov 18 18:38:24 oleg228-client sshd[42938]: Accepted publickey for root from 192.168.202.28 port 57976 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:38:24 oleg228-client systemd[1]: Started Session 211 of user root. Nov 18 18:38:24 oleg228-client systemd-logind[1015]: New session 211 of user root. Nov 18 18:38:24 oleg228-client sshd[42938]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:38:24 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 18:38:24 oleg228-client sshd[42951]: Received disconnect from 192.168.202.28 port 57976:11: disconnected by user Nov 18 18:38:24 oleg228-client sshd[42951]: Disconnected from user root 192.168.202.28 port 57976 Nov 18 18:38:24 oleg228-client sshd[42938]: pam_unix(sshd:session): session closed for user root Nov 18 18:38:24 oleg228-client systemd[1]: session-211.scope: Succeeded. Nov 18 18:38:24 oleg228-client systemd-logind[1015]: Session 211 logged out. Waiting for processes to exit. Nov 18 18:38:24 oleg228-client systemd-logind[1015]: Removed session 211. Nov 18 18:38:25 oleg228-client sshd[43094]: Accepted publickey for root from 192.168.202.28 port 57988 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:38:25 oleg228-client systemd[1]: Started Session 212 of user root. Nov 18 18:38:25 oleg228-client systemd-logind[1015]: New session 212 of user root. Nov 18 18:38:25 oleg228-client sshd[43094]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:38:26 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 18:38:26 oleg228-client sshd[43108]: Received disconnect from 192.168.202.28 port 57988:11: disconnected by user Nov 18 18:38:26 oleg228-client sshd[43108]: Disconnected from user root 192.168.202.28 port 57988 Nov 18 18:38:26 oleg228-client sshd[43094]: pam_unix(sshd:session): session closed for user root Nov 18 18:38:26 oleg228-client systemd[1]: session-212.scope: Succeeded. Nov 18 18:38:26 oleg228-client systemd-logind[1015]: Session 212 logged out. Waiting for processes to exit. Nov 18 18:38:26 oleg228-client systemd-logind[1015]: Removed session 212. Nov 18 18:38:27 oleg228-client sshd[43149]: Accepted publickey for root from 192.168.202.28 port 58004 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:38:27 oleg228-client systemd-logind[1015]: New session 213 of user root. Nov 18 18:38:27 oleg228-client systemd[1]: Started Session 213 of user root. Nov 18 18:38:27 oleg228-client sshd[43149]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:38:28 oleg228-client sshd[43162]: Received disconnect from 192.168.202.28 port 58004:11: disconnected by user Nov 18 18:38:28 oleg228-client sshd[43162]: Disconnected from user root 192.168.202.28 port 58004 Nov 18 18:38:28 oleg228-client sshd[43149]: pam_unix(sshd:session): session closed for user root Nov 18 18:38:28 oleg228-client systemd[1]: session-213.scope: Succeeded. Nov 18 18:38:28 oleg228-client systemd-logind[1015]: Session 213 logged out. Waiting for processes to exit. Nov 18 18:38:28 oleg228-client systemd-logind[1015]: Removed session 213. Nov 18 18:39:50 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:39:50 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cb95ce to 0x2622672b25cd9315 Nov 18 18:39:58 oleg228-client sshd[43476]: Accepted publickey for root from 192.168.202.28 port 40746 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:39:58 oleg228-client systemd-logind[1015]: New session 214 of user root. Nov 18 18:39:58 oleg228-client systemd[1]: Started Session 214 of user root. Nov 18 18:39:58 oleg228-client sshd[43476]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:39:58 oleg228-client sshd[43489]: Received disconnect from 192.168.202.28 port 40746:11: disconnected by user Nov 18 18:39:58 oleg228-client sshd[43489]: Disconnected from user root 192.168.202.28 port 40746 Nov 18 18:39:58 oleg228-client sshd[43476]: pam_unix(sshd:session): session closed for user root Nov 18 18:39:59 oleg228-client systemd[1]: session-214.scope: Succeeded. Nov 18 18:39:59 oleg228-client systemd-logind[1015]: Session 214 logged out. Waiting for processes to exit. Nov 18 18:39:59 oleg228-client systemd-logind[1015]: Removed session 214. Nov 18 18:40:02 oleg228-client sshd[43714]: Accepted publickey for root from 192.168.202.28 port 56832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:40:02 oleg228-client systemd-logind[1015]: New session 215 of user root. Nov 18 18:40:02 oleg228-client systemd[1]: Started Session 215 of user root. Nov 18 18:40:02 oleg228-client sshd[43714]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:40:03 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 18:40:03 oleg228-client sshd[43727]: Received disconnect from 192.168.202.28 port 56832:11: disconnected by user Nov 18 18:40:03 oleg228-client sshd[43727]: Disconnected from user root 192.168.202.28 port 56832 Nov 18 18:40:03 oleg228-client sshd[43714]: pam_unix(sshd:session): session closed for user root Nov 18 18:40:03 oleg228-client systemd-logind[1015]: Session 215 logged out. Waiting for processes to exit. Nov 18 18:40:03 oleg228-client systemd[1]: session-215.scope: Succeeded. Nov 18 18:40:03 oleg228-client systemd-logind[1015]: Removed session 215. Nov 18 18:40:04 oleg228-client sshd[43870]: Accepted publickey for root from 192.168.202.28 port 56844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:40:05 oleg228-client systemd[1]: Started Session 216 of user root. Nov 18 18:40:05 oleg228-client systemd-logind[1015]: New session 216 of user root. Nov 18 18:40:05 oleg228-client sshd[43870]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:40:05 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 18:40:05 oleg228-client sshd[43883]: Received disconnect from 192.168.202.28 port 56844:11: disconnected by user Nov 18 18:40:05 oleg228-client sshd[43883]: Disconnected from user root 192.168.202.28 port 56844 Nov 18 18:40:05 oleg228-client sshd[43870]: pam_unix(sshd:session): session closed for user root Nov 18 18:40:05 oleg228-client systemd[1]: session-216.scope: Succeeded. Nov 18 18:40:05 oleg228-client systemd-logind[1015]: Session 216 logged out. Waiting for processes to exit. Nov 18 18:40:05 oleg228-client systemd-logind[1015]: Removed session 216. Nov 18 18:40:07 oleg228-client sshd[43925]: Accepted publickey for root from 192.168.202.28 port 56852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:40:07 oleg228-client systemd[1]: Started Session 217 of user root. Nov 18 18:40:07 oleg228-client systemd-logind[1015]: New session 217 of user root. Nov 18 18:40:07 oleg228-client sshd[43925]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:40:07 oleg228-client sshd[43938]: Received disconnect from 192.168.202.28 port 56852:11: disconnected by user Nov 18 18:40:08 oleg228-client sshd[43938]: Disconnected from user root 192.168.202.28 port 56852 Nov 18 18:40:08 oleg228-client sshd[43925]: pam_unix(sshd:session): session closed for user root Nov 18 18:40:08 oleg228-client systemd-logind[1015]: Session 217 logged out. Waiting for processes to exit. Nov 18 18:40:08 oleg228-client systemd[1]: session-217.scope: Succeeded. Nov 18 18:40:08 oleg228-client systemd-logind[1015]: Removed session 217. Nov 18 18:41:10 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation mds_reint to node 192.168.202.128@tcp failed: rc = -19 Nov 18 18:41:10 oleg228-client kernel: LustreError: Skipped 5 previous similar messages Nov 18 18:41:28 oleg228-client kernel: Lustre: 2407:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763509272/real 1763509272] req@ffff9ccbc7bb7100 x1849171040376320/t0(0) o400->MGC192.168.202.128@tcp@192.168.202.128@tcp:26/25 lens 224/224 e 0 to 1 dl 1763509288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Nov 18 18:41:28 oleg228-client kernel: Lustre: 2407:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 10 previous similar messages Nov 18 18:41:28 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:41:28 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 18:41:38 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cd9315 to 0x2622672b25cf93ea Nov 18 18:41:45 oleg228-client sshd[44254]: Accepted publickey for root from 192.168.202.28 port 50362 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:41:45 oleg228-client systemd-logind[1015]: New session 218 of user root. Nov 18 18:41:45 oleg228-client systemd[1]: Started Session 218 of user root. Nov 18 18:41:45 oleg228-client sshd[44254]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:41:45 oleg228-client sshd[44267]: Received disconnect from 192.168.202.28 port 50362:11: disconnected by user Nov 18 18:41:46 oleg228-client sshd[44267]: Disconnected from user root 192.168.202.28 port 50362 Nov 18 18:41:46 oleg228-client sshd[44254]: pam_unix(sshd:session): session closed for user root Nov 18 18:41:46 oleg228-client systemd-logind[1015]: Session 218 logged out. Waiting for processes to exit. Nov 18 18:41:46 oleg228-client systemd[1]: session-218.scope: Succeeded. Nov 18 18:41:46 oleg228-client systemd-logind[1015]: Removed session 218. Nov 18 18:41:49 oleg228-client sshd[44490]: Accepted publickey for root from 192.168.202.28 port 50374 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:41:49 oleg228-client systemd-logind[1015]: New session 219 of user root. Nov 18 18:41:49 oleg228-client systemd[1]: Started Session 219 of user root. Nov 18 18:41:49 oleg228-client sshd[44490]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:41:49 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 18:41:49 oleg228-client sshd[44503]: Received disconnect from 192.168.202.28 port 50374:11: disconnected by user Nov 18 18:41:49 oleg228-client sshd[44503]: Disconnected from user root 192.168.202.28 port 50374 Nov 18 18:41:49 oleg228-client sshd[44490]: pam_unix(sshd:session): session closed for user root Nov 18 18:41:49 oleg228-client systemd-logind[1015]: Session 219 logged out. Waiting for processes to exit. Nov 18 18:41:49 oleg228-client systemd[1]: session-219.scope: Succeeded. Nov 18 18:41:49 oleg228-client systemd-logind[1015]: Removed session 219. Nov 18 18:41:51 oleg228-client sshd[44646]: Accepted publickey for root from 192.168.202.28 port 35646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:41:51 oleg228-client systemd-logind[1015]: New session 220 of user root. Nov 18 18:41:51 oleg228-client systemd[1]: Started Session 220 of user root. Nov 18 18:41:51 oleg228-client sshd[44646]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:41:51 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 18:41:51 oleg228-client sshd[44659]: Received disconnect from 192.168.202.28 port 35646:11: disconnected by user Nov 18 18:41:51 oleg228-client sshd[44659]: Disconnected from user root 192.168.202.28 port 35646 Nov 18 18:41:51 oleg228-client sshd[44646]: pam_unix(sshd:session): session closed for user root Nov 18 18:41:51 oleg228-client systemd-logind[1015]: Session 220 logged out. Waiting for processes to exit. Nov 18 18:41:51 oleg228-client systemd[1]: session-220.scope: Succeeded. Nov 18 18:41:51 oleg228-client systemd-logind[1015]: Removed session 220. Nov 18 18:41:53 oleg228-client sshd[44702]: Accepted publickey for root from 192.168.202.28 port 35650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:41:53 oleg228-client systemd-logind[1015]: New session 221 of user root. Nov 18 18:41:53 oleg228-client systemd[1]: Started Session 221 of user root. Nov 18 18:41:53 oleg228-client sshd[44702]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:41:53 oleg228-client sshd[44715]: Received disconnect from 192.168.202.28 port 35650:11: disconnected by user Nov 18 18:41:53 oleg228-client sshd[44715]: Disconnected from user root 192.168.202.28 port 35650 Nov 18 18:41:53 oleg228-client sshd[44702]: pam_unix(sshd:session): session closed for user root Nov 18 18:41:53 oleg228-client systemd[1]: session-221.scope: Succeeded. Nov 18 18:41:53 oleg228-client systemd-logind[1015]: Session 221 logged out. Waiting for processes to exit. Nov 18 18:41:53 oleg228-client systemd-logind[1015]: Removed session 221. Nov 18 18:42:14 oleg228-client sshd[44838]: Accepted publickey for root from 192.168.202.28 port 60838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:42:14 oleg228-client systemd-logind[1015]: New session 222 of user root. Nov 18 18:42:14 oleg228-client systemd[1]: Started Session 222 of user root. Nov 18 18:42:14 oleg228-client sshd[44838]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:42:14 oleg228-client sshd[44851]: Received disconnect from 192.168.202.28 port 60838:11: disconnected by user Nov 18 18:42:14 oleg228-client sshd[44851]: Disconnected from user root 192.168.202.28 port 60838 Nov 18 18:42:14 oleg228-client sshd[44838]: pam_unix(sshd:session): session closed for user root Nov 18 18:42:14 oleg228-client systemd[1]: session-222.scope: Succeeded. Nov 18 18:42:14 oleg228-client systemd-logind[1015]: Session 222 logged out. Waiting for processes to exit. Nov 18 18:42:14 oleg228-client systemd-logind[1015]: Removed session 222. Nov 18 18:42:16 oleg228-client sshd[44977]: Accepted publickey for root from 192.168.202.28 port 60842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:42:16 oleg228-client systemd-logind[1015]: New session 223 of user root. Nov 18 18:42:16 oleg228-client systemd[1]: Started Session 223 of user root. Nov 18 18:42:16 oleg228-client sshd[44977]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:42:16 oleg228-client sshd[44990]: Received disconnect from 192.168.202.28 port 60842:11: disconnected by user Nov 18 18:42:16 oleg228-client sshd[44990]: Disconnected from user root 192.168.202.28 port 60842 Nov 18 18:42:16 oleg228-client sshd[44977]: pam_unix(sshd:session): session closed for user root Nov 18 18:42:17 oleg228-client systemd[1]: session-223.scope: Succeeded. Nov 18 18:42:17 oleg228-client systemd-logind[1015]: Session 223 logged out. Waiting for processes to exit. Nov 18 18:42:17 oleg228-client systemd-logind[1015]: Removed session 223. Nov 18 18:42:17 oleg228-client sshd[45125]: Accepted publickey for root from 192.168.202.28 port 60848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:42:17 oleg228-client systemd-logind[1015]: New session 224 of user root. Nov 18 18:42:17 oleg228-client systemd[1]: Started Session 224 of user root. Nov 18 18:42:17 oleg228-client sshd[45125]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:42:18 oleg228-client sshd[45138]: Received disconnect from 192.168.202.28 port 60848:11: disconnected by user Nov 18 18:42:18 oleg228-client sshd[45138]: Disconnected from user root 192.168.202.28 port 60848 Nov 18 18:42:18 oleg228-client sshd[45125]: pam_unix(sshd:session): session closed for user root Nov 18 18:42:18 oleg228-client systemd-logind[1015]: Session 224 logged out. Waiting for processes to exit. Nov 18 18:42:18 oleg228-client systemd[1]: session-224.scope: Succeeded. Nov 18 18:42:18 oleg228-client systemd-logind[1015]: Removed session 224. Nov 18 18:42:19 oleg228-client sshd[45280]: Accepted publickey for root from 192.168.202.28 port 60854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:42:19 oleg228-client systemd-logind[1015]: New session 225 of user root. Nov 18 18:42:19 oleg228-client systemd[1]: Started Session 225 of user root. Nov 18 18:42:19 oleg228-client sshd[45280]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:42:19 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 51: failover MDS during recovery == 18:42:18 (1763509338) Nov 18 18:42:19 oleg228-client sshd[45293]: Received disconnect from 192.168.202.28 port 60854:11: disconnected by user Nov 18 18:42:19 oleg228-client sshd[45293]: Disconnected from user root 192.168.202.28 port 60854 Nov 18 18:42:19 oleg228-client sshd[45280]: pam_unix(sshd:session): session closed for user root Nov 18 18:42:19 oleg228-client systemd[1]: session-225.scope: Succeeded. Nov 18 18:42:19 oleg228-client systemd-logind[1015]: Session 225 logged out. Waiting for processes to exit. Nov 18 18:42:19 oleg228-client systemd-logind[1015]: Removed session 225. Nov 18 18:42:41 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:42:51 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25cf93ea to 0x2622672b25d07820 Nov 18 18:42:51 oleg228-client kernel: Lustre: MGC192.168.202.128@tcp: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 18:42:51 oleg228-client kernel: Lustre: Skipped 13 previous similar messages Nov 18 18:42:55 oleg228-client sshd[45702]: Accepted publickey for root from 192.168.202.28 port 33178 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:42:55 oleg228-client systemd[1]: Started Session 226 of user root. Nov 18 18:42:55 oleg228-client systemd-logind[1015]: New session 226 of user root. Nov 18 18:42:55 oleg228-client sshd[45702]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:42:55 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 1 sec Nov 18 18:42:55 oleg228-client sshd[45715]: Received disconnect from 192.168.202.28 port 33178:11: disconnected by user Nov 18 18:42:55 oleg228-client sshd[45715]: Disconnected from user root 192.168.202.28 port 33178 Nov 18 18:42:55 oleg228-client sshd[45702]: pam_unix(sshd:session): session closed for user root Nov 18 18:42:55 oleg228-client systemd[1]: session-226.scope: Succeeded. Nov 18 18:42:55 oleg228-client systemd-logind[1015]: Session 226 logged out. Waiting for processes to exit. Nov 18 18:42:55 oleg228-client systemd-logind[1015]: Removed session 226. Nov 18 18:43:23 oleg228-client sshd[46107]: Accepted publickey for root from 192.168.202.28 port 35058 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:43:23 oleg228-client systemd-logind[1015]: New session 227 of user root. Nov 18 18:43:23 oleg228-client systemd[1]: Started Session 227 of user root. Nov 18 18:43:23 oleg228-client sshd[46107]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:43:23 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 5 sec Nov 18 18:43:23 oleg228-client sshd[46120]: Received disconnect from 192.168.202.28 port 35058:11: disconnected by user Nov 18 18:43:23 oleg228-client sshd[46120]: Disconnected from user root 192.168.202.28 port 35058 Nov 18 18:43:23 oleg228-client sshd[46107]: pam_unix(sshd:session): session closed for user root Nov 18 18:43:23 oleg228-client systemd[1]: session-227.scope: Succeeded. Nov 18 18:43:23 oleg228-client systemd-logind[1015]: Session 227 logged out. Waiting for processes to exit. Nov 18 18:43:23 oleg228-client systemd-logind[1015]: Removed session 227. Nov 18 18:44:04 oleg228-client sshd[46514]: Accepted publickey for root from 192.168.202.28 port 33552 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:44:04 oleg228-client systemd-logind[1015]: New session 228 of user root. Nov 18 18:44:04 oleg228-client systemd[1]: Started Session 228 of user root. Nov 18 18:44:04 oleg228-client sshd[46514]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:44:05 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 10 sec Nov 18 18:44:05 oleg228-client sshd[46527]: Received disconnect from 192.168.202.28 port 33552:11: disconnected by user Nov 18 18:44:05 oleg228-client sshd[46527]: Disconnected from user root 192.168.202.28 port 33552 Nov 18 18:44:05 oleg228-client sshd[46514]: pam_unix(sshd:session): session closed for user root Nov 18 18:44:05 oleg228-client systemd[1]: session-228.scope: Succeeded. Nov 18 18:44:05 oleg228-client systemd-logind[1015]: Session 228 logged out. Waiting for processes to exit. Nov 18 18:44:05 oleg228-client systemd-logind[1015]: Removed session 228. Nov 18 18:44:42 oleg228-client sshd[46913]: Accepted publickey for root from 192.168.202.28 port 60854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:44:42 oleg228-client systemd[1]: Started Session 229 of user root. Nov 18 18:44:42 oleg228-client systemd-logind[1015]: New session 229 of user root. Nov 18 18:44:42 oleg228-client sshd[46913]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:44:42 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 20 sec Nov 18 18:44:42 oleg228-client sshd[46927]: Received disconnect from 192.168.202.28 port 60854:11: disconnected by user Nov 18 18:44:42 oleg228-client sshd[46927]: Disconnected from user root 192.168.202.28 port 60854 Nov 18 18:44:42 oleg228-client sshd[46913]: pam_unix(sshd:session): session closed for user root Nov 18 18:44:42 oleg228-client systemd[1]: session-229.scope: Succeeded. Nov 18 18:44:42 oleg228-client systemd-logind[1015]: Session 229 logged out. Waiting for processes to exit. Nov 18 18:44:42 oleg228-client systemd-logind[1015]: Removed session 229. Nov 18 18:45:05 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc551f800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:45:05 oleg228-client kernel: Lustre: Skipped 10 previous similar messages Nov 18 18:45:23 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 18:45:23 oleg228-client kernel: LustreError: Skipped 3 previous similar messages Nov 18 18:45:23 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25d16984 to 0x2622672b25d1e291 Nov 18 18:45:23 oleg228-client kernel: Lustre: Skipped 3 previous similar messages Nov 18 18:45:29 oleg228-client sshd[47325]: Accepted publickey for root from 192.168.202.28 port 39940 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:45:29 oleg228-client systemd[1]: Started Session 230 of user root. Nov 18 18:45:29 oleg228-client systemd-logind[1015]: New session 230 of user root. Nov 18 18:45:29 oleg228-client sshd[47325]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:45:29 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 25 sec Nov 18 18:45:29 oleg228-client sshd[47338]: Received disconnect from 192.168.202.28 port 39940:11: disconnected by user Nov 18 18:45:29 oleg228-client sshd[47338]: Disconnected from user root 192.168.202.28 port 39940 Nov 18 18:45:29 oleg228-client sshd[47325]: pam_unix(sshd:session): session closed for user root Nov 18 18:45:29 oleg228-client systemd[1]: session-230.scope: Succeeded. Nov 18 18:45:29 oleg228-client systemd-logind[1015]: Session 230 logged out. Waiting for processes to exit. Nov 18 18:45:29 oleg228-client systemd-logind[1015]: Removed session 230. Nov 18 18:45:56 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551f800: operation mds_reint to node 192.168.202.128@tcp failed: rc = -19 Nov 18 18:45:56 oleg228-client kernel: LustreError: Skipped 10 previous similar messages Nov 18 18:46:21 oleg228-client sshd[47732]: Accepted publickey for root from 192.168.202.28 port 56970 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:46:21 oleg228-client systemd-logind[1015]: New session 231 of user root. Nov 18 18:46:21 oleg228-client systemd[1]: Started Session 231 of user root. Nov 18 18:46:21 oleg228-client sshd[47732]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:46:21 oleg228-client kernel: Lustre: DEBUG MARKER: test_51: failover in 30 sec Nov 18 18:46:21 oleg228-client sshd[47746]: Received disconnect from 192.168.202.28 port 56970:11: disconnected by user Nov 18 18:46:22 oleg228-client sshd[47746]: Disconnected from user root 192.168.202.28 port 56970 Nov 18 18:46:22 oleg228-client sshd[47732]: pam_unix(sshd:session): session closed for user root Nov 18 18:46:22 oleg228-client systemd[1]: session-231.scope: Succeeded. Nov 18 18:46:22 oleg228-client systemd-logind[1015]: Session 231 logged out. Waiting for processes to exit. Nov 18 18:46:22 oleg228-client systemd-logind[1015]: Removed session 231. Nov 18 18:47:39 oleg228-client sshd[48142]: Accepted publickey for root from 192.168.202.28 port 50758 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:47:39 oleg228-client systemd-logind[1015]: New session 232 of user root. Nov 18 18:47:39 oleg228-client systemd[1]: Started Session 232 of user root. Nov 18 18:47:39 oleg228-client sshd[48142]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:47:39 oleg228-client sshd[48155]: Received disconnect from 192.168.202.28 port 50758:11: disconnected by user Nov 18 18:47:39 oleg228-client sshd[48155]: Disconnected from user root 192.168.202.28 port 50758 Nov 18 18:47:39 oleg228-client sshd[48142]: pam_unix(sshd:session): session closed for user root Nov 18 18:47:39 oleg228-client systemd[1]: session-232.scope: Succeeded. Nov 18 18:47:39 oleg228-client systemd-logind[1015]: Session 232 logged out. Waiting for processes to exit. Nov 18 18:47:39 oleg228-client systemd-logind[1015]: Removed session 232. Nov 18 18:47:41 oleg228-client sshd[48283]: Accepted publickey for root from 192.168.202.28 port 42182 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:47:41 oleg228-client systemd-logind[1015]: New session 233 of user root. Nov 18 18:47:41 oleg228-client systemd[1]: Started Session 233 of user root. Nov 18 18:47:41 oleg228-client sshd[48283]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:47:41 oleg228-client sshd[48296]: Received disconnect from 192.168.202.28 port 42182:11: disconnected by user Nov 18 18:47:41 oleg228-client sshd[48296]: Disconnected from user root 192.168.202.28 port 42182 Nov 18 18:47:41 oleg228-client sshd[48283]: pam_unix(sshd:session): session closed for user root Nov 18 18:47:41 oleg228-client systemd[1]: session-233.scope: Succeeded. Nov 18 18:47:41 oleg228-client systemd-logind[1015]: Session 233 logged out. Waiting for processes to exit. Nov 18 18:47:41 oleg228-client systemd-logind[1015]: Removed session 233. Nov 18 18:47:42 oleg228-client sshd[48429]: Accepted publickey for root from 192.168.202.28 port 42194 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:47:42 oleg228-client systemd[1]: Started Session 234 of user root. Nov 18 18:47:42 oleg228-client systemd-logind[1015]: New session 234 of user root. Nov 18 18:47:42 oleg228-client sshd[48429]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:47:42 oleg228-client sshd[48442]: Received disconnect from 192.168.202.28 port 42194:11: disconnected by user Nov 18 18:47:42 oleg228-client sshd[48442]: Disconnected from user root 192.168.202.28 port 42194 Nov 18 18:47:42 oleg228-client sshd[48429]: pam_unix(sshd:session): session closed for user root Nov 18 18:47:43 oleg228-client systemd[1]: session-234.scope: Succeeded. Nov 18 18:47:43 oleg228-client systemd-logind[1015]: Session 234 logged out. Waiting for processes to exit. Nov 18 18:47:43 oleg228-client systemd-logind[1015]: Removed session 234. Nov 18 18:47:44 oleg228-client sshd[48586]: Accepted publickey for root from 192.168.202.28 port 42206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:47:44 oleg228-client systemd[1]: Started Session 235 of user root. Nov 18 18:47:44 oleg228-client systemd-logind[1015]: New session 235 of user root. Nov 18 18:47:44 oleg228-client sshd[48586]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:47:44 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 52: failover OST under load ======= 18:47:43 (1763509663) Nov 18 18:47:44 oleg228-client sshd[48599]: Received disconnect from 192.168.202.28 port 42206:11: disconnected by user Nov 18 18:47:44 oleg228-client sshd[48599]: Disconnected from user root 192.168.202.28 port 42206 Nov 18 18:47:44 oleg228-client sshd[48586]: pam_unix(sshd:session): session closed for user root Nov 18 18:47:44 oleg228-client systemd[1]: session-235.scope: Succeeded. Nov 18 18:47:44 oleg228-client systemd-logind[1015]: Session 235 logged out. Waiting for processes to exit. Nov 18 18:47:44 oleg228-client systemd-logind[1015]: Removed session 235. Nov 18 18:48:25 oleg228-client sshd[48957]: Accepted publickey for root from 192.168.202.28 port 45762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:48:25 oleg228-client systemd-logind[1015]: New session 236 of user root. Nov 18 18:48:25 oleg228-client systemd[1]: Started Session 236 of user root. Nov 18 18:48:25 oleg228-client sshd[48957]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:48:26 oleg228-client sshd[48970]: Received disconnect from 192.168.202.28 port 45762:11: disconnected by user Nov 18 18:48:26 oleg228-client sshd[48970]: Disconnected from user root 192.168.202.28 port 45762 Nov 18 18:48:26 oleg228-client sshd[48957]: pam_unix(sshd:session): session closed for user root Nov 18 18:48:26 oleg228-client systemd[1]: session-236.scope: Succeeded. Nov 18 18:48:26 oleg228-client systemd-logind[1015]: Session 236 logged out. Waiting for processes to exit. Nov 18 18:48:26 oleg228-client systemd-logind[1015]: Removed session 236. Nov 18 18:48:30 oleg228-client sshd[49194]: Accepted publickey for root from 192.168.202.28 port 45768 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:48:30 oleg228-client systemd[1]: Started Session 237 of user root. Nov 18 18:48:30 oleg228-client systemd-logind[1015]: New session 237 of user root. Nov 18 18:48:30 oleg228-client sshd[49194]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:48:30 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 18:48:30 oleg228-client sshd[49207]: Received disconnect from 192.168.202.28 port 45768:11: disconnected by user Nov 18 18:48:30 oleg228-client sshd[49207]: Disconnected from user root 192.168.202.28 port 45768 Nov 18 18:48:30 oleg228-client sshd[49194]: pam_unix(sshd:session): session closed for user root Nov 18 18:48:30 oleg228-client systemd[1]: session-237.scope: Succeeded. Nov 18 18:48:30 oleg228-client systemd-logind[1015]: Session 237 logged out. Waiting for processes to exit. Nov 18 18:48:30 oleg228-client systemd-logind[1015]: Removed session 237. Nov 18 18:48:32 oleg228-client sshd[49351]: Accepted publickey for root from 192.168.202.28 port 51328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:48:32 oleg228-client systemd[1]: Started Session 238 of user root. Nov 18 18:48:32 oleg228-client systemd-logind[1015]: New session 238 of user root. Nov 18 18:48:32 oleg228-client sshd[49351]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:48:32 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 18:48:32 oleg228-client sshd[49364]: Received disconnect from 192.168.202.28 port 51328:11: disconnected by user Nov 18 18:48:32 oleg228-client sshd[49364]: Disconnected from user root 192.168.202.28 port 51328 Nov 18 18:48:32 oleg228-client sshd[49351]: pam_unix(sshd:session): session closed for user root Nov 18 18:48:32 oleg228-client systemd[1]: session-238.scope: Succeeded. Nov 18 18:48:32 oleg228-client systemd-logind[1015]: Session 238 logged out. Waiting for processes to exit. Nov 18 18:48:32 oleg228-client systemd-logind[1015]: Removed session 238. Nov 18 18:48:34 oleg228-client sshd[49405]: Accepted publickey for root from 192.168.202.28 port 51340 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:48:34 oleg228-client systemd-logind[1015]: New session 239 of user root. Nov 18 18:48:34 oleg228-client systemd[1]: Started Session 239 of user root. Nov 18 18:48:34 oleg228-client sshd[49405]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:48:34 oleg228-client sshd[49418]: Received disconnect from 192.168.202.28 port 51340:11: disconnected by user Nov 18 18:48:34 oleg228-client sshd[49418]: Disconnected from user root 192.168.202.28 port 51340 Nov 18 18:48:34 oleg228-client sshd[49405]: pam_unix(sshd:session): session closed for user root Nov 18 18:48:34 oleg228-client systemd[1]: session-239.scope: Succeeded. Nov 18 18:48:34 oleg228-client systemd-logind[1015]: Session 239 logged out. Waiting for processes to exit. Nov 18 18:48:34 oleg228-client systemd-logind[1015]: Removed session 239. Nov 18 18:53:56 oleg228-client sshd[49789]: Accepted publickey for root from 192.168.202.28 port 33608 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:53:56 oleg228-client systemd[1]: Started Session 240 of user root. Nov 18 18:53:56 oleg228-client systemd-logind[1015]: New session 240 of user root. Nov 18 18:53:56 oleg228-client sshd[49789]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:53:56 oleg228-client sshd[49802]: Received disconnect from 192.168.202.28 port 33608:11: disconnected by user Nov 18 18:53:56 oleg228-client sshd[49802]: Disconnected from user root 192.168.202.28 port 33608 Nov 18 18:53:56 oleg228-client sshd[49789]: pam_unix(sshd:session): session closed for user root Nov 18 18:53:56 oleg228-client systemd-logind[1015]: Session 240 logged out. Waiting for processes to exit. Nov 18 18:53:56 oleg228-client systemd[1]: session-240.scope: Succeeded. Nov 18 18:53:56 oleg228-client systemd-logind[1015]: Removed session 240. Nov 18 18:53:59 oleg228-client sshd[50026]: Accepted publickey for root from 192.168.202.28 port 33610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:53:59 oleg228-client systemd-logind[1015]: New session 241 of user root. Nov 18 18:53:59 oleg228-client systemd[1]: Started Session 241 of user root. Nov 18 18:53:59 oleg228-client sshd[50026]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:54:00 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 18:54:00 oleg228-client sshd[50039]: Received disconnect from 192.168.202.28 port 33610:11: disconnected by user Nov 18 18:54:00 oleg228-client sshd[50039]: Disconnected from user root 192.168.202.28 port 33610 Nov 18 18:54:00 oleg228-client sshd[50026]: pam_unix(sshd:session): session closed for user root Nov 18 18:54:00 oleg228-client systemd[1]: session-241.scope: Succeeded. Nov 18 18:54:00 oleg228-client systemd-logind[1015]: Session 241 logged out. Waiting for processes to exit. Nov 18 18:54:00 oleg228-client systemd-logind[1015]: Removed session 241. Nov 18 18:54:01 oleg228-client sshd[50183]: Accepted publickey for root from 192.168.202.28 port 39006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:54:01 oleg228-client systemd[1]: Started Session 242 of user root. Nov 18 18:54:01 oleg228-client systemd-logind[1015]: New session 242 of user root. Nov 18 18:54:01 oleg228-client sshd[50183]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:54:01 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 18:54:01 oleg228-client sshd[50196]: Received disconnect from 192.168.202.28 port 39006:11: disconnected by user Nov 18 18:54:01 oleg228-client sshd[50196]: Disconnected from user root 192.168.202.28 port 39006 Nov 18 18:54:01 oleg228-client sshd[50183]: pam_unix(sshd:session): session closed for user root Nov 18 18:54:02 oleg228-client systemd[1]: session-242.scope: Succeeded. Nov 18 18:54:02 oleg228-client systemd-logind[1015]: Session 242 logged out. Waiting for processes to exit. Nov 18 18:54:02 oleg228-client systemd-logind[1015]: Removed session 242. Nov 18 18:54:03 oleg228-client sshd[50237]: Accepted publickey for root from 192.168.202.28 port 39022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:54:03 oleg228-client systemd-logind[1015]: New session 243 of user root. Nov 18 18:54:03 oleg228-client systemd[1]: Started Session 243 of user root. Nov 18 18:54:03 oleg228-client sshd[50237]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:54:04 oleg228-client sshd[50250]: Received disconnect from 192.168.202.28 port 39022:11: disconnected by user Nov 18 18:54:04 oleg228-client sshd[50250]: Disconnected from user root 192.168.202.28 port 39022 Nov 18 18:54:04 oleg228-client sshd[50237]: pam_unix(sshd:session): session closed for user root Nov 18 18:54:04 oleg228-client systemd[1]: session-243.scope: Succeeded. Nov 18 18:54:04 oleg228-client systemd-logind[1015]: Session 243 logged out. Waiting for processes to exit. Nov 18 18:54:04 oleg228-client systemd-logind[1015]: Removed session 243. Nov 18 18:59:01 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551f800: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 18:59:01 oleg228-client kernel: LustreError: Skipped 6 previous similar messages Nov 18 18:59:01 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc551f800: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 18:59:01 oleg228-client kernel: Lustre: Skipped 4 previous similar messages Nov 18 18:59:30 oleg228-client sshd[50620]: Accepted publickey for root from 192.168.202.28 port 59414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:59:31 oleg228-client systemd[1]: Started Session 244 of user root. Nov 18 18:59:31 oleg228-client systemd-logind[1015]: New session 244 of user root. Nov 18 18:59:31 oleg228-client sshd[50620]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:59:31 oleg228-client sshd[50633]: Received disconnect from 192.168.202.28 port 59414:11: disconnected by user Nov 18 18:59:31 oleg228-client sshd[50633]: Disconnected from user root 192.168.202.28 port 59414 Nov 18 18:59:31 oleg228-client sshd[50620]: pam_unix(sshd:session): session closed for user root Nov 18 18:59:31 oleg228-client systemd-logind[1015]: Session 244 logged out. Waiting for processes to exit. Nov 18 18:59:31 oleg228-client systemd[1]: session-244.scope: Succeeded. Nov 18 18:59:31 oleg228-client systemd-logind[1015]: Removed session 244. Nov 18 18:59:34 oleg228-client sshd[50857]: Accepted publickey for root from 192.168.202.28 port 59430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:59:35 oleg228-client systemd-logind[1015]: New session 245 of user root. Nov 18 18:59:35 oleg228-client systemd[1]: Started Session 245 of user root. Nov 18 18:59:35 oleg228-client sshd[50857]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:59:35 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 18:59:35 oleg228-client sshd[50870]: Received disconnect from 192.168.202.28 port 59430:11: disconnected by user Nov 18 18:59:35 oleg228-client sshd[50870]: Disconnected from user root 192.168.202.28 port 59430 Nov 18 18:59:35 oleg228-client sshd[50857]: pam_unix(sshd:session): session closed for user root Nov 18 18:59:35 oleg228-client systemd[1]: session-245.scope: Succeeded. Nov 18 18:59:35 oleg228-client systemd-logind[1015]: Session 245 logged out. Waiting for processes to exit. Nov 18 18:59:35 oleg228-client systemd-logind[1015]: Removed session 245. Nov 18 18:59:36 oleg228-client sshd[51014]: Accepted publickey for root from 192.168.202.28 port 59446 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:59:37 oleg228-client systemd[1]: Started Session 246 of user root. Nov 18 18:59:37 oleg228-client systemd-logind[1015]: New session 246 of user root. Nov 18 18:59:37 oleg228-client sshd[51014]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:59:37 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 18:59:37 oleg228-client sshd[51027]: Received disconnect from 192.168.202.28 port 59446:11: disconnected by user Nov 18 18:59:37 oleg228-client sshd[51027]: Disconnected from user root 192.168.202.28 port 59446 Nov 18 18:59:37 oleg228-client sshd[51014]: pam_unix(sshd:session): session closed for user root Nov 18 18:59:37 oleg228-client systemd-logind[1015]: Session 246 logged out. Waiting for processes to exit. Nov 18 18:59:37 oleg228-client systemd[1]: session-246.scope: Succeeded. Nov 18 18:59:37 oleg228-client systemd-logind[1015]: Removed session 246. Nov 18 18:59:38 oleg228-client sshd[51068]: Accepted publickey for root from 192.168.202.28 port 59458 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 18:59:39 oleg228-client systemd-logind[1015]: New session 247 of user root. Nov 18 18:59:39 oleg228-client systemd[1]: Started Session 247 of user root. Nov 18 18:59:39 oleg228-client sshd[51068]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 18:59:39 oleg228-client sshd[51081]: Received disconnect from 192.168.202.28 port 59458:11: disconnected by user Nov 18 18:59:39 oleg228-client sshd[51081]: Disconnected from user root 192.168.202.28 port 59458 Nov 18 18:59:39 oleg228-client sshd[51068]: pam_unix(sshd:session): session closed for user root Nov 18 18:59:39 oleg228-client systemd[1]: session-247.scope: Succeeded. Nov 18 18:59:39 oleg228-client systemd-logind[1015]: Session 247 logged out. Waiting for processes to exit. Nov 18 18:59:39 oleg228-client systemd-logind[1015]: Removed session 247. Nov 18 19:01:02 oleg228-client CROND[51128]: (root) CMD (run-parts /etc/cron.hourly) Nov 18 19:01:02 oleg228-client run-parts[51128]: (/etc/cron.hourly) starting 0anacron Nov 18 19:01:02 oleg228-client anacron[51137]: Anacron started on 2025-11-18 Nov 18 19:01:02 oleg228-client anacron[51137]: Will run job `cron.daily' in 23 min. Nov 18 19:01:02 oleg228-client anacron[51137]: Will run job `cron.weekly' in 43 min. Nov 18 19:01:02 oleg228-client anacron[51137]: Will run job `cron.monthly' in 63 min. Nov 18 19:01:02 oleg228-client anacron[51137]: Jobs will be executed sequentially Nov 18 19:01:02 oleg228-client run-parts[51128]: (/etc/cron.hourly) finished 0anacron Nov 18 19:03:49 oleg228-client sshd[51261]: Accepted publickey for root from 192.168.202.28 port 54892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:03:49 oleg228-client systemd-logind[1015]: New session 248 of user root. Nov 18 19:03:49 oleg228-client systemd[1]: Started Session 248 of user root. Nov 18 19:03:49 oleg228-client sshd[51261]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:03:49 oleg228-client sshd[51274]: Received disconnect from 192.168.202.28 port 54892:11: disconnected by user Nov 18 19:03:49 oleg228-client sshd[51274]: Disconnected from user root 192.168.202.28 port 54892 Nov 18 19:03:49 oleg228-client sshd[51261]: pam_unix(sshd:session): session closed for user root Nov 18 19:03:49 oleg228-client systemd[1]: session-248.scope: Succeeded. Nov 18 19:03:49 oleg228-client systemd-logind[1015]: Session 248 logged out. Waiting for processes to exit. Nov 18 19:03:49 oleg228-client systemd-logind[1015]: Removed session 248. Nov 18 19:03:51 oleg228-client sshd[51402]: Accepted publickey for root from 192.168.202.28 port 52338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:03:51 oleg228-client systemd-logind[1015]: New session 249 of user root. Nov 18 19:03:51 oleg228-client systemd[1]: Started Session 249 of user root. Nov 18 19:03:51 oleg228-client sshd[51402]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:03:51 oleg228-client sshd[51415]: Received disconnect from 192.168.202.28 port 52338:11: disconnected by user Nov 18 19:03:51 oleg228-client sshd[51415]: Disconnected from user root 192.168.202.28 port 52338 Nov 18 19:03:51 oleg228-client sshd[51402]: pam_unix(sshd:session): session closed for user root Nov 18 19:03:51 oleg228-client systemd-logind[1015]: Session 249 logged out. Waiting for processes to exit. Nov 18 19:03:51 oleg228-client systemd[1]: session-249.scope: Succeeded. Nov 18 19:03:51 oleg228-client systemd-logind[1015]: Removed session 249. Nov 18 19:03:52 oleg228-client sshd[51548]: Accepted publickey for root from 192.168.202.28 port 52348 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:03:52 oleg228-client systemd[1]: Started Session 250 of user root. Nov 18 19:03:52 oleg228-client sshd[51548]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:03:52 oleg228-client systemd-logind[1015]: New session 250 of user root. Nov 18 19:03:52 oleg228-client sshd[51561]: Received disconnect from 192.168.202.28 port 52348:11: disconnected by user Nov 18 19:03:52 oleg228-client sshd[51561]: Disconnected from user root 192.168.202.28 port 52348 Nov 18 19:03:52 oleg228-client sshd[51548]: pam_unix(sshd:session): session closed for user root Nov 18 19:03:52 oleg228-client systemd[1]: session-250.scope: Succeeded. Nov 18 19:03:52 oleg228-client systemd-logind[1015]: Session 250 logged out. Waiting for processes to exit. Nov 18 19:03:52 oleg228-client systemd-logind[1015]: Removed session 250. Nov 18 19:03:53 oleg228-client sshd[51703]: Accepted publickey for root from 192.168.202.28 port 52352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:03:53 oleg228-client systemd-logind[1015]: New session 251 of user root. Nov 18 19:03:53 oleg228-client systemd[1]: Started Session 251 of user root. Nov 18 19:03:53 oleg228-client sshd[51703]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:03:54 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53a: touch: drop rep ============== 19:03:53 (1763510633) Nov 18 19:03:54 oleg228-client sshd[51716]: Received disconnect from 192.168.202.28 port 52352:11: disconnected by user Nov 18 19:03:54 oleg228-client sshd[51716]: Disconnected from user root 192.168.202.28 port 52352 Nov 18 19:03:54 oleg228-client sshd[51703]: pam_unix(sshd:session): session closed for user root Nov 18 19:03:54 oleg228-client systemd-logind[1015]: Session 251 logged out. Waiting for processes to exit. Nov 18 19:03:54 oleg228-client systemd[1]: session-251.scope: Succeeded. Nov 18 19:03:54 oleg228-client systemd-logind[1015]: Removed session 251. Nov 18 19:04:11 oleg228-client kernel: Lustre: 51819:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763510635/real 1763510635] req@ffff9ccbc83b0000 x1849171064358784/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc551f800@192.168.202.128@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763510651 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'openfile.0' uid:0 gid:0 projid:0 Nov 18 19:04:11 oleg228-client kernel: Lustre: 51819:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Nov 18 19:04:11 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc551f800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:04:11 oleg228-client kernel: Lustre: Skipped 13 previous similar messages Nov 18 19:04:13 oleg228-client sshd[51947]: Accepted publickey for root from 192.168.202.28 port 53748 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:13 oleg228-client systemd-logind[1015]: New session 252 of user root. Nov 18 19:04:13 oleg228-client systemd[1]: Started Session 252 of user root. Nov 18 19:04:13 oleg228-client sshd[51947]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:13 oleg228-client sshd[51960]: Received disconnect from 192.168.202.28 port 53748:11: disconnected by user Nov 18 19:04:13 oleg228-client sshd[51960]: Disconnected from user root 192.168.202.28 port 53748 Nov 18 19:04:13 oleg228-client sshd[51947]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:14 oleg228-client systemd[1]: session-252.scope: Succeeded. Nov 18 19:04:14 oleg228-client systemd-logind[1015]: Session 252 logged out. Waiting for processes to exit. Nov 18 19:04:14 oleg228-client systemd-logind[1015]: Removed session 252. Nov 18 19:04:14 oleg228-client sshd[52087]: Accepted publickey for root from 192.168.202.28 port 53760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:14 oleg228-client systemd-logind[1015]: New session 253 of user root. Nov 18 19:04:14 oleg228-client sshd[52087]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:14 oleg228-client systemd[1]: Started Session 253 of user root. Nov 18 19:04:15 oleg228-client sshd[52100]: Received disconnect from 192.168.202.28 port 53760:11: disconnected by user Nov 18 19:04:15 oleg228-client sshd[52100]: Disconnected from user root 192.168.202.28 port 53760 Nov 18 19:04:15 oleg228-client sshd[52087]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:15 oleg228-client systemd[1]: session-253.scope: Succeeded. Nov 18 19:04:15 oleg228-client systemd-logind[1015]: Session 253 logged out. Waiting for processes to exit. Nov 18 19:04:15 oleg228-client systemd-logind[1015]: Removed session 253. Nov 18 19:04:16 oleg228-client sshd[52233]: Accepted publickey for root from 192.168.202.28 port 53776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:16 oleg228-client systemd-logind[1015]: New session 254 of user root. Nov 18 19:04:16 oleg228-client systemd[1]: Started Session 254 of user root. Nov 18 19:04:16 oleg228-client sshd[52233]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:16 oleg228-client sshd[52246]: Received disconnect from 192.168.202.28 port 53776:11: disconnected by user Nov 18 19:04:16 oleg228-client sshd[52246]: Disconnected from user root 192.168.202.28 port 53776 Nov 18 19:04:16 oleg228-client sshd[52233]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:16 oleg228-client systemd[1]: session-254.scope: Succeeded. Nov 18 19:04:16 oleg228-client systemd-logind[1015]: Session 254 logged out. Waiting for processes to exit. Nov 18 19:04:16 oleg228-client systemd-logind[1015]: Removed session 254. Nov 18 19:04:18 oleg228-client sshd[52388]: Accepted publickey for root from 192.168.202.28 port 53780 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:18 oleg228-client systemd[1]: Started Session 255 of user root. Nov 18 19:04:18 oleg228-client systemd-logind[1015]: New session 255 of user root. Nov 18 19:04:18 oleg228-client sshd[52388]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:18 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53b: touch: drop rep ============== 19:04:17 (1763510657) Nov 18 19:04:18 oleg228-client sshd[52401]: Received disconnect from 192.168.202.28 port 53780:11: disconnected by user Nov 18 19:04:18 oleg228-client sshd[52401]: Disconnected from user root 192.168.202.28 port 53780 Nov 18 19:04:18 oleg228-client sshd[52388]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:18 oleg228-client systemd[1]: session-255.scope: Succeeded. Nov 18 19:04:18 oleg228-client systemd-logind[1015]: Session 255 logged out. Waiting for processes to exit. Nov 18 19:04:18 oleg228-client systemd-logind[1015]: Removed session 255. Nov 18 19:04:37 oleg228-client sshd[52631]: Accepted publickey for root from 192.168.202.28 port 46352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:37 oleg228-client systemd[1]: Started Session 256 of user root. Nov 18 19:04:37 oleg228-client systemd-logind[1015]: New session 256 of user root. Nov 18 19:04:37 oleg228-client sshd[52631]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:37 oleg228-client sshd[52644]: Received disconnect from 192.168.202.28 port 46352:11: disconnected by user Nov 18 19:04:38 oleg228-client sshd[52644]: Disconnected from user root 192.168.202.28 port 46352 Nov 18 19:04:38 oleg228-client sshd[52631]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:38 oleg228-client systemd[1]: session-256.scope: Succeeded. Nov 18 19:04:38 oleg228-client systemd-logind[1015]: Session 256 logged out. Waiting for processes to exit. Nov 18 19:04:38 oleg228-client systemd-logind[1015]: Removed session 256. Nov 18 19:04:39 oleg228-client sshd[52770]: Accepted publickey for root from 192.168.202.28 port 46356 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:39 oleg228-client systemd-logind[1015]: New session 257 of user root. Nov 18 19:04:39 oleg228-client systemd[1]: Started Session 257 of user root. Nov 18 19:04:39 oleg228-client sshd[52770]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:39 oleg228-client sshd[52783]: Received disconnect from 192.168.202.28 port 46356:11: disconnected by user Nov 18 19:04:39 oleg228-client sshd[52783]: Disconnected from user root 192.168.202.28 port 46356 Nov 18 19:04:39 oleg228-client sshd[52770]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:39 oleg228-client systemd[1]: session-257.scope: Succeeded. Nov 18 19:04:39 oleg228-client systemd-logind[1015]: Session 257 logged out. Waiting for processes to exit. Nov 18 19:04:39 oleg228-client systemd-logind[1015]: Removed session 257. Nov 18 19:04:40 oleg228-client sshd[52917]: Accepted publickey for root from 192.168.202.28 port 46364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:40 oleg228-client systemd-logind[1015]: New session 258 of user root. Nov 18 19:04:40 oleg228-client systemd[1]: Started Session 258 of user root. Nov 18 19:04:40 oleg228-client sshd[52917]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:41 oleg228-client sshd[52930]: Received disconnect from 192.168.202.28 port 46364:11: disconnected by user Nov 18 19:04:41 oleg228-client sshd[52930]: Disconnected from user root 192.168.202.28 port 46364 Nov 18 19:04:41 oleg228-client sshd[52917]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:41 oleg228-client systemd-logind[1015]: Session 258 logged out. Waiting for processes to exit. Nov 18 19:04:41 oleg228-client systemd[1]: session-258.scope: Succeeded. Nov 18 19:04:41 oleg228-client systemd-logind[1015]: Removed session 258. Nov 18 19:04:42 oleg228-client sshd[53072]: Accepted publickey for root from 192.168.202.28 port 58998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:04:42 oleg228-client systemd-logind[1015]: New session 259 of user root. Nov 18 19:04:42 oleg228-client systemd[1]: Started Session 259 of user root. Nov 18 19:04:42 oleg228-client sshd[53072]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:04:42 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 53c: touch: drop rep ============== 19:04:41 (1763510681) Nov 18 19:04:42 oleg228-client sshd[53085]: Received disconnect from 192.168.202.28 port 58998:11: disconnected by user Nov 18 19:04:42 oleg228-client sshd[53085]: Disconnected from user root 192.168.202.28 port 58998 Nov 18 19:04:42 oleg228-client sshd[53072]: pam_unix(sshd:session): session closed for user root Nov 18 19:04:42 oleg228-client systemd[1]: session-259.scope: Succeeded. Nov 18 19:04:42 oleg228-client systemd-logind[1015]: Session 259 logged out. Waiting for processes to exit. Nov 18 19:04:42 oleg228-client systemd-logind[1015]: Removed session 259. Nov 18 19:05:02 oleg228-client sshd[53316]: Accepted publickey for root from 192.168.202.28 port 50914 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:03 oleg228-client systemd[1]: Started Session 260 of user root. Nov 18 19:05:03 oleg228-client systemd-logind[1015]: New session 260 of user root. Nov 18 19:05:03 oleg228-client sshd[53316]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:03 oleg228-client sshd[53329]: Received disconnect from 192.168.202.28 port 50914:11: disconnected by user Nov 18 19:05:03 oleg228-client sshd[53329]: Disconnected from user root 192.168.202.28 port 50914 Nov 18 19:05:03 oleg228-client sshd[53316]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:03 oleg228-client systemd-logind[1015]: Session 260 logged out. Waiting for processes to exit. Nov 18 19:05:03 oleg228-client systemd[1]: session-260.scope: Succeeded. Nov 18 19:05:03 oleg228-client systemd-logind[1015]: Removed session 260. Nov 18 19:05:04 oleg228-client sshd[53455]: Accepted publickey for root from 192.168.202.28 port 50920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:04 oleg228-client systemd[1]: Started Session 261 of user root. Nov 18 19:05:04 oleg228-client systemd-logind[1015]: New session 261 of user root. Nov 18 19:05:04 oleg228-client sshd[53455]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:04 oleg228-client sshd[53468]: Received disconnect from 192.168.202.28 port 50920:11: disconnected by user Nov 18 19:05:04 oleg228-client sshd[53468]: Disconnected from user root 192.168.202.28 port 50920 Nov 18 19:05:04 oleg228-client sshd[53455]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:04 oleg228-client systemd-logind[1015]: Session 261 logged out. Waiting for processes to exit. Nov 18 19:05:04 oleg228-client systemd[1]: session-261.scope: Succeeded. Nov 18 19:05:04 oleg228-client systemd-logind[1015]: Removed session 261. Nov 18 19:05:05 oleg228-client sshd[53601]: Accepted publickey for root from 192.168.202.28 port 50926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:05 oleg228-client systemd-logind[1015]: New session 262 of user root. Nov 18 19:05:05 oleg228-client systemd[1]: Started Session 262 of user root. Nov 18 19:05:05 oleg228-client sshd[53601]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:06 oleg228-client sshd[53614]: Received disconnect from 192.168.202.28 port 50926:11: disconnected by user Nov 18 19:05:06 oleg228-client sshd[53614]: Disconnected from user root 192.168.202.28 port 50926 Nov 18 19:05:06 oleg228-client sshd[53601]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:06 oleg228-client systemd[1]: session-262.scope: Succeeded. Nov 18 19:05:06 oleg228-client systemd-logind[1015]: Session 262 logged out. Waiting for processes to exit. Nov 18 19:05:06 oleg228-client systemd-logind[1015]: Removed session 262. Nov 18 19:05:07 oleg228-client sshd[53756]: Accepted publickey for root from 192.168.202.28 port 50934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:07 oleg228-client systemd[1]: Started Session 263 of user root. Nov 18 19:05:07 oleg228-client sshd[53756]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:07 oleg228-client systemd-logind[1015]: New session 263 of user root. Nov 18 19:05:07 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 54: back in time ================== 19:05:06 (1763510706) Nov 18 19:05:07 oleg228-client sshd[53769]: Received disconnect from 192.168.202.28 port 50934:11: disconnected by user Nov 18 19:05:08 oleg228-client sshd[53769]: Disconnected from user root 192.168.202.28 port 50934 Nov 18 19:05:08 oleg228-client sshd[53756]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:08 oleg228-client systemd[1]: session-263.scope: Succeeded. Nov 18 19:05:08 oleg228-client systemd-logind[1015]: Session 263 logged out. Waiting for processes to exit. Nov 18 19:05:08 oleg228-client systemd-logind[1015]: Removed session 263. Nov 18 19:05:08 oleg228-client systemd-udevd[53828]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:05:08 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:05:39 oleg228-client kernel: Lustre: 2409:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763510723/real 1763510723] req@ffff9ccbc7f1ed80 x1849171064378624/t0(0) o400->MGC192.168.202.128@tcp@192.168.202.128@tcp:26/25 lens 224/224 e 0 to 1 dl 1763510739 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Nov 18 19:05:39 oleg228-client kernel: Lustre: 2409:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Nov 18 19:05:39 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:05:39 oleg228-client kernel: LustreError: Skipped 2 previous similar messages Nov 18 19:05:48 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbd01ac000: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:05:48 oleg228-client kernel: Lustre: Skipped 2 previous similar messages Nov 18 19:05:49 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25d3b2ba to 0x2622672b25eced83 Nov 18 19:05:49 oleg228-client kernel: Lustre: Skipped 2 previous similar messages Nov 18 19:05:51 oleg228-client sshd[54118]: Accepted publickey for root from 192.168.202.28 port 60830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:51 oleg228-client systemd[1]: Started Session 264 of user root. Nov 18 19:05:51 oleg228-client systemd-logind[1015]: New session 264 of user root. Nov 18 19:05:51 oleg228-client sshd[54118]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:52 oleg228-client sshd[54138]: Received disconnect from 192.168.202.28 port 60830:11: disconnected by user Nov 18 19:05:52 oleg228-client sshd[54138]: Disconnected from user root 192.168.202.28 port 60830 Nov 18 19:05:52 oleg228-client sshd[54118]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:52 oleg228-client systemd[1]: session-264.scope: Succeeded. Nov 18 19:05:52 oleg228-client systemd-logind[1015]: Session 264 logged out. Waiting for processes to exit. Nov 18 19:05:52 oleg228-client systemd-logind[1015]: Removed session 264. Nov 18 19:05:54 oleg228-client sshd[54362]: Accepted publickey for root from 192.168.202.28 port 60842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:54 oleg228-client systemd-logind[1015]: New session 265 of user root. Nov 18 19:05:54 oleg228-client systemd[1]: Started Session 265 of user root. Nov 18 19:05:54 oleg228-client sshd[54362]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:55 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 19:05:55 oleg228-client sshd[54375]: Received disconnect from 192.168.202.28 port 60842:11: disconnected by user Nov 18 19:05:55 oleg228-client sshd[54375]: Disconnected from user root 192.168.202.28 port 60842 Nov 18 19:05:55 oleg228-client sshd[54362]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:55 oleg228-client systemd[1]: session-265.scope: Succeeded. Nov 18 19:05:55 oleg228-client systemd-logind[1015]: Session 265 logged out. Waiting for processes to exit. Nov 18 19:05:55 oleg228-client systemd-logind[1015]: Removed session 265. Nov 18 19:05:56 oleg228-client sshd[54518]: Accepted publickey for root from 192.168.202.28 port 60848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:56 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:05:56 oleg228-client systemd-logind[1015]: New session 266 of user root. Nov 18 19:05:56 oleg228-client systemd[1]: Started Session 266 of user root. Nov 18 19:05:56 oleg228-client sshd[54518]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:56 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 19:05:56 oleg228-client sshd[54532]: Received disconnect from 192.168.202.28 port 60848:11: disconnected by user Nov 18 19:05:56 oleg228-client sshd[54532]: Disconnected from user root 192.168.202.28 port 60848 Nov 18 19:05:56 oleg228-client sshd[54518]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:56 oleg228-client systemd-logind[1015]: Session 266 logged out. Waiting for processes to exit. Nov 18 19:05:56 oleg228-client systemd[1]: session-266.scope: Succeeded. Nov 18 19:05:56 oleg228-client systemd-logind[1015]: Removed session 266. Nov 18 19:05:58 oleg228-client sshd[54574]: Accepted publickey for root from 192.168.202.28 port 60860 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:58 oleg228-client systemd[1]: Started Session 267 of user root. Nov 18 19:05:58 oleg228-client systemd-logind[1015]: New session 267 of user root. Nov 18 19:05:58 oleg228-client sshd[54574]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:05:58 oleg228-client sshd[54587]: Received disconnect from 192.168.202.28 port 60860:11: disconnected by user Nov 18 19:05:58 oleg228-client sshd[54587]: Disconnected from user root 192.168.202.28 port 60860 Nov 18 19:05:58 oleg228-client sshd[54574]: pam_unix(sshd:session): session closed for user root Nov 18 19:05:58 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 19:05:58 oleg228-client kernel: LustreError: 54610:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbd01ac000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:05:58 oleg228-client kernel: LustreError: 54610:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:05:58 oleg228-client kernel: LustreError: 54610:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 19:05:58 oleg228-client kernel: LustreError: 54610:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:05:58 oleg228-client systemd[1]: session-267.scope: Succeeded. Nov 18 19:05:58 oleg228-client systemd-logind[1015]: Session 267 logged out. Waiting for processes to exit. Nov 18 19:05:58 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:05:58 oleg228-client systemd-logind[1015]: Removed session 267. Nov 18 19:05:59 oleg228-client sshd[54713]: Accepted publickey for root from 192.168.202.28 port 60864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:05:59 oleg228-client systemd-logind[1015]: New session 268 of user root. Nov 18 19:05:59 oleg228-client systemd[1]: Started Session 268 of user root. Nov 18 19:05:59 oleg228-client sshd[54713]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:06:00 oleg228-client sshd[54727]: Received disconnect from 192.168.202.28 port 60864:11: disconnected by user Nov 18 19:06:00 oleg228-client sshd[54727]: Disconnected from user root 192.168.202.28 port 60864 Nov 18 19:06:00 oleg228-client sshd[54713]: pam_unix(sshd:session): session closed for user root Nov 18 19:06:00 oleg228-client systemd-logind[1015]: Session 268 logged out. Waiting for processes to exit. Nov 18 19:06:00 oleg228-client systemd[1]: session-268.scope: Succeeded. Nov 18 19:06:00 oleg228-client systemd-logind[1015]: Removed session 268. Nov 18 19:06:01 oleg228-client sshd[54853]: Accepted publickey for root from 192.168.202.28 port 53216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:06:01 oleg228-client systemd-logind[1015]: New session 269 of user root. Nov 18 19:06:01 oleg228-client systemd[1]: Started Session 269 of user root. Nov 18 19:06:01 oleg228-client sshd[54853]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:06:01 oleg228-client sshd[54866]: Received disconnect from 192.168.202.28 port 53216:11: disconnected by user Nov 18 19:06:01 oleg228-client sshd[54866]: Disconnected from user root 192.168.202.28 port 53216 Nov 18 19:06:01 oleg228-client sshd[54853]: pam_unix(sshd:session): session closed for user root Nov 18 19:06:01 oleg228-client systemd[1]: session-269.scope: Succeeded. Nov 18 19:06:01 oleg228-client systemd-logind[1015]: Session 269 logged out. Waiting for processes to exit. Nov 18 19:06:01 oleg228-client systemd-logind[1015]: Removed session 269. Nov 18 19:06:02 oleg228-client sshd[54999]: Accepted publickey for root from 192.168.202.28 port 53220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:06:02 oleg228-client systemd-logind[1015]: New session 270 of user root. Nov 18 19:06:02 oleg228-client systemd[1]: Started Session 270 of user root. Nov 18 19:06:02 oleg228-client sshd[54999]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:06:03 oleg228-client sshd[55013]: Received disconnect from 192.168.202.28 port 53220:11: disconnected by user Nov 18 19:06:03 oleg228-client sshd[55013]: Disconnected from user root 192.168.202.28 port 53220 Nov 18 19:06:03 oleg228-client sshd[54999]: pam_unix(sshd:session): session closed for user root Nov 18 19:06:03 oleg228-client systemd-logind[1015]: Session 270 logged out. Waiting for processes to exit. Nov 18 19:06:03 oleg228-client systemd[1]: session-270.scope: Succeeded. Nov 18 19:06:03 oleg228-client systemd-logind[1015]: Removed session 270. Nov 18 19:06:04 oleg228-client sshd[55155]: Accepted publickey for root from 192.168.202.28 port 53234 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:06:04 oleg228-client systemd-logind[1015]: New session 271 of user root. Nov 18 19:06:04 oleg228-client systemd[1]: Started Session 271 of user root. Nov 18 19:06:04 oleg228-client sshd[55155]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:06:04 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 55: ost_brw_read/write drops timed-out read/write request ========================================================== 19:06:03 (1763510763) Nov 18 19:06:04 oleg228-client sshd[55168]: Received disconnect from 192.168.202.28 port 53234:11: disconnected by user Nov 18 19:06:04 oleg228-client sshd[55168]: Disconnected from user root 192.168.202.28 port 53234 Nov 18 19:06:04 oleg228-client sshd[55155]: pam_unix(sshd:session): session closed for user root Nov 18 19:06:05 oleg228-client systemd[1]: session-271.scope: Succeeded. Nov 18 19:06:05 oleg228-client systemd-logind[1015]: Session 271 logged out. Waiting for processes to exit. Nov 18 19:06:05 oleg228-client systemd-logind[1015]: Removed session 271. Nov 18 19:07:35 oleg228-client sshd[55447]: Accepted publickey for root from 192.168.202.28 port 32920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:07:35 oleg228-client systemd-logind[1015]: New session 272 of user root. Nov 18 19:07:35 oleg228-client systemd[1]: Started Session 272 of user root. Nov 18 19:07:35 oleg228-client sshd[55447]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:07:35 oleg228-client sshd[55460]: Received disconnect from 192.168.202.28 port 32920:11: disconnected by user Nov 18 19:07:35 oleg228-client sshd[55460]: Disconnected from user root 192.168.202.28 port 32920 Nov 18 19:07:35 oleg228-client sshd[55447]: pam_unix(sshd:session): session closed for user root Nov 18 19:07:35 oleg228-client systemd[1]: session-272.scope: Succeeded. Nov 18 19:07:35 oleg228-client systemd-logind[1015]: Session 272 logged out. Waiting for processes to exit. Nov 18 19:07:35 oleg228-client systemd-logind[1015]: Removed session 272. Nov 18 19:07:37 oleg228-client sshd[55586]: Accepted publickey for root from 192.168.202.28 port 32926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:07:37 oleg228-client systemd-logind[1015]: New session 273 of user root. Nov 18 19:07:37 oleg228-client systemd[1]: Started Session 273 of user root. Nov 18 19:07:37 oleg228-client sshd[55586]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:07:37 oleg228-client sshd[55599]: Received disconnect from 192.168.202.28 port 32926:11: disconnected by user Nov 18 19:07:37 oleg228-client sshd[55599]: Disconnected from user root 192.168.202.28 port 32926 Nov 18 19:07:37 oleg228-client sshd[55586]: pam_unix(sshd:session): session closed for user root Nov 18 19:07:37 oleg228-client systemd[1]: session-273.scope: Succeeded. Nov 18 19:07:37 oleg228-client systemd-logind[1015]: Session 273 logged out. Waiting for processes to exit. Nov 18 19:07:37 oleg228-client systemd-logind[1015]: Removed session 273. Nov 18 19:07:38 oleg228-client sshd[55732]: Accepted publickey for root from 192.168.202.28 port 32932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:07:38 oleg228-client systemd-logind[1015]: New session 274 of user root. Nov 18 19:07:38 oleg228-client systemd[1]: Started Session 274 of user root. Nov 18 19:07:38 oleg228-client sshd[55732]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:07:39 oleg228-client sshd[55745]: Received disconnect from 192.168.202.28 port 32932:11: disconnected by user Nov 18 19:07:39 oleg228-client sshd[55745]: Disconnected from user root 192.168.202.28 port 32932 Nov 18 19:07:39 oleg228-client sshd[55732]: pam_unix(sshd:session): session closed for user root Nov 18 19:07:39 oleg228-client systemd[1]: session-274.scope: Succeeded. Nov 18 19:07:39 oleg228-client systemd-logind[1015]: Session 274 logged out. Waiting for processes to exit. Nov 18 19:07:39 oleg228-client systemd-logind[1015]: Removed session 274. Nov 18 19:07:40 oleg228-client sshd[55888]: Accepted publickey for root from 192.168.202.28 port 32934 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:07:40 oleg228-client systemd[1]: Started Session 275 of user root. Nov 18 19:07:40 oleg228-client systemd-logind[1015]: New session 275 of user root. Nov 18 19:07:40 oleg228-client sshd[55888]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:07:40 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 56: do not fail on getattr resend ========================================================== 19:07:39 (1763510859) Nov 18 19:07:40 oleg228-client sshd[55901]: Received disconnect from 192.168.202.28 port 32934:11: disconnected by user Nov 18 19:07:40 oleg228-client sshd[55901]: Disconnected from user root 192.168.202.28 port 32934 Nov 18 19:07:40 oleg228-client sshd[55888]: pam_unix(sshd:session): session closed for user root Nov 18 19:07:41 oleg228-client systemd[1]: session-275.scope: Succeeded. Nov 18 19:07:41 oleg228-client systemd-logind[1015]: Session 275 logged out. Waiting for processes to exit. Nov 18 19:07:41 oleg228-client systemd-logind[1015]: Removed session 275. Nov 18 19:08:13 oleg228-client kernel: Lustre: 55946:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763510877/real 1763510877] req@ffff9ccbc842ea00 x1849171064425216/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc551f800@192.168.202.128@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763510893 ref 2 fl Rpc:XQr/602/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 Nov 18 19:08:13 oleg228-client kernel: Lustre: 55946:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 33 previous similar messages Nov 18 19:08:24 oleg228-client sshd[56051]: Accepted publickey for root from 192.168.202.28 port 57702 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:24 oleg228-client systemd-logind[1015]: New session 276 of user root. Nov 18 19:08:24 oleg228-client systemd[1]: Started Session 276 of user root. Nov 18 19:08:24 oleg228-client sshd[56051]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:24 oleg228-client sshd[56064]: Received disconnect from 192.168.202.28 port 57702:11: disconnected by user Nov 18 19:08:24 oleg228-client sshd[56064]: Disconnected from user root 192.168.202.28 port 57702 Nov 18 19:08:24 oleg228-client sshd[56051]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:24 oleg228-client systemd[1]: session-276.scope: Succeeded. Nov 18 19:08:24 oleg228-client systemd-logind[1015]: Session 276 logged out. Waiting for processes to exit. Nov 18 19:08:24 oleg228-client systemd-logind[1015]: Removed session 276. Nov 18 19:08:25 oleg228-client sshd[56190]: Accepted publickey for root from 192.168.202.28 port 57718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:25 oleg228-client systemd-logind[1015]: New session 277 of user root. Nov 18 19:08:25 oleg228-client systemd[1]: Started Session 277 of user root. Nov 18 19:08:25 oleg228-client sshd[56190]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:25 oleg228-client sshd[56203]: Received disconnect from 192.168.202.28 port 57718:11: disconnected by user Nov 18 19:08:25 oleg228-client sshd[56203]: Disconnected from user root 192.168.202.28 port 57718 Nov 18 19:08:25 oleg228-client sshd[56190]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:25 oleg228-client systemd[1]: session-277.scope: Succeeded. Nov 18 19:08:25 oleg228-client systemd-logind[1015]: Session 277 logged out. Waiting for processes to exit. Nov 18 19:08:25 oleg228-client systemd-logind[1015]: Removed session 277. Nov 18 19:08:26 oleg228-client sshd[56336]: Accepted publickey for root from 192.168.202.28 port 57724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:26 oleg228-client systemd-logind[1015]: New session 278 of user root. Nov 18 19:08:26 oleg228-client systemd[1]: Started Session 278 of user root. Nov 18 19:08:26 oleg228-client sshd[56336]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:27 oleg228-client sshd[56349]: Received disconnect from 192.168.202.28 port 57724:11: disconnected by user Nov 18 19:08:27 oleg228-client sshd[56349]: Disconnected from user root 192.168.202.28 port 57724 Nov 18 19:08:27 oleg228-client sshd[56336]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:27 oleg228-client systemd[1]: session-278.scope: Succeeded. Nov 18 19:08:27 oleg228-client systemd-logind[1015]: Session 278 logged out. Waiting for processes to exit. Nov 18 19:08:27 oleg228-client systemd-logind[1015]: Removed session 278. Nov 18 19:08:28 oleg228-client sshd[56491]: Accepted publickey for root from 192.168.202.28 port 57732 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:28 oleg228-client systemd[1]: Started Session 279 of user root. Nov 18 19:08:28 oleg228-client systemd-logind[1015]: New session 279 of user root. Nov 18 19:08:28 oleg228-client sshd[56491]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 57: read procfs entries causes kernel crash ========================================================== 19:08:27 (1763510907) Nov 18 19:08:28 oleg228-client sshd[56504]: Received disconnect from 192.168.202.28 port 57732:11: disconnected by user Nov 18 19:08:28 oleg228-client sshd[56504]: Disconnected from user root 192.168.202.28 port 57732 Nov 18 19:08:28 oleg228-client sshd[56491]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:29 oleg228-client systemd-logind[1015]: Session 279 logged out. Waiting for processes to exit. Nov 18 19:08:29 oleg228-client systemd[1]: session-279.scope: Succeeded. Nov 18 19:08:29 oleg228-client systemd-logind[1015]: Removed session 279. Nov 18 19:08:30 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 19:08:30 oleg228-client kernel: LustreError: 56562:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc551f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:08:30 oleg228-client kernel: LustreError: 56562:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:08:30 oleg228-client kernel: LustreError: 56562:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 19:08:30 oleg228-client kernel: LustreError: 56562:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:08:30 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:08:48 oleg228-client sshd[56822]: Accepted publickey for root from 192.168.202.28 port 47808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:48 oleg228-client systemd-logind[1015]: New session 280 of user root. Nov 18 19:08:48 oleg228-client systemd[1]: Started Session 280 of user root. Nov 18 19:08:48 oleg228-client sshd[56822]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:48 oleg228-client sshd[56835]: Received disconnect from 192.168.202.28 port 47808:11: disconnected by user Nov 18 19:08:48 oleg228-client sshd[56835]: Disconnected from user root 192.168.202.28 port 47808 Nov 18 19:08:49 oleg228-client sshd[56822]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:49 oleg228-client systemd[1]: session-280.scope: Succeeded. Nov 18 19:08:49 oleg228-client systemd-logind[1015]: Session 280 logged out. Waiting for processes to exit. Nov 18 19:08:49 oleg228-client systemd-logind[1015]: Removed session 280. Nov 18 19:08:50 oleg228-client sshd[56874]: Accepted publickey for root from 192.168.202.28 port 47822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:08:50 oleg228-client systemd[1]: Started Session 281 of user root. Nov 18 19:08:50 oleg228-client systemd-logind[1015]: New session 281 of user root. Nov 18 19:08:50 oleg228-client sshd[56874]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:08:50 oleg228-client sshd[56887]: Received disconnect from 192.168.202.28 port 47822:11: disconnected by user Nov 18 19:08:50 oleg228-client sshd[56887]: Disconnected from user root 192.168.202.28 port 47822 Nov 18 19:08:50 oleg228-client sshd[56874]: pam_unix(sshd:session): session closed for user root Nov 18 19:08:51 oleg228-client systemd[1]: session-281.scope: Succeeded. Nov 18 19:08:51 oleg228-client systemd-logind[1015]: Session 281 logged out. Waiting for processes to exit. Nov 18 19:08:51 oleg228-client systemd-logind[1015]: Removed session 281. Nov 18 19:08:59 oleg228-client systemd-udevd[57068]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:08:59 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:09:00 oleg228-client sshd[57176]: Accepted publickey for root from 192.168.202.28 port 40148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:00 oleg228-client systemd-logind[1015]: New session 282 of user root. Nov 18 19:09:00 oleg228-client systemd[1]: Started Session 282 of user root. Nov 18 19:09:00 oleg228-client sshd[57176]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:00 oleg228-client sshd[57189]: Received disconnect from 192.168.202.28 port 40148:11: disconnected by user Nov 18 19:09:00 oleg228-client sshd[57189]: Disconnected from user root 192.168.202.28 port 40148 Nov 18 19:09:00 oleg228-client sshd[57176]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:00 oleg228-client systemd[1]: session-282.scope: Succeeded. Nov 18 19:09:00 oleg228-client systemd-logind[1015]: Session 282 logged out. Waiting for processes to exit. Nov 18 19:09:00 oleg228-client systemd-logind[1015]: Removed session 282. Nov 18 19:09:01 oleg228-client sshd[57316]: Accepted publickey for root from 192.168.202.28 port 55306 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:01 oleg228-client systemd-logind[1015]: New session 283 of user root. Nov 18 19:09:01 oleg228-client systemd[1]: Started Session 283 of user root. Nov 18 19:09:01 oleg228-client sshd[57316]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:01 oleg228-client sshd[57329]: Received disconnect from 192.168.202.28 port 55306:11: disconnected by user Nov 18 19:09:01 oleg228-client sshd[57329]: Disconnected from user root 192.168.202.28 port 55306 Nov 18 19:09:01 oleg228-client sshd[57316]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:01 oleg228-client systemd[1]: session-283.scope: Succeeded. Nov 18 19:09:01 oleg228-client systemd-logind[1015]: Session 283 logged out. Waiting for processes to exit. Nov 18 19:09:01 oleg228-client systemd-logind[1015]: Removed session 283. Nov 18 19:09:02 oleg228-client sshd[57462]: Accepted publickey for root from 192.168.202.28 port 55318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:03 oleg228-client systemd-logind[1015]: New session 284 of user root. Nov 18 19:09:03 oleg228-client systemd[1]: Started Session 284 of user root. Nov 18 19:09:03 oleg228-client sshd[57462]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:03 oleg228-client sshd[57475]: Received disconnect from 192.168.202.28 port 55318:11: disconnected by user Nov 18 19:09:03 oleg228-client sshd[57475]: Disconnected from user root 192.168.202.28 port 55318 Nov 18 19:09:03 oleg228-client sshd[57462]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:03 oleg228-client systemd[1]: session-284.scope: Succeeded. Nov 18 19:09:03 oleg228-client systemd-logind[1015]: Session 284 logged out. Waiting for processes to exit. Nov 18 19:09:03 oleg228-client systemd-logind[1015]: Removed session 284. Nov 18 19:09:04 oleg228-client sshd[57617]: Accepted publickey for root from 192.168.202.28 port 55332 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:04 oleg228-client systemd-logind[1015]: New session 285 of user root. Nov 18 19:09:04 oleg228-client systemd[1]: Started Session 285 of user root. Nov 18 19:09:05 oleg228-client sshd[57617]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:05 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 58: Eviction in the middle of open RPC reply processing ========================================================== 19:09:03 (1763510943) Nov 18 19:09:05 oleg228-client sshd[57630]: Received disconnect from 192.168.202.28 port 55332:11: disconnected by user Nov 18 19:09:05 oleg228-client sshd[57630]: Disconnected from user root 192.168.202.28 port 55332 Nov 18 19:09:05 oleg228-client sshd[57617]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:05 oleg228-client systemd-logind[1015]: Session 285 logged out. Waiting for processes to exit. Nov 18 19:09:05 oleg228-client systemd[1]: session-285.scope: Succeeded. Nov 18 19:09:05 oleg228-client systemd-logind[1015]: Removed session 285. Nov 18 19:09:05 oleg228-client kernel: LustreError: 57668:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout id 801 sleeping for 20000ms Nov 18 19:09:06 oleg228-client kernel: LustreError: 57668:0:(mdc_locks.c:1335:mdc_finish_intent_lock()) cfs_fail_timeout interrupted Nov 18 19:09:06 oleg228-client kernel: Lustre: *** cfs_fail_loc=305, val=0*** Nov 18 19:09:23 oleg228-client sshd[57802]: Accepted publickey for root from 192.168.202.28 port 52192 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:23 oleg228-client systemd-logind[1015]: New session 286 of user root. Nov 18 19:09:23 oleg228-client systemd[1]: Started Session 286 of user root. Nov 18 19:09:23 oleg228-client sshd[57802]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:23 oleg228-client sshd[57815]: Received disconnect from 192.168.202.28 port 52192:11: disconnected by user Nov 18 19:09:24 oleg228-client sshd[57815]: Disconnected from user root 192.168.202.28 port 52192 Nov 18 19:09:24 oleg228-client sshd[57802]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:24 oleg228-client systemd[1]: session-286.scope: Succeeded. Nov 18 19:09:24 oleg228-client systemd-logind[1015]: Session 286 logged out. Waiting for processes to exit. Nov 18 19:09:24 oleg228-client systemd-logind[1015]: Removed session 286. Nov 18 19:09:25 oleg228-client sshd[57941]: Accepted publickey for root from 192.168.202.28 port 52202 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:25 oleg228-client systemd-logind[1015]: New session 287 of user root. Nov 18 19:09:25 oleg228-client systemd[1]: Started Session 287 of user root. Nov 18 19:09:25 oleg228-client sshd[57941]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:25 oleg228-client sshd[57954]: Received disconnect from 192.168.202.28 port 52202:11: disconnected by user Nov 18 19:09:25 oleg228-client sshd[57954]: Disconnected from user root 192.168.202.28 port 52202 Nov 18 19:09:25 oleg228-client sshd[57941]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:25 oleg228-client systemd[1]: session-287.scope: Succeeded. Nov 18 19:09:25 oleg228-client systemd-logind[1015]: Session 287 logged out. Waiting for processes to exit. Nov 18 19:09:25 oleg228-client systemd-logind[1015]: Removed session 287. Nov 18 19:09:26 oleg228-client sshd[58087]: Accepted publickey for root from 192.168.202.28 port 52216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:26 oleg228-client systemd[1]: Started Session 288 of user root. Nov 18 19:09:26 oleg228-client systemd-logind[1015]: New session 288 of user root. Nov 18 19:09:26 oleg228-client sshd[58087]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:27 oleg228-client sshd[58100]: Received disconnect from 192.168.202.28 port 52216:11: disconnected by user Nov 18 19:09:27 oleg228-client sshd[58100]: Disconnected from user root 192.168.202.28 port 52216 Nov 18 19:09:27 oleg228-client sshd[58087]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:27 oleg228-client systemd[1]: session-288.scope: Succeeded. Nov 18 19:09:27 oleg228-client systemd-logind[1015]: Session 288 logged out. Waiting for processes to exit. Nov 18 19:09:27 oleg228-client systemd-logind[1015]: Removed session 288. Nov 18 19:09:28 oleg228-client sshd[58242]: Accepted publickey for root from 192.168.202.28 port 52232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:28 oleg228-client systemd-logind[1015]: New session 289 of user root. Nov 18 19:09:28 oleg228-client systemd[1]: Started Session 289 of user root. Nov 18 19:09:28 oleg228-client sshd[58242]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 59: Read cancel race on client eviction ========================================================== 19:09:27 (1763510967) Nov 18 19:09:28 oleg228-client sshd[58255]: Received disconnect from 192.168.202.28 port 52232:11: disconnected by user Nov 18 19:09:28 oleg228-client sshd[58255]: Disconnected from user root 192.168.202.28 port 52232 Nov 18 19:09:28 oleg228-client sshd[58242]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:28 oleg228-client systemd[1]: session-289.scope: Succeeded. Nov 18 19:09:28 oleg228-client systemd-logind[1015]: Session 289 logged out. Waiting for processes to exit. Nov 18 19:09:28 oleg228-client systemd-logind[1015]: Removed session 289. Nov 18 19:09:29 oleg228-client systemd-udevd[58312]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:09:29 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:09:30 oleg228-client kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request Nov 18 19:09:40 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 19:09:40 oleg228-client kernel: LustreError: 58357:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 19:09:40 oleg228-client kernel: LustreError: 58357:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages Nov 18 19:09:40 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:09:41 oleg228-client sshd[58452]: Accepted publickey for root from 192.168.202.28 port 59474 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:41 oleg228-client systemd-logind[1015]: New session 290 of user root. Nov 18 19:09:41 oleg228-client systemd[1]: Started Session 290 of user root. Nov 18 19:09:41 oleg228-client sshd[58452]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:42 oleg228-client sshd[58465]: Received disconnect from 192.168.202.28 port 59474:11: disconnected by user Nov 18 19:09:42 oleg228-client sshd[58465]: Disconnected from user root 192.168.202.28 port 59474 Nov 18 19:09:42 oleg228-client sshd[58452]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:42 oleg228-client systemd-logind[1015]: Session 290 logged out. Waiting for processes to exit. Nov 18 19:09:42 oleg228-client systemd[1]: session-290.scope: Succeeded. Nov 18 19:09:42 oleg228-client systemd-logind[1015]: Removed session 290. Nov 18 19:09:43 oleg228-client sshd[58592]: Accepted publickey for root from 192.168.202.28 port 59484 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:43 oleg228-client systemd-logind[1015]: New session 291 of user root. Nov 18 19:09:43 oleg228-client systemd[1]: Started Session 291 of user root. Nov 18 19:09:43 oleg228-client sshd[58592]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:44 oleg228-client sshd[58605]: Received disconnect from 192.168.202.28 port 59484:11: disconnected by user Nov 18 19:09:44 oleg228-client sshd[58605]: Disconnected from user root 192.168.202.28 port 59484 Nov 18 19:09:44 oleg228-client sshd[58592]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:44 oleg228-client systemd[1]: session-291.scope: Succeeded. Nov 18 19:09:44 oleg228-client systemd-logind[1015]: Session 291 logged out. Waiting for processes to exit. Nov 18 19:09:44 oleg228-client systemd-logind[1015]: Removed session 291. Nov 18 19:09:45 oleg228-client sshd[58738]: Accepted publickey for root from 192.168.202.28 port 59486 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:45 oleg228-client systemd-logind[1015]: New session 292 of user root. Nov 18 19:09:45 oleg228-client systemd[1]: Started Session 292 of user root. Nov 18 19:09:45 oleg228-client sshd[58738]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:45 oleg228-client sshd[58751]: Received disconnect from 192.168.202.28 port 59486:11: disconnected by user Nov 18 19:09:45 oleg228-client sshd[58751]: Disconnected from user root 192.168.202.28 port 59486 Nov 18 19:09:45 oleg228-client sshd[58738]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:45 oleg228-client systemd[1]: session-292.scope: Succeeded. Nov 18 19:09:45 oleg228-client systemd-logind[1015]: Session 292 logged out. Waiting for processes to exit. Nov 18 19:09:45 oleg228-client systemd-logind[1015]: Removed session 292. Nov 18 19:09:47 oleg228-client sshd[58893]: Accepted publickey for root from 192.168.202.28 port 59490 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:47 oleg228-client systemd-logind[1015]: New session 293 of user root. Nov 18 19:09:47 oleg228-client systemd[1]: Started Session 293 of user root. Nov 18 19:09:47 oleg228-client sshd[58893]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:47 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 60: Add Changelog entries during MDS failover ========================================================== 19:09:46 (1763510986) Nov 18 19:09:47 oleg228-client sshd[58906]: Received disconnect from 192.168.202.28 port 59490:11: disconnected by user Nov 18 19:09:47 oleg228-client sshd[58906]: Disconnected from user root 192.168.202.28 port 59490 Nov 18 19:09:47 oleg228-client sshd[58893]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:48 oleg228-client systemd[1]: session-293.scope: Succeeded. Nov 18 19:09:48 oleg228-client systemd-logind[1015]: Session 293 logged out. Waiting for processes to exit. Nov 18 19:09:48 oleg228-client systemd-logind[1015]: Removed session 293. Nov 18 19:09:55 oleg228-client sshd[59099]: Accepted publickey for root from 192.168.202.28 port 45794 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:09:55 oleg228-client systemd-logind[1015]: New session 294 of user root. Nov 18 19:09:55 oleg228-client systemd[1]: Started Session 294 of user root. Nov 18 19:09:55 oleg228-client sshd[59099]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:09:55 oleg228-client sshd[59112]: Received disconnect from 192.168.202.28 port 45794:11: disconnected by user Nov 18 19:09:55 oleg228-client sshd[59112]: Disconnected from user root 192.168.202.28 port 45794 Nov 18 19:09:55 oleg228-client sshd[59099]: pam_unix(sshd:session): session closed for user root Nov 18 19:09:55 oleg228-client systemd[1]: session-294.scope: Succeeded. Nov 18 19:09:55 oleg228-client systemd-logind[1015]: Session 294 logged out. Waiting for processes to exit. Nov 18 19:09:55 oleg228-client systemd-logind[1015]: Removed session 294. Nov 18 19:11:04 oleg228-client sshd[59323]: Accepted publickey for root from 192.168.202.28 port 43568 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:11:04 oleg228-client systemd-logind[1015]: New session 295 of user root. Nov 18 19:11:04 oleg228-client systemd[1]: Started Session 295 of user root. Nov 18 19:11:04 oleg228-client sshd[59323]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:11:05 oleg228-client sshd[59336]: Received disconnect from 192.168.202.28 port 43568:11: disconnected by user Nov 18 19:11:05 oleg228-client sshd[59336]: Disconnected from user root 192.168.202.28 port 43568 Nov 18 19:11:05 oleg228-client sshd[59323]: pam_unix(sshd:session): session closed for user root Nov 18 19:11:05 oleg228-client systemd[1]: session-295.scope: Succeeded. Nov 18 19:11:05 oleg228-client systemd-logind[1015]: Session 295 logged out. Waiting for processes to exit. Nov 18 19:11:05 oleg228-client systemd-logind[1015]: Removed session 295. Nov 18 19:11:05 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbd8f57800: operation mds_reint to node 192.168.202.128@tcp failed: rc = -19 Nov 18 19:11:05 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbd8f57800: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 19:11:05 oleg228-client kernel: Lustre: Skipped 12 previous similar messages Nov 18 19:11:22 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:11:28 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbd8f57800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:11:28 oleg228-client kernel: Lustre: Skipped 8 previous similar messages Nov 18 19:11:32 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25ecf769 to 0x2622672b25efe11a Nov 18 19:13:04 oleg228-client sshd[59874]: Accepted publickey for root from 192.168.202.28 port 48404 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:04 oleg228-client systemd[1]: Started Session 296 of user root. Nov 18 19:13:04 oleg228-client systemd-logind[1015]: New session 296 of user root. Nov 18 19:13:04 oleg228-client sshd[59874]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:04 oleg228-client sshd[59887]: Received disconnect from 192.168.202.28 port 48404:11: disconnected by user Nov 18 19:13:04 oleg228-client sshd[59887]: Disconnected from user root 192.168.202.28 port 48404 Nov 18 19:13:04 oleg228-client sshd[59874]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:04 oleg228-client systemd[1]: session-296.scope: Succeeded. Nov 18 19:13:04 oleg228-client systemd-logind[1015]: Session 296 logged out. Waiting for processes to exit. Nov 18 19:13:04 oleg228-client systemd-logind[1015]: Removed session 296. Nov 18 19:13:05 oleg228-client sshd[60013]: Accepted publickey for root from 192.168.202.28 port 48412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:05 oleg228-client systemd-logind[1015]: New session 297 of user root. Nov 18 19:13:05 oleg228-client systemd[1]: Started Session 297 of user root. Nov 18 19:13:05 oleg228-client sshd[60013]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:06 oleg228-client sshd[60026]: Received disconnect from 192.168.202.28 port 48412:11: disconnected by user Nov 18 19:13:06 oleg228-client sshd[60026]: Disconnected from user root 192.168.202.28 port 48412 Nov 18 19:13:06 oleg228-client sshd[60013]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:06 oleg228-client systemd-logind[1015]: Session 297 logged out. Waiting for processes to exit. Nov 18 19:13:06 oleg228-client systemd[1]: session-297.scope: Succeeded. Nov 18 19:13:06 oleg228-client systemd-logind[1015]: Removed session 297. Nov 18 19:13:06 oleg228-client sshd[60160]: Accepted publickey for root from 192.168.202.28 port 48418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:06 oleg228-client systemd[1]: Started Session 298 of user root. Nov 18 19:13:06 oleg228-client systemd-logind[1015]: New session 298 of user root. Nov 18 19:13:06 oleg228-client sshd[60160]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:07 oleg228-client sshd[60173]: Received disconnect from 192.168.202.28 port 48418:11: disconnected by user Nov 18 19:13:07 oleg228-client sshd[60173]: Disconnected from user root 192.168.202.28 port 48418 Nov 18 19:13:07 oleg228-client sshd[60160]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:07 oleg228-client systemd[1]: session-298.scope: Succeeded. Nov 18 19:13:07 oleg228-client systemd-logind[1015]: Session 298 logged out. Waiting for processes to exit. Nov 18 19:13:07 oleg228-client systemd-logind[1015]: Removed session 298. Nov 18 19:13:11 oleg228-client sshd[60362]: Accepted publickey for root from 192.168.202.28 port 40688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:11 oleg228-client systemd-logind[1015]: New session 299 of user root. Nov 18 19:13:11 oleg228-client systemd[1]: Started Session 299 of user root. Nov 18 19:13:11 oleg228-client sshd[60362]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:11 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 61: Verify to not reuse orphan objects - bug 17025 ========================================================== 19:13:10 (1763511190) Nov 18 19:13:11 oleg228-client sshd[60375]: Received disconnect from 192.168.202.28 port 40688:11: disconnected by user Nov 18 19:13:11 oleg228-client sshd[60375]: Disconnected from user root 192.168.202.28 port 40688 Nov 18 19:13:11 oleg228-client sshd[60362]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:12 oleg228-client systemd-logind[1015]: Session 299 logged out. Waiting for processes to exit. Nov 18 19:13:12 oleg228-client systemd[1]: session-299.scope: Succeeded. Nov 18 19:13:12 oleg228-client systemd-logind[1015]: Removed session 299. Nov 18 19:13:19 oleg228-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Nov 18 19:13:35 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:13:35 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbd8f57800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:13:35 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25efe11a to 0x2622672b25f367b1 Nov 18 19:13:39 oleg228-client sshd[60825]: Accepted publickey for root from 192.168.202.28 port 47392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:39 oleg228-client systemd[1]: Started Session 300 of user root. Nov 18 19:13:39 oleg228-client systemd-logind[1015]: New session 300 of user root. Nov 18 19:13:39 oleg228-client sshd[60825]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:39 oleg228-client sshd[60838]: Received disconnect from 192.168.202.28 port 47392:11: disconnected by user Nov 18 19:13:39 oleg228-client sshd[60838]: Disconnected from user root 192.168.202.28 port 47392 Nov 18 19:13:39 oleg228-client sshd[60825]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:39 oleg228-client systemd-logind[1015]: Session 300 logged out. Waiting for processes to exit. Nov 18 19:13:39 oleg228-client systemd[1]: session-300.scope: Succeeded. Nov 18 19:13:39 oleg228-client systemd-logind[1015]: Removed session 300. Nov 18 19:13:40 oleg228-client sshd[60877]: Accepted publickey for root from 192.168.202.28 port 39844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:40 oleg228-client systemd-logind[1015]: New session 301 of user root. Nov 18 19:13:40 oleg228-client systemd[1]: Started Session 301 of user root. Nov 18 19:13:40 oleg228-client sshd[60877]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:41 oleg228-client sshd[60890]: Received disconnect from 192.168.202.28 port 39844:11: disconnected by user Nov 18 19:13:41 oleg228-client sshd[60890]: Disconnected from user root 192.168.202.28 port 39844 Nov 18 19:13:41 oleg228-client sshd[60877]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:41 oleg228-client systemd-logind[1015]: Session 301 logged out. Waiting for processes to exit. Nov 18 19:13:41 oleg228-client systemd[1]: session-301.scope: Succeeded. Nov 18 19:13:41 oleg228-client systemd-logind[1015]: Removed session 301. Nov 18 19:13:49 oleg228-client sshd[61126]: Accepted publickey for root from 192.168.202.28 port 39852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:49 oleg228-client systemd-logind[1015]: New session 302 of user root. Nov 18 19:13:49 oleg228-client systemd[1]: Started Session 302 of user root. Nov 18 19:13:49 oleg228-client sshd[61126]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:50 oleg228-client sshd[61139]: Received disconnect from 192.168.202.28 port 39852:11: disconnected by user Nov 18 19:13:50 oleg228-client sshd[61139]: Disconnected from user root 192.168.202.28 port 39852 Nov 18 19:13:50 oleg228-client sshd[61126]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:50 oleg228-client systemd[1]: session-302.scope: Succeeded. Nov 18 19:13:50 oleg228-client systemd-logind[1015]: Session 302 logged out. Waiting for processes to exit. Nov 18 19:13:50 oleg228-client systemd-logind[1015]: Removed session 302. Nov 18 19:13:50 oleg228-client sshd[61266]: Accepted publickey for root from 192.168.202.28 port 32846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:51 oleg228-client systemd[1]: Started Session 303 of user root. Nov 18 19:13:51 oleg228-client systemd-logind[1015]: New session 303 of user root. Nov 18 19:13:51 oleg228-client sshd[61266]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:51 oleg228-client sshd[61279]: Received disconnect from 192.168.202.28 port 32846:11: disconnected by user Nov 18 19:13:51 oleg228-client sshd[61279]: Disconnected from user root 192.168.202.28 port 32846 Nov 18 19:13:51 oleg228-client sshd[61266]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:51 oleg228-client systemd-logind[1015]: Session 303 logged out. Waiting for processes to exit. Nov 18 19:13:51 oleg228-client systemd[1]: session-303.scope: Succeeded. Nov 18 19:13:51 oleg228-client systemd-logind[1015]: Removed session 303. Nov 18 19:13:52 oleg228-client sshd[61412]: Accepted publickey for root from 192.168.202.28 port 32854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:52 oleg228-client systemd[1]: Started Session 304 of user root. Nov 18 19:13:52 oleg228-client systemd-logind[1015]: New session 304 of user root. Nov 18 19:13:52 oleg228-client sshd[61412]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:52 oleg228-client sshd[61425]: Received disconnect from 192.168.202.28 port 32854:11: disconnected by user Nov 18 19:13:52 oleg228-client sshd[61425]: Disconnected from user root 192.168.202.28 port 32854 Nov 18 19:13:52 oleg228-client sshd[61412]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:52 oleg228-client systemd[1]: session-304.scope: Succeeded. Nov 18 19:13:52 oleg228-client systemd-logind[1015]: Session 304 logged out. Waiting for processes to exit. Nov 18 19:13:52 oleg228-client systemd-logind[1015]: Removed session 304. Nov 18 19:13:53 oleg228-client sshd[61567]: Accepted publickey for root from 192.168.202.28 port 32862 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:13:53 oleg228-client systemd-logind[1015]: New session 305 of user root. Nov 18 19:13:53 oleg228-client systemd[1]: Started Session 305 of user root. Nov 18 19:13:53 oleg228-client sshd[61567]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:13:53 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 65: lock enqueue for destroyed export ========================================================== 19:13:52 (1763511232) Nov 18 19:13:53 oleg228-client sshd[61580]: Received disconnect from 192.168.202.28 port 32862:11: disconnected by user Nov 18 19:13:53 oleg228-client sshd[61580]: Disconnected from user root 192.168.202.28 port 32862 Nov 18 19:13:53 oleg228-client sshd[61567]: pam_unix(sshd:session): session closed for user root Nov 18 19:13:53 oleg228-client systemd[1]: session-305.scope: Succeeded. Nov 18 19:13:53 oleg228-client systemd-logind[1015]: Session 305 logged out. Waiting for processes to exit. Nov 18 19:13:53 oleg228-client systemd-logind[1015]: Removed session 305. Nov 18 19:13:54 oleg228-client systemd-udevd[61636]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:13:54 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:14:01 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbd8f57800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 19:14:01 oleg228-client kernel: LustreError: 61679:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-OST0000-osc-ffff9ccbd8f57800: namespace resource [0x280000401:0x1ae3:0x0].0x0 (ffff9ccbc99d8a00) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:14:11 oleg228-client kernel: Lustre: 2406:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763511235/real 1763511235] req@ffff9ccbd1513800 x1849171068697344/t0(0) o103->lustre-OST0000-osc-ffff9ccbc80e4000@192.168.202.128@tcp:17/18 lens 328/224 e 0 to 1 dl 1763511251 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 Nov 18 19:14:11 oleg228-client kernel: Lustre: 2406:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 1 previous similar message Nov 18 19:14:12 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 19:14:12 oleg228-client kernel: LustreError: 61708:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc80e4000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:14:12 oleg228-client kernel: LustreError: 61708:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:14:12 oleg228-client kernel: LustreError: 61708:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 19:14:12 oleg228-client kernel: LustreError: 61708:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:14:13 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:14:13 oleg228-client sshd[61796]: Accepted publickey for root from 192.168.202.28 port 56636 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:13 oleg228-client systemd-logind[1015]: New session 306 of user root. Nov 18 19:14:13 oleg228-client systemd[1]: Started Session 306 of user root. Nov 18 19:14:13 oleg228-client sshd[61796]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:14 oleg228-client sshd[61809]: Received disconnect from 192.168.202.28 port 56636:11: disconnected by user Nov 18 19:14:14 oleg228-client sshd[61809]: Disconnected from user root 192.168.202.28 port 56636 Nov 18 19:14:14 oleg228-client sshd[61796]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:14 oleg228-client systemd-logind[1015]: Session 306 logged out. Waiting for processes to exit. Nov 18 19:14:14 oleg228-client systemd[1]: session-306.scope: Succeeded. Nov 18 19:14:14 oleg228-client systemd-logind[1015]: Removed session 306. Nov 18 19:14:15 oleg228-client sshd[61935]: Accepted publickey for root from 192.168.202.28 port 56646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:15 oleg228-client systemd-logind[1015]: New session 307 of user root. Nov 18 19:14:15 oleg228-client systemd[1]: Started Session 307 of user root. Nov 18 19:14:15 oleg228-client sshd[61935]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:15 oleg228-client sshd[61948]: Received disconnect from 192.168.202.28 port 56646:11: disconnected by user Nov 18 19:14:15 oleg228-client sshd[61948]: Disconnected from user root 192.168.202.28 port 56646 Nov 18 19:14:15 oleg228-client sshd[61935]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:16 oleg228-client systemd[1]: session-307.scope: Succeeded. Nov 18 19:14:16 oleg228-client systemd-logind[1015]: Session 307 logged out. Waiting for processes to exit. Nov 18 19:14:16 oleg228-client systemd-logind[1015]: Removed session 307. Nov 18 19:14:16 oleg228-client sshd[62081]: Accepted publickey for root from 192.168.202.28 port 56656 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:17 oleg228-client systemd[1]: Started Session 308 of user root. Nov 18 19:14:17 oleg228-client systemd-logind[1015]: New session 308 of user root. Nov 18 19:14:17 oleg228-client sshd[62081]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:17 oleg228-client sshd[62095]: Received disconnect from 192.168.202.28 port 56656:11: disconnected by user Nov 18 19:14:17 oleg228-client sshd[62095]: Disconnected from user root 192.168.202.28 port 56656 Nov 18 19:14:17 oleg228-client sshd[62081]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:17 oleg228-client systemd[1]: session-308.scope: Succeeded. Nov 18 19:14:17 oleg228-client systemd-logind[1015]: Session 308 logged out. Waiting for processes to exit. Nov 18 19:14:17 oleg228-client systemd-logind[1015]: Removed session 308. Nov 18 19:14:18 oleg228-client sshd[62237]: Accepted publickey for root from 192.168.202.28 port 56664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:18 oleg228-client systemd-logind[1015]: New session 309 of user root. Nov 18 19:14:18 oleg228-client systemd[1]: Started Session 309 of user root. Nov 18 19:14:18 oleg228-client sshd[62237]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:19 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 66: lock enqueue re-send vs client eviction ========================================================== 19:14:17 (1763511257) Nov 18 19:14:19 oleg228-client sshd[62250]: Received disconnect from 192.168.202.28 port 56664:11: disconnected by user Nov 18 19:14:19 oleg228-client sshd[62250]: Disconnected from user root 192.168.202.28 port 56664 Nov 18 19:14:19 oleg228-client sshd[62237]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:19 oleg228-client systemd-logind[1015]: Session 309 logged out. Waiting for processes to exit. Nov 18 19:14:19 oleg228-client systemd[1]: session-309.scope: Succeeded. Nov 18 19:14:19 oleg228-client systemd-logind[1015]: Removed session 309. Nov 18 19:14:25 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbd8f57800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:14:25 oleg228-client kernel: LustreError: 62359:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 Nov 18 19:14:27 oleg228-client sshd[62575]: Accepted publickey for root from 192.168.202.28 port 45816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:27 oleg228-client systemd-logind[1015]: New session 310 of user root. Nov 18 19:14:27 oleg228-client systemd[1]: Started Session 310 of user root. Nov 18 19:14:27 oleg228-client sshd[62575]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:27 oleg228-client sshd[62588]: Received disconnect from 192.168.202.28 port 45816:11: disconnected by user Nov 18 19:14:27 oleg228-client sshd[62588]: Disconnected from user root 192.168.202.28 port 45816 Nov 18 19:14:27 oleg228-client sshd[62575]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:27 oleg228-client systemd[1]: session-310.scope: Succeeded. Nov 18 19:14:27 oleg228-client systemd-logind[1015]: Session 310 logged out. Waiting for processes to exit. Nov 18 19:14:27 oleg228-client systemd-logind[1015]: Removed session 310. Nov 18 19:14:28 oleg228-client sshd[62714]: Accepted publickey for root from 192.168.202.28 port 45830 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:28 oleg228-client systemd-logind[1015]: New session 311 of user root. Nov 18 19:14:28 oleg228-client systemd[1]: Started Session 311 of user root. Nov 18 19:14:28 oleg228-client sshd[62714]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:28 oleg228-client sshd[62727]: Received disconnect from 192.168.202.28 port 45830:11: disconnected by user Nov 18 19:14:28 oleg228-client sshd[62727]: Disconnected from user root 192.168.202.28 port 45830 Nov 18 19:14:28 oleg228-client sshd[62714]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:28 oleg228-client systemd-logind[1015]: Session 311 logged out. Waiting for processes to exit. Nov 18 19:14:28 oleg228-client systemd[1]: session-311.scope: Succeeded. Nov 18 19:14:28 oleg228-client systemd-logind[1015]: Removed session 311. Nov 18 19:14:29 oleg228-client sshd[62860]: Accepted publickey for root from 192.168.202.28 port 45840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:29 oleg228-client systemd-logind[1015]: New session 312 of user root. Nov 18 19:14:29 oleg228-client systemd[1]: Started Session 312 of user root. Nov 18 19:14:29 oleg228-client sshd[62860]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:29 oleg228-client sshd[62873]: Received disconnect from 192.168.202.28 port 45840:11: disconnected by user Nov 18 19:14:29 oleg228-client sshd[62873]: Disconnected from user root 192.168.202.28 port 45840 Nov 18 19:14:29 oleg228-client sshd[62860]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:30 oleg228-client systemd[1]: session-312.scope: Succeeded. Nov 18 19:14:30 oleg228-client systemd-logind[1015]: Session 312 logged out. Waiting for processes to exit. Nov 18 19:14:30 oleg228-client systemd-logind[1015]: Removed session 312. Nov 18 19:14:30 oleg228-client sshd[63016]: Accepted publickey for root from 192.168.202.28 port 33204 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:30 oleg228-client systemd-logind[1015]: New session 313 of user root. Nov 18 19:14:30 oleg228-client systemd[1]: Started Session 313 of user root. Nov 18 19:14:31 oleg228-client sshd[63016]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:31 oleg228-client sshd[63029]: Received disconnect from 192.168.202.28 port 33204:11: disconnected by user Nov 18 19:14:31 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 67: connect vs import invalidate race ========================================================== 19:14:30 (1763511270) Nov 18 19:14:31 oleg228-client sshd[63029]: Disconnected from user root 192.168.202.28 port 33204 Nov 18 19:14:31 oleg228-client sshd[63016]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:31 oleg228-client systemd[1]: session-313.scope: Succeeded. Nov 18 19:14:31 oleg228-client systemd-logind[1015]: Session 313 logged out. Waiting for processes to exit. Nov 18 19:14:31 oleg228-client systemd-logind[1015]: Removed session 313. Nov 18 19:14:31 oleg228-client kernel: LustreError: 63070:0:(recover.c:330:ptlrpc_recover_import()) cfs_race id 531 sleeping Nov 18 19:14:35 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbd8f57800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:14:35 oleg228-client kernel: LustreError: 63087:0:(import.c:291:ptlrpc_invalidate_import()) cfs_fail_race id 531 waking Nov 18 19:14:35 oleg228-client kernel: LustreError: 63070:0:(recover.c:330:ptlrpc_recover_import()) cfs_fail_race id 531 awake: rc=900 Nov 18 19:14:35 oleg228-client kernel: LustreError: 63070:0:(import.c:716:ptlrpc_connect_import_locked()) already connecting Nov 18 19:14:35 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:14:35 oleg228-client kernel: LustreError: 63093:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:14:36 oleg228-client kernel: LustreError: 63099:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:14:36 oleg228-client kernel: LustreError: 63099:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 5 previous similar messages Nov 18 19:14:39 oleg228-client kernel: LustreError: 63122:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:14:39 oleg228-client kernel: LustreError: 63122:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Nov 18 19:14:43 oleg228-client kernel: LustreError: 63166:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:14:43 oleg228-client kernel: LustreError: 63166:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 27 previous similar messages Nov 18 19:14:46 oleg228-client sshd[63286]: Accepted publickey for root from 192.168.202.28 port 60390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:47 oleg228-client systemd-logind[1015]: New session 314 of user root. Nov 18 19:14:47 oleg228-client systemd[1]: Started Session 314 of user root. Nov 18 19:14:47 oleg228-client sshd[63286]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:47 oleg228-client sshd[63299]: Received disconnect from 192.168.202.28 port 60390:11: disconnected by user Nov 18 19:14:47 oleg228-client sshd[63299]: Disconnected from user root 192.168.202.28 port 60390 Nov 18 19:14:47 oleg228-client sshd[63286]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:47 oleg228-client systemd[1]: session-314.scope: Succeeded. Nov 18 19:14:47 oleg228-client systemd-logind[1015]: Session 314 logged out. Waiting for processes to exit. Nov 18 19:14:47 oleg228-client systemd-logind[1015]: Removed session 314. Nov 18 19:14:49 oleg228-client sshd[63425]: Accepted publickey for root from 192.168.202.28 port 60402 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:49 oleg228-client systemd[1]: Started Session 315 of user root. Nov 18 19:14:49 oleg228-client systemd-logind[1015]: New session 315 of user root. Nov 18 19:14:49 oleg228-client sshd[63425]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:49 oleg228-client sshd[63438]: Received disconnect from 192.168.202.28 port 60402:11: disconnected by user Nov 18 19:14:49 oleg228-client sshd[63438]: Disconnected from user root 192.168.202.28 port 60402 Nov 18 19:14:49 oleg228-client sshd[63425]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:49 oleg228-client systemd[1]: session-315.scope: Succeeded. Nov 18 19:14:49 oleg228-client systemd-logind[1015]: Session 315 logged out. Waiting for processes to exit. Nov 18 19:14:49 oleg228-client systemd-logind[1015]: Removed session 315. Nov 18 19:14:50 oleg228-client sshd[63571]: Accepted publickey for root from 192.168.202.28 port 60408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:50 oleg228-client systemd-logind[1015]: New session 316 of user root. Nov 18 19:14:50 oleg228-client systemd[1]: Started Session 316 of user root. Nov 18 19:14:50 oleg228-client sshd[63571]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:50 oleg228-client sshd[63584]: Received disconnect from 192.168.202.28 port 60408:11: disconnected by user Nov 18 19:14:50 oleg228-client sshd[63584]: Disconnected from user root 192.168.202.28 port 60408 Nov 18 19:14:50 oleg228-client sshd[63571]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:50 oleg228-client systemd[1]: session-316.scope: Succeeded. Nov 18 19:14:50 oleg228-client systemd-logind[1015]: Session 316 logged out. Waiting for processes to exit. Nov 18 19:14:50 oleg228-client systemd-logind[1015]: Removed session 316. Nov 18 19:14:51 oleg228-client sshd[63726]: Accepted publickey for root from 192.168.202.28 port 56870 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:14:51 oleg228-client systemd-logind[1015]: New session 317 of user root. Nov 18 19:14:51 oleg228-client systemd[1]: Started Session 317 of user root. Nov 18 19:14:51 oleg228-client sshd[63726]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:14:51 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 100: IR: Make sure normal recovery still works w/o IR ========================================================== 19:14:50 (1763511290) Nov 18 19:14:51 oleg228-client sshd[63740]: Received disconnect from 192.168.202.28 port 56870:11: disconnected by user Nov 18 19:14:51 oleg228-client sshd[63740]: Disconnected from user root 192.168.202.28 port 56870 Nov 18 19:14:51 oleg228-client sshd[63726]: pam_unix(sshd:session): session closed for user root Nov 18 19:14:52 oleg228-client systemd-logind[1015]: Session 317 logged out. Waiting for processes to exit. Nov 18 19:14:52 oleg228-client systemd[1]: session-317.scope: Succeeded. Nov 18 19:14:52 oleg228-client systemd-logind[1015]: Removed session 317. Nov 18 19:15:20 oleg228-client sshd[64090]: Accepted publickey for root from 192.168.202.28 port 55468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:20 oleg228-client systemd-logind[1015]: New session 318 of user root. Nov 18 19:15:20 oleg228-client systemd[1]: Started Session 318 of user root. Nov 18 19:15:20 oleg228-client sshd[64090]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:20 oleg228-client sshd[64103]: Received disconnect from 192.168.202.28 port 55468:11: disconnected by user Nov 18 19:15:20 oleg228-client sshd[64103]: Disconnected from user root 192.168.202.28 port 55468 Nov 18 19:15:20 oleg228-client sshd[64090]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:20 oleg228-client systemd[1]: session-318.scope: Succeeded. Nov 18 19:15:20 oleg228-client systemd-logind[1015]: Session 318 logged out. Waiting for processes to exit. Nov 18 19:15:20 oleg228-client systemd-logind[1015]: Removed session 318. Nov 18 19:15:23 oleg228-client sshd[64326]: Accepted publickey for root from 192.168.202.28 port 59564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:23 oleg228-client systemd[1]: Started Session 319 of user root. Nov 18 19:15:23 oleg228-client systemd-logind[1015]: New session 319 of user root. Nov 18 19:15:23 oleg228-client sshd[64326]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:23 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:15:23 oleg228-client sshd[64339]: Received disconnect from 192.168.202.28 port 59564:11: disconnected by user Nov 18 19:15:23 oleg228-client sshd[64339]: Disconnected from user root 192.168.202.28 port 59564 Nov 18 19:15:23 oleg228-client sshd[64326]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:23 oleg228-client systemd[1]: session-319.scope: Succeeded. Nov 18 19:15:23 oleg228-client systemd-logind[1015]: Session 319 logged out. Waiting for processes to exit. Nov 18 19:15:23 oleg228-client systemd-logind[1015]: Removed session 319. Nov 18 19:15:24 oleg228-client sshd[64483]: Accepted publickey for root from 192.168.202.28 port 59574 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:24 oleg228-client systemd-logind[1015]: New session 320 of user root. Nov 18 19:15:24 oleg228-client systemd[1]: Started Session 320 of user root. Nov 18 19:15:24 oleg228-client sshd[64483]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:24 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:15:24 oleg228-client sshd[64496]: Received disconnect from 192.168.202.28 port 59574:11: disconnected by user Nov 18 19:15:24 oleg228-client sshd[64496]: Disconnected from user root 192.168.202.28 port 59574 Nov 18 19:15:24 oleg228-client sshd[64483]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:25 oleg228-client systemd-logind[1015]: Session 320 logged out. Waiting for processes to exit. Nov 18 19:15:25 oleg228-client systemd[1]: session-320.scope: Succeeded. Nov 18 19:15:25 oleg228-client systemd-logind[1015]: Removed session 320. Nov 18 19:15:26 oleg228-client sshd[64537]: Accepted publickey for root from 192.168.202.28 port 59580 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:26 oleg228-client systemd[1]: Started Session 321 of user root. Nov 18 19:15:26 oleg228-client sshd[64537]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:26 oleg228-client systemd-logind[1015]: New session 321 of user root. Nov 18 19:15:26 oleg228-client sshd[64550]: Received disconnect from 192.168.202.28 port 59580:11: disconnected by user Nov 18 19:15:26 oleg228-client sshd[64550]: Disconnected from user root 192.168.202.28 port 59580 Nov 18 19:15:26 oleg228-client sshd[64537]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:26 oleg228-client systemd[1]: session-321.scope: Succeeded. Nov 18 19:15:26 oleg228-client systemd-logind[1015]: Session 321 logged out. Waiting for processes to exit. Nov 18 19:15:26 oleg228-client systemd-logind[1015]: Removed session 321. Nov 18 19:15:28 oleg228-client sshd[64700]: Accepted publickey for root from 192.168.202.28 port 59584 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:29 oleg228-client systemd-logind[1015]: New session 322 of user root. Nov 18 19:15:29 oleg228-client systemd[1]: Started Session 322 of user root. Nov 18 19:15:29 oleg228-client sshd[64700]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:29 oleg228-client sshd[64713]: Received disconnect from 192.168.202.28 port 59584:11: disconnected by user Nov 18 19:15:29 oleg228-client sshd[64713]: Disconnected from user root 192.168.202.28 port 59584 Nov 18 19:15:29 oleg228-client sshd[64700]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:29 oleg228-client systemd[1]: session-322.scope: Succeeded. Nov 18 19:15:29 oleg228-client systemd-logind[1015]: Session 322 logged out. Waiting for processes to exit. Nov 18 19:15:29 oleg228-client systemd-logind[1015]: Removed session 322. Nov 18 19:15:30 oleg228-client sshd[64840]: Accepted publickey for root from 192.168.202.28 port 59588 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:30 oleg228-client systemd-logind[1015]: New session 323 of user root. Nov 18 19:15:30 oleg228-client systemd[1]: Started Session 323 of user root. Nov 18 19:15:30 oleg228-client sshd[64840]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:30 oleg228-client sshd[64853]: Received disconnect from 192.168.202.28 port 59588:11: disconnected by user Nov 18 19:15:30 oleg228-client sshd[64853]: Disconnected from user root 192.168.202.28 port 59588 Nov 18 19:15:30 oleg228-client sshd[64840]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:30 oleg228-client systemd[1]: session-323.scope: Succeeded. Nov 18 19:15:30 oleg228-client systemd-logind[1015]: Session 323 logged out. Waiting for processes to exit. Nov 18 19:15:30 oleg228-client systemd-logind[1015]: Removed session 323. Nov 18 19:15:31 oleg228-client sshd[64986]: Accepted publickey for root from 192.168.202.28 port 38982 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:31 oleg228-client systemd-logind[1015]: New session 324 of user root. Nov 18 19:15:31 oleg228-client systemd[1]: Started Session 324 of user root. Nov 18 19:15:31 oleg228-client sshd[64986]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:31 oleg228-client sshd[64999]: Received disconnect from 192.168.202.28 port 38982:11: disconnected by user Nov 18 19:15:31 oleg228-client sshd[64999]: Disconnected from user root 192.168.202.28 port 38982 Nov 18 19:15:31 oleg228-client sshd[64986]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:32 oleg228-client systemd-logind[1015]: Session 324 logged out. Waiting for processes to exit. Nov 18 19:15:32 oleg228-client systemd[1]: session-324.scope: Succeeded. Nov 18 19:15:32 oleg228-client systemd-logind[1015]: Removed session 324. Nov 18 19:15:33 oleg228-client sshd[65141]: Accepted publickey for root from 192.168.202.28 port 38992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:15:33 oleg228-client systemd-logind[1015]: New session 325 of user root. Nov 18 19:15:33 oleg228-client systemd[1]: Started Session 325 of user root. Nov 18 19:15:33 oleg228-client sshd[65141]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:15:33 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101a: IR: Make sure IR works w/o normal recovery ========================================================== 19:15:32 (1763511332) Nov 18 19:15:33 oleg228-client sshd[65154]: Received disconnect from 192.168.202.28 port 38992:11: disconnected by user Nov 18 19:15:33 oleg228-client sshd[65154]: Disconnected from user root 192.168.202.28 port 38992 Nov 18 19:15:33 oleg228-client sshd[65141]: pam_unix(sshd:session): session closed for user root Nov 18 19:15:33 oleg228-client systemd[1]: session-325.scope: Succeeded. Nov 18 19:15:33 oleg228-client systemd-logind[1015]: Session 325 logged out. Waiting for processes to exit. Nov 18 19:15:33 oleg228-client systemd-logind[1015]: Removed session 325. Nov 18 19:16:00 oleg228-client sshd[65480]: Accepted publickey for root from 192.168.202.28 port 49852 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:00 oleg228-client systemd[1]: Started Session 326 of user root. Nov 18 19:16:00 oleg228-client systemd-logind[1015]: New session 326 of user root. Nov 18 19:16:00 oleg228-client sshd[65480]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:00 oleg228-client sshd[65493]: Received disconnect from 192.168.202.28 port 49852:11: disconnected by user Nov 18 19:16:01 oleg228-client sshd[65493]: Disconnected from user root 192.168.202.28 port 49852 Nov 18 19:16:01 oleg228-client sshd[65480]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:01 oleg228-client systemd[1]: session-326.scope: Succeeded. Nov 18 19:16:01 oleg228-client systemd-logind[1015]: Session 326 logged out. Waiting for processes to exit. Nov 18 19:16:01 oleg228-client systemd-logind[1015]: Removed session 326. Nov 18 19:16:03 oleg228-client sshd[65717]: Accepted publickey for root from 192.168.202.28 port 42380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:03 oleg228-client systemd[1]: Started Session 327 of user root. Nov 18 19:16:03 oleg228-client systemd-logind[1015]: New session 327 of user root. Nov 18 19:16:03 oleg228-client sshd[65717]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:03 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:16:03 oleg228-client sshd[65730]: Received disconnect from 192.168.202.28 port 42380:11: disconnected by user Nov 18 19:16:03 oleg228-client sshd[65730]: Disconnected from user root 192.168.202.28 port 42380 Nov 18 19:16:03 oleg228-client sshd[65717]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:03 oleg228-client systemd[1]: session-327.scope: Succeeded. Nov 18 19:16:03 oleg228-client systemd-logind[1015]: Session 327 logged out. Waiting for processes to exit. Nov 18 19:16:03 oleg228-client systemd-logind[1015]: Removed session 327. Nov 18 19:16:04 oleg228-client sshd[65873]: Accepted publickey for root from 192.168.202.28 port 42394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:04 oleg228-client systemd-logind[1015]: New session 328 of user root. Nov 18 19:16:04 oleg228-client systemd[1]: Started Session 328 of user root. Nov 18 19:16:04 oleg228-client sshd[65873]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:05 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:16:05 oleg228-client sshd[65886]: Received disconnect from 192.168.202.28 port 42394:11: disconnected by user Nov 18 19:16:05 oleg228-client sshd[65886]: Disconnected from user root 192.168.202.28 port 42394 Nov 18 19:16:05 oleg228-client sshd[65873]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:05 oleg228-client systemd[1]: session-328.scope: Succeeded. Nov 18 19:16:05 oleg228-client systemd-logind[1015]: Session 328 logged out. Waiting for processes to exit. Nov 18 19:16:05 oleg228-client systemd-logind[1015]: Removed session 328. Nov 18 19:16:06 oleg228-client sshd[65927]: Accepted publickey for root from 192.168.202.28 port 42396 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:06 oleg228-client systemd-logind[1015]: New session 329 of user root. Nov 18 19:16:06 oleg228-client systemd[1]: Started Session 329 of user root. Nov 18 19:16:06 oleg228-client sshd[65927]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:06 oleg228-client sshd[65940]: Received disconnect from 192.168.202.28 port 42396:11: disconnected by user Nov 18 19:16:07 oleg228-client sshd[65940]: Disconnected from user root 192.168.202.28 port 42396 Nov 18 19:16:07 oleg228-client sshd[65927]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:07 oleg228-client systemd[1]: session-329.scope: Succeeded. Nov 18 19:16:07 oleg228-client systemd-logind[1015]: Session 329 logged out. Waiting for processes to exit. Nov 18 19:16:07 oleg228-client systemd-logind[1015]: Removed session 329. Nov 18 19:16:09 oleg228-client sshd[66094]: Accepted publickey for root from 192.168.202.28 port 42406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:09 oleg228-client systemd[1]: Started Session 330 of user root. Nov 18 19:16:09 oleg228-client systemd-logind[1015]: New session 330 of user root. Nov 18 19:16:09 oleg228-client sshd[66094]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:09 oleg228-client sshd[66107]: Received disconnect from 192.168.202.28 port 42406:11: disconnected by user Nov 18 19:16:09 oleg228-client sshd[66107]: Disconnected from user root 192.168.202.28 port 42406 Nov 18 19:16:09 oleg228-client sshd[66094]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:09 oleg228-client systemd[1]: session-330.scope: Succeeded. Nov 18 19:16:09 oleg228-client systemd-logind[1015]: Session 330 logged out. Waiting for processes to exit. Nov 18 19:16:09 oleg228-client systemd-logind[1015]: Removed session 330. Nov 18 19:16:10 oleg228-client sshd[66234]: Accepted publickey for root from 192.168.202.28 port 42412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:10 oleg228-client systemd-logind[1015]: New session 331 of user root. Nov 18 19:16:10 oleg228-client systemd[1]: Started Session 331 of user root. Nov 18 19:16:10 oleg228-client sshd[66234]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:11 oleg228-client sshd[66247]: Received disconnect from 192.168.202.28 port 42412:11: disconnected by user Nov 18 19:16:11 oleg228-client sshd[66247]: Disconnected from user root 192.168.202.28 port 42412 Nov 18 19:16:11 oleg228-client sshd[66234]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:11 oleg228-client systemd[1]: session-331.scope: Succeeded. Nov 18 19:16:11 oleg228-client systemd-logind[1015]: Session 331 logged out. Waiting for processes to exit. Nov 18 19:16:11 oleg228-client systemd-logind[1015]: Removed session 331. Nov 18 19:16:12 oleg228-client sshd[66380]: Accepted publickey for root from 192.168.202.28 port 58706 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:12 oleg228-client systemd-logind[1015]: New session 332 of user root. Nov 18 19:16:12 oleg228-client systemd[1]: Started Session 332 of user root. Nov 18 19:16:12 oleg228-client sshd[66380]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:12 oleg228-client sshd[66393]: Received disconnect from 192.168.202.28 port 58706:11: disconnected by user Nov 18 19:16:12 oleg228-client sshd[66393]: Disconnected from user root 192.168.202.28 port 58706 Nov 18 19:16:12 oleg228-client sshd[66380]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:12 oleg228-client systemd[1]: session-332.scope: Succeeded. Nov 18 19:16:12 oleg228-client systemd-logind[1015]: Session 332 logged out. Waiting for processes to exit. Nov 18 19:16:12 oleg228-client systemd-logind[1015]: Removed session 332. Nov 18 19:16:13 oleg228-client sshd[66536]: Accepted publickey for root from 192.168.202.28 port 58712 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:16:13 oleg228-client systemd-logind[1015]: New session 333 of user root. Nov 18 19:16:13 oleg228-client systemd[1]: Started Session 333 of user root. Nov 18 19:16:13 oleg228-client sshd[66536]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:16:14 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 101b: IR: Make sure IR works w/o normal recovery and proceed EAGAIN ========================================================== 19:16:12 (1763511372) Nov 18 19:16:14 oleg228-client sshd[66549]: Received disconnect from 192.168.202.28 port 58712:11: disconnected by user Nov 18 19:16:14 oleg228-client sshd[66549]: Disconnected from user root 192.168.202.28 port 58712 Nov 18 19:16:14 oleg228-client sshd[66536]: pam_unix(sshd:session): session closed for user root Nov 18 19:16:14 oleg228-client systemd-logind[1015]: Session 333 logged out. Waiting for processes to exit. Nov 18 19:16:14 oleg228-client systemd[1]: session-333.scope: Succeeded. Nov 18 19:16:14 oleg228-client systemd-logind[1015]: Removed session 333. Nov 18 19:17:03 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbd8f57800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:17:03 oleg228-client kernel: Lustre: Skipped 9 previous similar messages Nov 18 19:17:09 oleg228-client sshd[66888]: Accepted publickey for root from 192.168.202.28 port 42692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:09 oleg228-client systemd[1]: Started Session 334 of user root. Nov 18 19:17:09 oleg228-client systemd-logind[1015]: New session 334 of user root. Nov 18 19:17:09 oleg228-client sshd[66888]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:09 oleg228-client sshd[66901]: Received disconnect from 192.168.202.28 port 42692:11: disconnected by user Nov 18 19:17:09 oleg228-client sshd[66901]: Disconnected from user root 192.168.202.28 port 42692 Nov 18 19:17:09 oleg228-client sshd[66888]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:09 oleg228-client systemd[1]: session-334.scope: Succeeded. Nov 18 19:17:09 oleg228-client systemd-logind[1015]: Session 334 logged out. Waiting for processes to exit. Nov 18 19:17:09 oleg228-client systemd-logind[1015]: Removed session 334. Nov 18 19:17:12 oleg228-client sshd[67125]: Accepted publickey for root from 192.168.202.28 port 42760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:12 oleg228-client systemd[1]: Started Session 335 of user root. Nov 18 19:17:12 oleg228-client systemd-logind[1015]: New session 335 of user root. Nov 18 19:17:12 oleg228-client sshd[67125]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:12 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:17:12 oleg228-client sshd[67138]: Received disconnect from 192.168.202.28 port 42760:11: disconnected by user Nov 18 19:17:12 oleg228-client sshd[67138]: Disconnected from user root 192.168.202.28 port 42760 Nov 18 19:17:12 oleg228-client sshd[67125]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:12 oleg228-client systemd[1]: session-335.scope: Succeeded. Nov 18 19:17:12 oleg228-client systemd-logind[1015]: Session 335 logged out. Waiting for processes to exit. Nov 18 19:17:12 oleg228-client systemd-logind[1015]: Removed session 335. Nov 18 19:17:14 oleg228-client sshd[67281]: Accepted publickey for root from 192.168.202.28 port 42762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:14 oleg228-client systemd[1]: Started Session 336 of user root. Nov 18 19:17:14 oleg228-client systemd-logind[1015]: New session 336 of user root. Nov 18 19:17:14 oleg228-client sshd[67281]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:14 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:17:14 oleg228-client sshd[67294]: Received disconnect from 192.168.202.28 port 42762:11: disconnected by user Nov 18 19:17:14 oleg228-client sshd[67294]: Disconnected from user root 192.168.202.28 port 42762 Nov 18 19:17:14 oleg228-client sshd[67281]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:14 oleg228-client systemd-logind[1015]: Session 336 logged out. Waiting for processes to exit. Nov 18 19:17:14 oleg228-client systemd[1]: session-336.scope: Succeeded. Nov 18 19:17:14 oleg228-client systemd-logind[1015]: Removed session 336. Nov 18 19:17:16 oleg228-client sshd[67335]: Accepted publickey for root from 192.168.202.28 port 42776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:16 oleg228-client systemd-logind[1015]: New session 337 of user root. Nov 18 19:17:16 oleg228-client systemd[1]: Started Session 337 of user root. Nov 18 19:17:16 oleg228-client sshd[67335]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:16 oleg228-client sshd[67348]: Received disconnect from 192.168.202.28 port 42776:11: disconnected by user Nov 18 19:17:16 oleg228-client sshd[67348]: Disconnected from user root 192.168.202.28 port 42776 Nov 18 19:17:16 oleg228-client sshd[67335]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:16 oleg228-client systemd-logind[1015]: Session 337 logged out. Waiting for processes to exit. Nov 18 19:17:16 oleg228-client systemd[1]: session-337.scope: Succeeded. Nov 18 19:17:16 oleg228-client systemd-logind[1015]: Removed session 337. Nov 18 19:17:17 oleg228-client sshd[67468]: Accepted publickey for root from 192.168.202.28 port 42778 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:17 oleg228-client systemd[1]: Started Session 338 of user root. Nov 18 19:17:17 oleg228-client systemd-logind[1015]: New session 338 of user root. Nov 18 19:17:17 oleg228-client sshd[67468]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:17 oleg228-client sshd[67481]: Received disconnect from 192.168.202.28 port 42778:11: disconnected by user Nov 18 19:17:18 oleg228-client sshd[67481]: Disconnected from user root 192.168.202.28 port 42778 Nov 18 19:17:18 oleg228-client sshd[67468]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:18 oleg228-client systemd[1]: session-338.scope: Succeeded. Nov 18 19:17:18 oleg228-client systemd-logind[1015]: Session 338 logged out. Waiting for processes to exit. Nov 18 19:17:18 oleg228-client systemd-logind[1015]: Removed session 338. Nov 18 19:17:19 oleg228-client sshd[67607]: Accepted publickey for root from 192.168.202.28 port 42784 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:19 oleg228-client systemd-logind[1015]: New session 339 of user root. Nov 18 19:17:19 oleg228-client systemd[1]: Started Session 339 of user root. Nov 18 19:17:19 oleg228-client sshd[67607]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:19 oleg228-client sshd[67620]: Received disconnect from 192.168.202.28 port 42784:11: disconnected by user Nov 18 19:17:19 oleg228-client sshd[67620]: Disconnected from user root 192.168.202.28 port 42784 Nov 18 19:17:19 oleg228-client sshd[67607]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:19 oleg228-client systemd[1]: session-339.scope: Succeeded. Nov 18 19:17:19 oleg228-client systemd-logind[1015]: Session 339 logged out. Waiting for processes to exit. Nov 18 19:17:19 oleg228-client systemd-logind[1015]: Removed session 339. Nov 18 19:17:20 oleg228-client sshd[67753]: Accepted publickey for root from 192.168.202.28 port 42800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:20 oleg228-client systemd[1]: Started Session 340 of user root. Nov 18 19:17:20 oleg228-client systemd-logind[1015]: New session 340 of user root. Nov 18 19:17:20 oleg228-client sshd[67753]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:20 oleg228-client sshd[67766]: Received disconnect from 192.168.202.28 port 42800:11: disconnected by user Nov 18 19:17:20 oleg228-client sshd[67766]: Disconnected from user root 192.168.202.28 port 42800 Nov 18 19:17:20 oleg228-client sshd[67753]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:20 oleg228-client systemd[1]: session-340.scope: Succeeded. Nov 18 19:17:20 oleg228-client systemd-logind[1015]: Session 340 logged out. Waiting for processes to exit. Nov 18 19:17:20 oleg228-client systemd-logind[1015]: Removed session 340. Nov 18 19:17:21 oleg228-client sshd[67909]: Accepted publickey for root from 192.168.202.28 port 39540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:22 oleg228-client systemd-logind[1015]: New session 341 of user root. Nov 18 19:17:22 oleg228-client systemd[1]: Started Session 341 of user root. Nov 18 19:17:22 oleg228-client sshd[67909]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:22 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 102: IR: New client gets updated nidtbl after MGS restart ========================================================== 19:17:21 (1763511441) Nov 18 19:17:22 oleg228-client sshd[67922]: Received disconnect from 192.168.202.28 port 39540:11: disconnected by user Nov 18 19:17:22 oleg228-client sshd[67922]: Disconnected from user root 192.168.202.28 port 39540 Nov 18 19:17:22 oleg228-client sshd[67909]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:22 oleg228-client systemd[1]: session-341.scope: Succeeded. Nov 18 19:17:22 oleg228-client systemd-logind[1015]: Session 341 logged out. Waiting for processes to exit. Nov 18 19:17:22 oleg228-client systemd-logind[1015]: Removed session 341. Nov 18 19:17:53 oleg228-client sshd[68244]: Accepted publickey for root from 192.168.202.28 port 49338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:53 oleg228-client systemd-logind[1015]: New session 342 of user root. Nov 18 19:17:53 oleg228-client systemd[1]: Started Session 342 of user root. Nov 18 19:17:53 oleg228-client sshd[68244]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:53 oleg228-client sshd[68257]: Received disconnect from 192.168.202.28 port 49338:11: disconnected by user Nov 18 19:17:53 oleg228-client sshd[68257]: Disconnected from user root 192.168.202.28 port 49338 Nov 18 19:17:53 oleg228-client sshd[68244]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:53 oleg228-client systemd[1]: session-342.scope: Succeeded. Nov 18 19:17:53 oleg228-client systemd-logind[1015]: Session 342 logged out. Waiting for processes to exit. Nov 18 19:17:53 oleg228-client systemd-logind[1015]: Removed session 342. Nov 18 19:17:56 oleg228-client sshd[68480]: Accepted publickey for root from 192.168.202.28 port 49352 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:56 oleg228-client systemd-logind[1015]: New session 343 of user root. Nov 18 19:17:56 oleg228-client systemd[1]: Started Session 343 of user root. Nov 18 19:17:56 oleg228-client sshd[68480]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:56 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:17:56 oleg228-client sshd[68493]: Received disconnect from 192.168.202.28 port 49352:11: disconnected by user Nov 18 19:17:56 oleg228-client sshd[68493]: Disconnected from user root 192.168.202.28 port 49352 Nov 18 19:17:56 oleg228-client sshd[68480]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:56 oleg228-client systemd[1]: session-343.scope: Succeeded. Nov 18 19:17:56 oleg228-client systemd-logind[1015]: Session 343 logged out. Waiting for processes to exit. Nov 18 19:17:56 oleg228-client systemd-logind[1015]: Removed session 343. Nov 18 19:17:57 oleg228-client sshd[68637]: Accepted publickey for root from 192.168.202.28 port 49354 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:57 oleg228-client systemd-logind[1015]: New session 344 of user root. Nov 18 19:17:57 oleg228-client systemd[1]: Started Session 344 of user root. Nov 18 19:17:57 oleg228-client sshd[68637]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:57 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:17:57 oleg228-client sshd[68650]: Received disconnect from 192.168.202.28 port 49354:11: disconnected by user Nov 18 19:17:57 oleg228-client sshd[68650]: Disconnected from user root 192.168.202.28 port 49354 Nov 18 19:17:57 oleg228-client sshd[68637]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:57 oleg228-client systemd[1]: session-344.scope: Succeeded. Nov 18 19:17:57 oleg228-client systemd-logind[1015]: Session 344 logged out. Waiting for processes to exit. Nov 18 19:17:58 oleg228-client systemd-logind[1015]: Removed session 344. Nov 18 19:17:59 oleg228-client sshd[68691]: Accepted publickey for root from 192.168.202.28 port 49370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:17:59 oleg228-client systemd[1]: Started Session 345 of user root. Nov 18 19:17:59 oleg228-client systemd-logind[1015]: New session 345 of user root. Nov 18 19:17:59 oleg228-client sshd[68691]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:17:59 oleg228-client sshd[68704]: Received disconnect from 192.168.202.28 port 49370:11: disconnected by user Nov 18 19:17:59 oleg228-client sshd[68704]: Disconnected from user root 192.168.202.28 port 49370 Nov 18 19:17:59 oleg228-client sshd[68691]: pam_unix(sshd:session): session closed for user root Nov 18 19:17:59 oleg228-client systemd[1]: session-345.scope: Succeeded. Nov 18 19:17:59 oleg228-client systemd-logind[1015]: Session 345 logged out. Waiting for processes to exit. Nov 18 19:17:59 oleg228-client systemd-logind[1015]: Removed session 345. Nov 18 19:18:02 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 19:18:02 oleg228-client kernel: LustreError: 68795:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbd8f57800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:18:02 oleg228-client kernel: LustreError: 68795:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:18:02 oleg228-client kernel: LustreError: 68795:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 19:18:02 oleg228-client kernel: LustreError: 68795:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:18:02 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:18:44 oleg228-client sshd[69264]: Accepted publickey for root from 192.168.202.28 port 33350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:44 oleg228-client systemd[1]: Started Session 346 of user root. Nov 18 19:18:44 oleg228-client systemd-logind[1015]: New session 346 of user root. Nov 18 19:18:44 oleg228-client sshd[69264]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:45 oleg228-client sshd[69277]: Received disconnect from 192.168.202.28 port 33350:11: disconnected by user Nov 18 19:18:45 oleg228-client sshd[69277]: Disconnected from user root 192.168.202.28 port 33350 Nov 18 19:18:45 oleg228-client sshd[69264]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:45 oleg228-client systemd[1]: session-346.scope: Succeeded. Nov 18 19:18:45 oleg228-client systemd-logind[1015]: Session 346 logged out. Waiting for processes to exit. Nov 18 19:18:45 oleg228-client systemd-logind[1015]: Removed session 346. Nov 18 19:18:48 oleg228-client sshd[69500]: Accepted publickey for root from 192.168.202.28 port 33364 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:48 oleg228-client systemd-logind[1015]: New session 347 of user root. Nov 18 19:18:48 oleg228-client systemd[1]: Started Session 347 of user root. Nov 18 19:18:48 oleg228-client sshd[69500]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:48 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:18:48 oleg228-client sshd[69513]: Received disconnect from 192.168.202.28 port 33364:11: disconnected by user Nov 18 19:18:48 oleg228-client sshd[69513]: Disconnected from user root 192.168.202.28 port 33364 Nov 18 19:18:48 oleg228-client sshd[69500]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:48 oleg228-client systemd-logind[1015]: Session 347 logged out. Waiting for processes to exit. Nov 18 19:18:48 oleg228-client systemd[1]: session-347.scope: Succeeded. Nov 18 19:18:48 oleg228-client systemd-logind[1015]: Removed session 347. Nov 18 19:18:50 oleg228-client sshd[69562]: Accepted publickey for root from 192.168.202.28 port 33366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:50 oleg228-client systemd[1]: Started Session 348 of user root. Nov 18 19:18:50 oleg228-client systemd-logind[1015]: New session 348 of user root. Nov 18 19:18:50 oleg228-client sshd[69562]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:50 oleg228-client sshd[69575]: Received disconnect from 192.168.202.28 port 33366:11: disconnected by user Nov 18 19:18:50 oleg228-client sshd[69575]: Disconnected from user root 192.168.202.28 port 33366 Nov 18 19:18:50 oleg228-client sshd[69562]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:50 oleg228-client systemd[1]: session-348.scope: Succeeded. Nov 18 19:18:50 oleg228-client systemd-logind[1015]: Session 348 logged out. Waiting for processes to exit. Nov 18 19:18:50 oleg228-client systemd-logind[1015]: Removed session 348. Nov 18 19:18:51 oleg228-client systemd-udevd[69650]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:18:51 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:18:52 oleg228-client sshd[69768]: Accepted publickey for root from 192.168.202.28 port 48764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:52 oleg228-client systemd-logind[1015]: New session 349 of user root. Nov 18 19:18:52 oleg228-client systemd[1]: Started Session 349 of user root. Nov 18 19:18:52 oleg228-client sshd[69768]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:52 oleg228-client sshd[69781]: Received disconnect from 192.168.202.28 port 48764:11: disconnected by user Nov 18 19:18:52 oleg228-client sshd[69781]: Disconnected from user root 192.168.202.28 port 48764 Nov 18 19:18:52 oleg228-client sshd[69768]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:52 oleg228-client systemd[1]: session-349.scope: Succeeded. Nov 18 19:18:52 oleg228-client systemd-logind[1015]: Session 349 logged out. Waiting for processes to exit. Nov 18 19:18:52 oleg228-client systemd-logind[1015]: Removed session 349. Nov 18 19:18:53 oleg228-client sshd[69907]: Accepted publickey for root from 192.168.202.28 port 48766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:53 oleg228-client systemd-logind[1015]: New session 350 of user root. Nov 18 19:18:53 oleg228-client systemd[1]: Started Session 350 of user root. Nov 18 19:18:53 oleg228-client sshd[69907]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:54 oleg228-client sshd[69920]: Received disconnect from 192.168.202.28 port 48766:11: disconnected by user Nov 18 19:18:54 oleg228-client sshd[69920]: Disconnected from user root 192.168.202.28 port 48766 Nov 18 19:18:54 oleg228-client sshd[69907]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:54 oleg228-client systemd[1]: session-350.scope: Succeeded. Nov 18 19:18:54 oleg228-client systemd-logind[1015]: Session 350 logged out. Waiting for processes to exit. Nov 18 19:18:54 oleg228-client systemd-logind[1015]: Removed session 350. Nov 18 19:18:55 oleg228-client sshd[70053]: Accepted publickey for root from 192.168.202.28 port 48776 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:55 oleg228-client systemd-logind[1015]: New session 351 of user root. Nov 18 19:18:55 oleg228-client systemd[1]: Started Session 351 of user root. Nov 18 19:18:55 oleg228-client sshd[70053]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:55 oleg228-client sshd[70066]: Received disconnect from 192.168.202.28 port 48776:11: disconnected by user Nov 18 19:18:55 oleg228-client sshd[70066]: Disconnected from user root 192.168.202.28 port 48776 Nov 18 19:18:55 oleg228-client sshd[70053]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:55 oleg228-client systemd[1]: session-351.scope: Succeeded. Nov 18 19:18:55 oleg228-client systemd-logind[1015]: Session 351 logged out. Waiting for processes to exit. Nov 18 19:18:55 oleg228-client systemd-logind[1015]: Removed session 351. Nov 18 19:18:56 oleg228-client sshd[70209]: Accepted publickey for root from 192.168.202.28 port 48792 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:56 oleg228-client systemd[1]: Started Session 352 of user root. Nov 18 19:18:56 oleg228-client systemd-logind[1015]: New session 352 of user root. Nov 18 19:18:56 oleg228-client sshd[70209]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:56 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 103: IR: MDS can start w/o MGS and get updated nidtbl later ========================================================== 19:18:55 (1763511535) Nov 18 19:18:56 oleg228-client sshd[70222]: Received disconnect from 192.168.202.28 port 48792:11: disconnected by user Nov 18 19:18:56 oleg228-client sshd[70222]: Disconnected from user root 192.168.202.28 port 48792 Nov 18 19:18:56 oleg228-client sshd[70209]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:57 oleg228-client systemd-logind[1015]: Session 352 logged out. Waiting for processes to exit. Nov 18 19:18:57 oleg228-client systemd[1]: session-352.scope: Succeeded. Nov 18 19:18:57 oleg228-client systemd-logind[1015]: Removed session 352. Nov 18 19:18:58 oleg228-client sshd[70370]: Accepted publickey for root from 192.168.202.28 port 48796 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:58 oleg228-client systemd-logind[1015]: New session 353 of user root. Nov 18 19:18:58 oleg228-client systemd[1]: Started Session 353 of user root. Nov 18 19:18:58 oleg228-client sshd[70370]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:18:58 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_103 needs separate mgs and mds Nov 18 19:18:58 oleg228-client sshd[70383]: Received disconnect from 192.168.202.28 port 48796:11: disconnected by user Nov 18 19:18:58 oleg228-client sshd[70383]: Disconnected from user root 192.168.202.28 port 48796 Nov 18 19:18:58 oleg228-client sshd[70370]: pam_unix(sshd:session): session closed for user root Nov 18 19:18:58 oleg228-client systemd[1]: session-353.scope: Succeeded. Nov 18 19:18:58 oleg228-client systemd-logind[1015]: Session 353 logged out. Waiting for processes to exit. Nov 18 19:18:59 oleg228-client systemd-logind[1015]: Removed session 353. Nov 18 19:18:59 oleg228-client sshd[70525]: Accepted publickey for root from 192.168.202.28 port 48804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:18:59 oleg228-client systemd[1]: Started Session 354 of user root. Nov 18 19:18:59 oleg228-client systemd-logind[1015]: New session 354 of user root. Nov 18 19:18:59 oleg228-client sshd[70525]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:00 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 104: IR: ost can disable IR voluntarily ========================================================== 19:18:59 (1763511539) Nov 18 19:19:00 oleg228-client sshd[70538]: Received disconnect from 192.168.202.28 port 48804:11: disconnected by user Nov 18 19:19:00 oleg228-client sshd[70538]: Disconnected from user root 192.168.202.28 port 48804 Nov 18 19:19:00 oleg228-client sshd[70525]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:00 oleg228-client systemd[1]: session-354.scope: Succeeded. Nov 18 19:19:00 oleg228-client systemd-logind[1015]: Session 354 logged out. Waiting for processes to exit. Nov 18 19:19:00 oleg228-client systemd-logind[1015]: Removed session 354. Nov 18 19:19:20 oleg228-client sshd[70826]: Accepted publickey for root from 192.168.202.28 port 56220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:20 oleg228-client systemd[1]: Started Session 355 of user root. Nov 18 19:19:20 oleg228-client systemd-logind[1015]: New session 355 of user root. Nov 18 19:19:20 oleg228-client sshd[70826]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:21 oleg228-client sshd[70839]: Received disconnect from 192.168.202.28 port 56220:11: disconnected by user Nov 18 19:19:21 oleg228-client sshd[70839]: Disconnected from user root 192.168.202.28 port 56220 Nov 18 19:19:21 oleg228-client sshd[70826]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:21 oleg228-client systemd[1]: session-355.scope: Succeeded. Nov 18 19:19:21 oleg228-client systemd-logind[1015]: Session 355 logged out. Waiting for processes to exit. Nov 18 19:19:21 oleg228-client systemd-logind[1015]: Removed session 355. Nov 18 19:19:23 oleg228-client sshd[70978]: Accepted publickey for root from 192.168.202.28 port 60902 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:23 oleg228-client systemd-logind[1015]: New session 356 of user root. Nov 18 19:19:23 oleg228-client systemd[1]: Started Session 356 of user root. Nov 18 19:19:23 oleg228-client sshd[70978]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:23 oleg228-client sshd[70992]: Received disconnect from 192.168.202.28 port 60902:11: disconnected by user Nov 18 19:19:23 oleg228-client sshd[70992]: Disconnected from user root 192.168.202.28 port 60902 Nov 18 19:19:24 oleg228-client sshd[70978]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:24 oleg228-client systemd[1]: session-356.scope: Succeeded. Nov 18 19:19:24 oleg228-client systemd-logind[1015]: Session 356 logged out. Waiting for processes to exit. Nov 18 19:19:24 oleg228-client systemd-logind[1015]: Removed session 356. Nov 18 19:19:24 oleg228-client sshd[71118]: Accepted publickey for root from 192.168.202.28 port 60908 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:25 oleg228-client systemd-logind[1015]: New session 357 of user root. Nov 18 19:19:25 oleg228-client systemd[1]: Started Session 357 of user root. Nov 18 19:19:25 oleg228-client sshd[71118]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:25 oleg228-client sshd[71131]: Received disconnect from 192.168.202.28 port 60908:11: disconnected by user Nov 18 19:19:25 oleg228-client sshd[71131]: Disconnected from user root 192.168.202.28 port 60908 Nov 18 19:19:25 oleg228-client sshd[71118]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:25 oleg228-client systemd[1]: session-357.scope: Succeeded. Nov 18 19:19:25 oleg228-client systemd-logind[1015]: Session 357 logged out. Waiting for processes to exit. Nov 18 19:19:25 oleg228-client systemd-logind[1015]: Removed session 357. Nov 18 19:19:26 oleg228-client sshd[71264]: Accepted publickey for root from 192.168.202.28 port 60912 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:26 oleg228-client systemd[1]: Started Session 358 of user root. Nov 18 19:19:26 oleg228-client systemd-logind[1015]: New session 358 of user root. Nov 18 19:19:26 oleg228-client sshd[71264]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:27 oleg228-client sshd[71277]: Received disconnect from 192.168.202.28 port 60912:11: disconnected by user Nov 18 19:19:27 oleg228-client sshd[71277]: Disconnected from user root 192.168.202.28 port 60912 Nov 18 19:19:27 oleg228-client sshd[71264]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:27 oleg228-client systemd[1]: session-358.scope: Succeeded. Nov 18 19:19:27 oleg228-client systemd-logind[1015]: Session 358 logged out. Waiting for processes to exit. Nov 18 19:19:27 oleg228-client systemd-logind[1015]: Removed session 358. Nov 18 19:19:28 oleg228-client sshd[71419]: Accepted publickey for root from 192.168.202.28 port 60916 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:28 oleg228-client systemd-logind[1015]: New session 359 of user root. Nov 18 19:19:28 oleg228-client systemd[1]: Started Session 359 of user root. Nov 18 19:19:28 oleg228-client sshd[71419]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 105: IR: NON IR clients support === 19:19:27 (1763511567) Nov 18 19:19:28 oleg228-client sshd[71432]: Received disconnect from 192.168.202.28 port 60916:11: disconnected by user Nov 18 19:19:28 oleg228-client sshd[71432]: Disconnected from user root 192.168.202.28 port 60916 Nov 18 19:19:28 oleg228-client sshd[71419]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:29 oleg228-client systemd[1]: session-359.scope: Succeeded. Nov 18 19:19:29 oleg228-client systemd-logind[1015]: Session 359 logged out. Waiting for processes to exit. Nov 18 19:19:29 oleg228-client systemd-logind[1015]: Removed session 359. Nov 18 19:19:30 oleg228-client sshd[71557]: Accepted publickey for root from 192.168.202.28 port 60918 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:30 oleg228-client systemd-logind[1015]: New session 360 of user root. Nov 18 19:19:30 oleg228-client systemd[1]: Started Session 360 of user root. Nov 18 19:19:30 oleg228-client sshd[71557]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:30 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_105 Needs multiple clients Nov 18 19:19:30 oleg228-client sshd[71570]: Received disconnect from 192.168.202.28 port 60918:11: disconnected by user Nov 18 19:19:30 oleg228-client sshd[71570]: Disconnected from user root 192.168.202.28 port 60918 Nov 18 19:19:30 oleg228-client sshd[71557]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:30 oleg228-client systemd-logind[1015]: Session 360 logged out. Waiting for processes to exit. Nov 18 19:19:30 oleg228-client systemd[1]: session-360.scope: Succeeded. Nov 18 19:19:30 oleg228-client systemd-logind[1015]: Removed session 360. Nov 18 19:19:31 oleg228-client sshd[71712]: Accepted publickey for root from 192.168.202.28 port 33658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:19:31 oleg228-client systemd-logind[1015]: New session 361 of user root. Nov 18 19:19:31 oleg228-client systemd[1]: Started Session 361 of user root. Nov 18 19:19:31 oleg228-client sshd[71712]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:19:32 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 106: lightweight connection support ========================================================== 19:19:30 (1763511570) Nov 18 19:19:32 oleg228-client sshd[71725]: Received disconnect from 192.168.202.28 port 33658:11: disconnected by user Nov 18 19:19:32 oleg228-client sshd[71725]: Disconnected from user root 192.168.202.28 port 33658 Nov 18 19:19:32 oleg228-client sshd[71712]: pam_unix(sshd:session): session closed for user root Nov 18 19:19:32 oleg228-client systemd-logind[1015]: Session 361 logged out. Waiting for processes to exit. Nov 18 19:19:32 oleg228-client systemd[1]: session-361.scope: Succeeded. Nov 18 19:19:32 oleg228-client systemd-logind[1015]: Removed session 361. Nov 18 19:19:33 oleg228-client systemd-udevd[71796]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:19:33 oleg228-client kernel: Lustre: *** cfs_fail_loc=805, val=0*** Nov 18 19:19:33 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:19:40 oleg228-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Nov 18 19:19:59 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:20:09 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25f3730a to 0x2622672b25f3755d Nov 18 19:20:22 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 19:20:22 oleg228-client kernel: LustreError: 72246:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc8b40800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:20:22 oleg228-client kernel: LustreError: 72246:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:20:22 oleg228-client kernel: LustreError: 72246:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 19:20:22 oleg228-client kernel: LustreError: 72246:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages Nov 18 19:20:22 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:20:24 oleg228-client sshd[72398]: Accepted publickey for root from 192.168.202.28 port 34556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:20:24 oleg228-client systemd-logind[1015]: New session 362 of user root. Nov 18 19:20:24 oleg228-client systemd[1]: Started Session 362 of user root. Nov 18 19:20:24 oleg228-client sshd[72398]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:20:25 oleg228-client sshd[72411]: Received disconnect from 192.168.202.28 port 34556:11: disconnected by user Nov 18 19:20:25 oleg228-client sshd[72411]: Disconnected from user root 192.168.202.28 port 34556 Nov 18 19:20:25 oleg228-client sshd[72398]: pam_unix(sshd:session): session closed for user root Nov 18 19:20:25 oleg228-client systemd[1]: session-362.scope: Succeeded. Nov 18 19:20:25 oleg228-client systemd-logind[1015]: Session 362 logged out. Waiting for processes to exit. Nov 18 19:20:25 oleg228-client systemd-logind[1015]: Removed session 362. Nov 18 19:20:26 oleg228-client sshd[72537]: Accepted publickey for root from 192.168.202.28 port 34564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:20:26 oleg228-client systemd-logind[1015]: New session 363 of user root. Nov 18 19:20:26 oleg228-client systemd[1]: Started Session 363 of user root. Nov 18 19:20:26 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:20:26 oleg228-client sshd[72537]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:20:26 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:20:26 oleg228-client sshd[72551]: Received disconnect from 192.168.202.28 port 34564:11: disconnected by user Nov 18 19:20:26 oleg228-client sshd[72551]: Disconnected from user root 192.168.202.28 port 34564 Nov 18 19:20:26 oleg228-client sshd[72537]: pam_unix(sshd:session): session closed for user root Nov 18 19:20:27 oleg228-client systemd[1]: session-363.scope: Succeeded. Nov 18 19:20:27 oleg228-client systemd-logind[1015]: Session 363 logged out. Waiting for processes to exit. Nov 18 19:20:27 oleg228-client systemd-logind[1015]: Removed session 363. Nov 18 19:20:28 oleg228-client sshd[72684]: Accepted publickey for root from 192.168.202.28 port 34568 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:20:28 oleg228-client systemd-logind[1015]: New session 364 of user root. Nov 18 19:20:28 oleg228-client systemd[1]: Started Session 364 of user root. Nov 18 19:20:28 oleg228-client sshd[72684]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:20:28 oleg228-client sshd[72697]: Received disconnect from 192.168.202.28 port 34568:11: disconnected by user Nov 18 19:20:28 oleg228-client sshd[72697]: Disconnected from user root 192.168.202.28 port 34568 Nov 18 19:20:28 oleg228-client sshd[72684]: pam_unix(sshd:session): session closed for user root Nov 18 19:20:28 oleg228-client systemd[1]: session-364.scope: Succeeded. Nov 18 19:20:28 oleg228-client systemd-logind[1015]: Session 364 logged out. Waiting for processes to exit. Nov 18 19:20:28 oleg228-client systemd-logind[1015]: Removed session 364. Nov 18 19:20:29 oleg228-client sshd[72839]: Accepted publickey for root from 192.168.202.28 port 34584 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:20:29 oleg228-client systemd[1]: Started Session 365 of user root. Nov 18 19:20:29 oleg228-client systemd-logind[1015]: New session 365 of user root. Nov 18 19:20:29 oleg228-client sshd[72839]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:20:30 oleg228-client sshd[72853]: Received disconnect from 192.168.202.28 port 34584:11: disconnected by user Nov 18 19:20:30 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 107: drop reint reply, then restart MDT ========================================================== 19:20:28 (1763511628) Nov 18 19:20:30 oleg228-client sshd[72853]: Disconnected from user root 192.168.202.28 port 34584 Nov 18 19:20:30 oleg228-client sshd[72839]: pam_unix(sshd:session): session closed for user root Nov 18 19:20:30 oleg228-client systemd[1]: session-365.scope: Succeeded. Nov 18 19:20:30 oleg228-client systemd-logind[1015]: Session 365 logged out. Waiting for processes to exit. Nov 18 19:20:30 oleg228-client systemd-logind[1015]: Removed session 365. Nov 18 19:21:03 oleg228-client kernel: LustreError: 2405:0:(client.c:3418:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff9ccbd1406300 x1849171068790784/t94489280517(94489280517) o101->lustre-MDT0000-mdc-ffff9ccbc7bdb800@192.168.202.128@tcp:12/10 lens 520/664 e 0 to 0 dl 1763511723 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'multiop.0' uid:0 gid:0 projid:0 Nov 18 19:21:08 oleg228-client sshd[73180]: Accepted publickey for root from 192.168.202.28 port 47586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:08 oleg228-client systemd-logind[1015]: New session 366 of user root. Nov 18 19:21:08 oleg228-client systemd[1]: Started Session 366 of user root. Nov 18 19:21:08 oleg228-client sshd[73180]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:09 oleg228-client sshd[73193]: Received disconnect from 192.168.202.28 port 47586:11: disconnected by user Nov 18 19:21:09 oleg228-client sshd[73193]: Disconnected from user root 192.168.202.28 port 47586 Nov 18 19:21:09 oleg228-client sshd[73180]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:09 oleg228-client systemd[1]: session-366.scope: Succeeded. Nov 18 19:21:09 oleg228-client systemd-logind[1015]: Session 366 logged out. Waiting for processes to exit. Nov 18 19:21:09 oleg228-client systemd-logind[1015]: Removed session 366. Nov 18 19:21:11 oleg228-client sshd[73415]: Accepted publickey for root from 192.168.202.28 port 54084 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:11 oleg228-client systemd-logind[1015]: New session 367 of user root. Nov 18 19:21:11 oleg228-client systemd[1]: Started Session 367 of user root. Nov 18 19:21:11 oleg228-client sshd[73415]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:11 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 19:21:11 oleg228-client sshd[73428]: Received disconnect from 192.168.202.28 port 54084:11: disconnected by user Nov 18 19:21:11 oleg228-client sshd[73428]: Disconnected from user root 192.168.202.28 port 54084 Nov 18 19:21:11 oleg228-client sshd[73415]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:12 oleg228-client systemd[1]: session-367.scope: Succeeded. Nov 18 19:21:12 oleg228-client systemd-logind[1015]: Session 367 logged out. Waiting for processes to exit. Nov 18 19:21:12 oleg228-client systemd-logind[1015]: Removed session 367. Nov 18 19:21:13 oleg228-client sshd[73572]: Accepted publickey for root from 192.168.202.28 port 54094 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:13 oleg228-client systemd-logind[1015]: New session 368 of user root. Nov 18 19:21:13 oleg228-client systemd[1]: Started Session 368 of user root. Nov 18 19:21:13 oleg228-client sshd[73572]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:13 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 19:21:13 oleg228-client sshd[73585]: Received disconnect from 192.168.202.28 port 54094:11: disconnected by user Nov 18 19:21:13 oleg228-client sshd[73585]: Disconnected from user root 192.168.202.28 port 54094 Nov 18 19:21:13 oleg228-client sshd[73572]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:13 oleg228-client systemd[1]: session-368.scope: Succeeded. Nov 18 19:21:13 oleg228-client systemd-logind[1015]: Session 368 logged out. Waiting for processes to exit. Nov 18 19:21:13 oleg228-client systemd-logind[1015]: Removed session 368. Nov 18 19:21:14 oleg228-client sshd[73626]: Accepted publickey for root from 192.168.202.28 port 54110 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:14 oleg228-client systemd-logind[1015]: New session 369 of user root. Nov 18 19:21:14 oleg228-client systemd[1]: Started Session 369 of user root. Nov 18 19:21:14 oleg228-client sshd[73626]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:15 oleg228-client sshd[73639]: Received disconnect from 192.168.202.28 port 54110:11: disconnected by user Nov 18 19:21:15 oleg228-client sshd[73639]: Disconnected from user root 192.168.202.28 port 54110 Nov 18 19:21:15 oleg228-client sshd[73626]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:15 oleg228-client systemd[1]: session-369.scope: Succeeded. Nov 18 19:21:15 oleg228-client systemd-logind[1015]: Session 369 logged out. Waiting for processes to exit. Nov 18 19:21:15 oleg228-client systemd-logind[1015]: Removed session 369. Nov 18 19:21:16 oleg228-client sshd[73759]: Accepted publickey for root from 192.168.202.28 port 54122 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:16 oleg228-client systemd[1]: Started Session 370 of user root. Nov 18 19:21:16 oleg228-client systemd-logind[1015]: New session 370 of user root. Nov 18 19:21:16 oleg228-client sshd[73759]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:16 oleg228-client sshd[73772]: Received disconnect from 192.168.202.28 port 54122:11: disconnected by user Nov 18 19:21:16 oleg228-client sshd[73772]: Disconnected from user root 192.168.202.28 port 54122 Nov 18 19:21:16 oleg228-client sshd[73759]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:16 oleg228-client systemd[1]: session-370.scope: Succeeded. Nov 18 19:21:16 oleg228-client systemd-logind[1015]: Session 370 logged out. Waiting for processes to exit. Nov 18 19:21:16 oleg228-client systemd-logind[1015]: Removed session 370. Nov 18 19:21:17 oleg228-client sshd[73898]: Accepted publickey for root from 192.168.202.28 port 54132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:17 oleg228-client systemd-logind[1015]: New session 371 of user root. Nov 18 19:21:17 oleg228-client systemd[1]: Started Session 371 of user root. Nov 18 19:21:17 oleg228-client sshd[73898]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:18 oleg228-client sshd[73911]: Received disconnect from 192.168.202.28 port 54132:11: disconnected by user Nov 18 19:21:18 oleg228-client sshd[73911]: Disconnected from user root 192.168.202.28 port 54132 Nov 18 19:21:18 oleg228-client sshd[73898]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:18 oleg228-client systemd[1]: session-371.scope: Succeeded. Nov 18 19:21:18 oleg228-client systemd-logind[1015]: Session 371 logged out. Waiting for processes to exit. Nov 18 19:21:18 oleg228-client systemd-logind[1015]: Removed session 371. Nov 18 19:21:19 oleg228-client sshd[74044]: Accepted publickey for root from 192.168.202.28 port 54136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:19 oleg228-client systemd[1]: Started Session 372 of user root. Nov 18 19:21:19 oleg228-client systemd-logind[1015]: New session 372 of user root. Nov 18 19:21:19 oleg228-client sshd[74044]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:19 oleg228-client sshd[74057]: Received disconnect from 192.168.202.28 port 54136:11: disconnected by user Nov 18 19:21:19 oleg228-client sshd[74057]: Disconnected from user root 192.168.202.28 port 54136 Nov 18 19:21:19 oleg228-client sshd[74044]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:19 oleg228-client systemd[1]: session-372.scope: Succeeded. Nov 18 19:21:19 oleg228-client systemd-logind[1015]: Session 372 logged out. Waiting for processes to exit. Nov 18 19:21:19 oleg228-client systemd-logind[1015]: Removed session 372. Nov 18 19:21:20 oleg228-client sshd[74200]: Accepted publickey for root from 192.168.202.28 port 39524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:20 oleg228-client systemd-logind[1015]: New session 373 of user root. Nov 18 19:21:20 oleg228-client systemd[1]: Started Session 373 of user root. Nov 18 19:21:20 oleg228-client sshd[74200]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:21 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 108: client eviction don't crash == 19:21:19 (1763511679) Nov 18 19:21:21 oleg228-client sshd[74213]: Received disconnect from 192.168.202.28 port 39524:11: disconnected by user Nov 18 19:21:21 oleg228-client sshd[74213]: Disconnected from user root 192.168.202.28 port 39524 Nov 18 19:21:21 oleg228-client sshd[74200]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:21 oleg228-client systemd[1]: session-373.scope: Succeeded. Nov 18 19:21:21 oleg228-client systemd-logind[1015]: Session 373 logged out. Waiting for processes to exit. Nov 18 19:21:21 oleg228-client systemd-logind[1015]: Removed session 373. Nov 18 19:21:24 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc7bdb800: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 19:21:24 oleg228-client kernel: Lustre: Skipped 15 previous similar messages Nov 18 19:21:24 oleg228-client kernel: LustreError: 2405:0:(osc_request.c:1010:osc_init_grant()) lustre-OST0000-osc-ffff9ccbc7bdb800: granted 8437760 but already consumed 12582912 Nov 18 19:21:24 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc7bdb800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 19:21:24 oleg228-client kernel: Lustre: 2408:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.128@tcp:/lustre/fid: [0x240000408:0x2:0x0]// may get corrupted (rc -5) Nov 18 19:21:24 oleg228-client kernel: LustreError: 74263:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-OST0000-osc-ffff9ccbc7bdb800: namespace resource [0x280000400:0x2cef:0x0].0x0 (ffff9ccbc4011b00) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:21:25 oleg228-client sshd[74270]: Accepted publickey for root from 192.168.202.28 port 39528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:25 oleg228-client systemd-logind[1015]: New session 374 of user root. Nov 18 19:21:25 oleg228-client systemd[1]: Started Session 374 of user root. Nov 18 19:21:25 oleg228-client sshd[74270]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:26 oleg228-client sshd[74283]: Received disconnect from 192.168.202.28 port 39528:11: disconnected by user Nov 18 19:21:26 oleg228-client sshd[74283]: Disconnected from user root 192.168.202.28 port 39528 Nov 18 19:21:26 oleg228-client sshd[74270]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:26 oleg228-client systemd-logind[1015]: Session 374 logged out. Waiting for processes to exit. Nov 18 19:21:26 oleg228-client systemd[1]: session-374.scope: Succeeded. Nov 18 19:21:26 oleg228-client systemd-logind[1015]: Removed session 374. Nov 18 19:21:26 oleg228-client sshd[74403]: Accepted publickey for root from 192.168.202.28 port 39532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:27 oleg228-client systemd-logind[1015]: New session 375 of user root. Nov 18 19:21:27 oleg228-client systemd[1]: Started Session 375 of user root. Nov 18 19:21:27 oleg228-client sshd[74403]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:27 oleg228-client sshd[74417]: Received disconnect from 192.168.202.28 port 39532:11: disconnected by user Nov 18 19:21:27 oleg228-client sshd[74417]: Disconnected from user root 192.168.202.28 port 39532 Nov 18 19:21:27 oleg228-client sshd[74403]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:27 oleg228-client systemd-logind[1015]: Session 375 logged out. Waiting for processes to exit. Nov 18 19:21:27 oleg228-client systemd[1]: session-375.scope: Succeeded. Nov 18 19:21:27 oleg228-client systemd-logind[1015]: Removed session 375. Nov 18 19:21:28 oleg228-client sshd[74543]: Accepted publickey for root from 192.168.202.28 port 39538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:28 oleg228-client systemd[1]: Started Session 376 of user root. Nov 18 19:21:28 oleg228-client systemd-logind[1015]: New session 376 of user root. Nov 18 19:21:28 oleg228-client sshd[74543]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:28 oleg228-client sshd[74556]: Received disconnect from 192.168.202.28 port 39538:11: disconnected by user Nov 18 19:21:28 oleg228-client sshd[74556]: Disconnected from user root 192.168.202.28 port 39538 Nov 18 19:21:28 oleg228-client sshd[74543]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:28 oleg228-client systemd[1]: session-376.scope: Succeeded. Nov 18 19:21:28 oleg228-client systemd-logind[1015]: Session 376 logged out. Waiting for processes to exit. Nov 18 19:21:28 oleg228-client systemd-logind[1015]: Removed session 376. Nov 18 19:21:29 oleg228-client sshd[74689]: Accepted publickey for root from 192.168.202.28 port 39544 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:29 oleg228-client systemd-logind[1015]: New session 377 of user root. Nov 18 19:21:29 oleg228-client systemd[1]: Started Session 377 of user root. Nov 18 19:21:29 oleg228-client sshd[74689]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:30 oleg228-client sshd[74702]: Received disconnect from 192.168.202.28 port 39544:11: disconnected by user Nov 18 19:21:30 oleg228-client sshd[74702]: Disconnected from user root 192.168.202.28 port 39544 Nov 18 19:21:30 oleg228-client sshd[74689]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:30 oleg228-client systemd[1]: session-377.scope: Succeeded. Nov 18 19:21:30 oleg228-client systemd-logind[1015]: Session 377 logged out. Waiting for processes to exit. Nov 18 19:21:30 oleg228-client systemd-logind[1015]: Removed session 377. Nov 18 19:21:31 oleg228-client sshd[74844]: Accepted publickey for root from 192.168.202.28 port 39610 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:31 oleg228-client systemd-logind[1015]: New session 378 of user root. Nov 18 19:21:31 oleg228-client systemd[1]: Started Session 378 of user root. Nov 18 19:21:31 oleg228-client sshd[74844]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:31 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110a: create remote directory: drop client req ========================================================== 19:21:30 (1763511690) Nov 18 19:21:31 oleg228-client sshd[74857]: Received disconnect from 192.168.202.28 port 39610:11: disconnected by user Nov 18 19:21:31 oleg228-client sshd[74857]: Disconnected from user root 192.168.202.28 port 39610 Nov 18 19:21:31 oleg228-client sshd[74844]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:31 oleg228-client systemd[1]: session-378.scope: Succeeded. Nov 18 19:21:31 oleg228-client systemd-logind[1015]: Session 378 logged out. Waiting for processes to exit. Nov 18 19:21:31 oleg228-client systemd-logind[1015]: Removed session 378. Nov 18 19:21:36 oleg228-client sshd[75023]: Accepted publickey for root from 192.168.202.28 port 39612 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:36 oleg228-client systemd-logind[1015]: New session 379 of user root. Nov 18 19:21:36 oleg228-client systemd[1]: Started Session 379 of user root. Nov 18 19:21:36 oleg228-client sshd[75023]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:36 oleg228-client sshd[75036]: Received disconnect from 192.168.202.28 port 39612:11: disconnected by user Nov 18 19:21:36 oleg228-client sshd[75036]: Disconnected from user root 192.168.202.28 port 39612 Nov 18 19:21:37 oleg228-client sshd[75023]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:37 oleg228-client systemd[1]: session-379.scope: Succeeded. Nov 18 19:21:37 oleg228-client systemd-logind[1015]: Session 379 logged out. Waiting for processes to exit. Nov 18 19:21:37 oleg228-client systemd-logind[1015]: Removed session 379. Nov 18 19:21:37 oleg228-client sshd[75163]: Accepted publickey for root from 192.168.202.28 port 39622 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:38 oleg228-client systemd-logind[1015]: New session 380 of user root. Nov 18 19:21:38 oleg228-client systemd[1]: Started Session 380 of user root. Nov 18 19:21:38 oleg228-client sshd[75163]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:38 oleg228-client sshd[75176]: Received disconnect from 192.168.202.28 port 39622:11: disconnected by user Nov 18 19:21:38 oleg228-client sshd[75176]: Disconnected from user root 192.168.202.28 port 39622 Nov 18 19:21:38 oleg228-client sshd[75163]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:38 oleg228-client systemd[1]: session-380.scope: Succeeded. Nov 18 19:21:38 oleg228-client systemd-logind[1015]: Session 380 logged out. Waiting for processes to exit. Nov 18 19:21:38 oleg228-client systemd-logind[1015]: Removed session 380. Nov 18 19:21:39 oleg228-client sshd[75309]: Accepted publickey for root from 192.168.202.28 port 39630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:39 oleg228-client systemd-logind[1015]: New session 381 of user root. Nov 18 19:21:39 oleg228-client systemd[1]: Started Session 381 of user root. Nov 18 19:21:39 oleg228-client sshd[75309]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:39 oleg228-client sshd[75322]: Received disconnect from 192.168.202.28 port 39630:11: disconnected by user Nov 18 19:21:40 oleg228-client sshd[75322]: Disconnected from user root 192.168.202.28 port 39630 Nov 18 19:21:40 oleg228-client sshd[75309]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:40 oleg228-client systemd[1]: session-381.scope: Succeeded. Nov 18 19:21:40 oleg228-client systemd-logind[1015]: Session 381 logged out. Waiting for processes to exit. Nov 18 19:21:40 oleg228-client systemd-logind[1015]: Removed session 381. Nov 18 19:21:41 oleg228-client sshd[75465]: Accepted publickey for root from 192.168.202.28 port 32900 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:21:41 oleg228-client systemd-logind[1015]: New session 382 of user root. Nov 18 19:21:41 oleg228-client systemd[1]: Started Session 382 of user root. Nov 18 19:21:41 oleg228-client sshd[75465]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:21:41 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110b: create remote directory: drop Master rep ========================================================== 19:21:40 (1763511700) Nov 18 19:21:41 oleg228-client sshd[75478]: Received disconnect from 192.168.202.28 port 32900:11: disconnected by user Nov 18 19:21:41 oleg228-client sshd[75478]: Disconnected from user root 192.168.202.28 port 32900 Nov 18 19:21:41 oleg228-client sshd[75465]: pam_unix(sshd:session): session closed for user root Nov 18 19:21:42 oleg228-client systemd[1]: session-382.scope: Succeeded. Nov 18 19:21:42 oleg228-client systemd-logind[1015]: Session 382 logged out. Waiting for processes to exit. Nov 18 19:21:42 oleg228-client systemd-logind[1015]: Removed session 382. Nov 18 19:22:44 oleg228-client sshd[75631]: Accepted publickey for root from 192.168.202.28 port 52520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:22:44 oleg228-client systemd-logind[1015]: New session 383 of user root. Nov 18 19:22:44 oleg228-client systemd[1]: Started Session 383 of user root. Nov 18 19:22:44 oleg228-client sshd[75631]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:22:45 oleg228-client sshd[75644]: Received disconnect from 192.168.202.28 port 52520:11: disconnected by user Nov 18 19:22:45 oleg228-client sshd[75644]: Disconnected from user root 192.168.202.28 port 52520 Nov 18 19:22:45 oleg228-client sshd[75631]: pam_unix(sshd:session): session closed for user root Nov 18 19:22:45 oleg228-client systemd[1]: session-383.scope: Succeeded. Nov 18 19:22:45 oleg228-client systemd-logind[1015]: Session 383 logged out. Waiting for processes to exit. Nov 18 19:22:45 oleg228-client systemd-logind[1015]: Removed session 383. Nov 18 19:22:45 oleg228-client sshd[75771]: Accepted publickey for root from 192.168.202.28 port 52530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:22:46 oleg228-client systemd-logind[1015]: New session 384 of user root. Nov 18 19:22:46 oleg228-client systemd[1]: Started Session 384 of user root. Nov 18 19:22:46 oleg228-client sshd[75771]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:22:46 oleg228-client sshd[75784]: Received disconnect from 192.168.202.28 port 52530:11: disconnected by user Nov 18 19:22:46 oleg228-client sshd[75784]: Disconnected from user root 192.168.202.28 port 52530 Nov 18 19:22:46 oleg228-client sshd[75771]: pam_unix(sshd:session): session closed for user root Nov 18 19:22:46 oleg228-client systemd-logind[1015]: Session 384 logged out. Waiting for processes to exit. Nov 18 19:22:46 oleg228-client systemd[1]: session-384.scope: Succeeded. Nov 18 19:22:46 oleg228-client systemd-logind[1015]: Removed session 384. Nov 18 19:22:47 oleg228-client sshd[75916]: Accepted publickey for root from 192.168.202.28 port 52546 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:22:47 oleg228-client systemd[1]: Started Session 385 of user root. Nov 18 19:22:47 oleg228-client systemd-logind[1015]: New session 385 of user root. Nov 18 19:22:47 oleg228-client sshd[75916]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:22:48 oleg228-client sshd[75931]: Received disconnect from 192.168.202.28 port 52546:11: disconnected by user Nov 18 19:22:48 oleg228-client sshd[75931]: Disconnected from user root 192.168.202.28 port 52546 Nov 18 19:22:48 oleg228-client sshd[75916]: pam_unix(sshd:session): session closed for user root Nov 18 19:22:48 oleg228-client systemd[1]: session-385.scope: Succeeded. Nov 18 19:22:48 oleg228-client systemd-logind[1015]: Session 385 logged out. Waiting for processes to exit. Nov 18 19:22:48 oleg228-client systemd-logind[1015]: Removed session 385. Nov 18 19:22:49 oleg228-client sshd[76073]: Accepted publickey for root from 192.168.202.28 port 52560 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:22:49 oleg228-client systemd-logind[1015]: New session 386 of user root. Nov 18 19:22:49 oleg228-client systemd[1]: Started Session 386 of user root. Nov 18 19:22:49 oleg228-client sshd[76073]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:22:49 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110c: create remote directory: drop update rep on slave MDT ========================================================== 19:22:48 (1763511768) Nov 18 19:22:49 oleg228-client sshd[76086]: Received disconnect from 192.168.202.28 port 52560:11: disconnected by user Nov 18 19:22:49 oleg228-client sshd[76086]: Disconnected from user root 192.168.202.28 port 52560 Nov 18 19:22:49 oleg228-client sshd[76073]: pam_unix(sshd:session): session closed for user root Nov 18 19:22:50 oleg228-client systemd[1]: session-386.scope: Succeeded. Nov 18 19:22:50 oleg228-client systemd-logind[1015]: Session 386 logged out. Waiting for processes to exit. Nov 18 19:22:50 oleg228-client systemd-logind[1015]: Removed session 386. Nov 18 19:23:08 oleg228-client sshd[76236]: Accepted publickey for root from 192.168.202.28 port 44904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:23:08 oleg228-client systemd-logind[1015]: New session 387 of user root. Nov 18 19:23:08 oleg228-client systemd[1]: Started Session 387 of user root. Nov 18 19:23:08 oleg228-client sshd[76236]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:23:09 oleg228-client sshd[76249]: Received disconnect from 192.168.202.28 port 44904:11: disconnected by user Nov 18 19:23:09 oleg228-client sshd[76249]: Disconnected from user root 192.168.202.28 port 44904 Nov 18 19:23:09 oleg228-client sshd[76236]: pam_unix(sshd:session): session closed for user root Nov 18 19:23:09 oleg228-client systemd[1]: session-387.scope: Succeeded. Nov 18 19:23:09 oleg228-client systemd-logind[1015]: Session 387 logged out. Waiting for processes to exit. Nov 18 19:23:09 oleg228-client systemd-logind[1015]: Removed session 387. Nov 18 19:23:10 oleg228-client sshd[76376]: Accepted publickey for root from 192.168.202.28 port 44910 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:23:10 oleg228-client systemd-logind[1015]: New session 388 of user root. Nov 18 19:23:10 oleg228-client systemd[1]: Started Session 388 of user root. Nov 18 19:23:10 oleg228-client sshd[76376]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:23:10 oleg228-client sshd[76389]: Received disconnect from 192.168.202.28 port 44910:11: disconnected by user Nov 18 19:23:10 oleg228-client sshd[76389]: Disconnected from user root 192.168.202.28 port 44910 Nov 18 19:23:10 oleg228-client sshd[76376]: pam_unix(sshd:session): session closed for user root Nov 18 19:23:10 oleg228-client systemd[1]: session-388.scope: Succeeded. Nov 18 19:23:10 oleg228-client systemd-logind[1015]: Session 388 logged out. Waiting for processes to exit. Nov 18 19:23:10 oleg228-client systemd-logind[1015]: Removed session 388. Nov 18 19:23:11 oleg228-client sshd[76522]: Accepted publickey for root from 192.168.202.28 port 44408 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:23:11 oleg228-client systemd-logind[1015]: New session 389 of user root. Nov 18 19:23:11 oleg228-client systemd[1]: Started Session 389 of user root. Nov 18 19:23:11 oleg228-client sshd[76522]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:23:12 oleg228-client sshd[76535]: Received disconnect from 192.168.202.28 port 44408:11: disconnected by user Nov 18 19:23:12 oleg228-client sshd[76535]: Disconnected from user root 192.168.202.28 port 44408 Nov 18 19:23:12 oleg228-client sshd[76522]: pam_unix(sshd:session): session closed for user root Nov 18 19:23:12 oleg228-client systemd[1]: session-389.scope: Succeeded. Nov 18 19:23:12 oleg228-client systemd-logind[1015]: Session 389 logged out. Waiting for processes to exit. Nov 18 19:23:12 oleg228-client systemd-logind[1015]: Removed session 389. Nov 18 19:23:13 oleg228-client sshd[76677]: Accepted publickey for root from 192.168.202.28 port 44422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:23:13 oleg228-client systemd-logind[1015]: New session 390 of user root. Nov 18 19:23:13 oleg228-client systemd[1]: Started Session 390 of user root. Nov 18 19:23:13 oleg228-client sshd[76677]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:23:13 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110d: remove remote directory: drop client req ========================================================== 19:23:12 (1763511792) Nov 18 19:23:13 oleg228-client sshd[76690]: Received disconnect from 192.168.202.28 port 44422:11: disconnected by user Nov 18 19:23:13 oleg228-client sshd[76690]: Disconnected from user root 192.168.202.28 port 44422 Nov 18 19:23:13 oleg228-client sshd[76677]: pam_unix(sshd:session): session closed for user root Nov 18 19:23:13 oleg228-client systemd-logind[1015]: Session 390 logged out. Waiting for processes to exit. Nov 18 19:23:13 oleg228-client systemd[1]: session-390.scope: Succeeded. Nov 18 19:23:13 oleg228-client systemd-logind[1015]: Removed session 390. Nov 18 19:24:02 oleg228-client anacron[51137]: Job `cron.daily' started Nov 18 19:24:02 oleg228-client run-parts[76748]: (/etc/cron.daily) starting logrotate Nov 18 19:24:02 oleg228-client run-parts[76748]: (/etc/cron.daily) finished logrotate Nov 18 19:24:02 oleg228-client anacron[51137]: Job `cron.daily' terminated Nov 18 19:24:14 oleg228-client kernel: Lustre: 76740:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763511794/real 1763511794] req@ffff9ccbcd703100 x1849171068835840/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc7bdb800@192.168.202.128@tcp:12/10 lens 584/1152 e 0 to 1 dl 1763511854 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 Nov 18 19:24:14 oleg228-client kernel: Lustre: 76740:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Nov 18 19:24:17 oleg228-client sshd[76855]: Accepted publickey for root from 192.168.202.28 port 56148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:24:17 oleg228-client systemd-logind[1015]: New session 391 of user root. Nov 18 19:24:17 oleg228-client systemd[1]: Started Session 391 of user root. Nov 18 19:24:17 oleg228-client sshd[76855]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:24:17 oleg228-client sshd[76868]: Received disconnect from 192.168.202.28 port 56148:11: disconnected by user Nov 18 19:24:17 oleg228-client sshd[76868]: Disconnected from user root 192.168.202.28 port 56148 Nov 18 19:24:17 oleg228-client sshd[76855]: pam_unix(sshd:session): session closed for user root Nov 18 19:24:17 oleg228-client systemd[1]: session-391.scope: Succeeded. Nov 18 19:24:17 oleg228-client systemd-logind[1015]: Session 391 logged out. Waiting for processes to exit. Nov 18 19:24:17 oleg228-client systemd-logind[1015]: Removed session 391. Nov 18 19:24:18 oleg228-client sshd[76994]: Accepted publickey for root from 192.168.202.28 port 56160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:24:18 oleg228-client systemd[1]: Started Session 392 of user root. Nov 18 19:24:18 oleg228-client systemd-logind[1015]: New session 392 of user root. Nov 18 19:24:18 oleg228-client sshd[76994]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:24:19 oleg228-client sshd[77007]: Received disconnect from 192.168.202.28 port 56160:11: disconnected by user Nov 18 19:24:19 oleg228-client sshd[77007]: Disconnected from user root 192.168.202.28 port 56160 Nov 18 19:24:19 oleg228-client sshd[76994]: pam_unix(sshd:session): session closed for user root Nov 18 19:24:19 oleg228-client systemd[1]: session-392.scope: Succeeded. Nov 18 19:24:19 oleg228-client systemd-logind[1015]: Session 392 logged out. Waiting for processes to exit. Nov 18 19:24:19 oleg228-client systemd-logind[1015]: Removed session 392. Nov 18 19:24:20 oleg228-client sshd[77141]: Accepted publickey for root from 192.168.202.28 port 56164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:24:20 oleg228-client systemd-logind[1015]: New session 393 of user root. Nov 18 19:24:20 oleg228-client systemd[1]: Started Session 393 of user root. Nov 18 19:24:20 oleg228-client sshd[77141]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:24:21 oleg228-client sshd[77154]: Received disconnect from 192.168.202.28 port 56164:11: disconnected by user Nov 18 19:24:21 oleg228-client sshd[77154]: Disconnected from user root 192.168.202.28 port 56164 Nov 18 19:24:21 oleg228-client sshd[77141]: pam_unix(sshd:session): session closed for user root Nov 18 19:24:21 oleg228-client systemd[1]: session-393.scope: Succeeded. Nov 18 19:24:21 oleg228-client systemd-logind[1015]: Session 393 logged out. Waiting for processes to exit. Nov 18 19:24:21 oleg228-client systemd-logind[1015]: Removed session 393. Nov 18 19:24:23 oleg228-client sshd[77296]: Accepted publickey for root from 192.168.202.28 port 53224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:24:23 oleg228-client systemd-logind[1015]: New session 394 of user root. Nov 18 19:24:23 oleg228-client systemd[1]: Started Session 394 of user root. Nov 18 19:24:23 oleg228-client sshd[77296]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:24:23 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110e: remove remote directory: drop master rep ========================================================== 19:24:21 (1763511861) Nov 18 19:24:23 oleg228-client sshd[77309]: Received disconnect from 192.168.202.28 port 53224:11: disconnected by user Nov 18 19:24:23 oleg228-client sshd[77309]: Disconnected from user root 192.168.202.28 port 53224 Nov 18 19:24:23 oleg228-client sshd[77296]: pam_unix(sshd:session): session closed for user root Nov 18 19:24:24 oleg228-client systemd-logind[1015]: Session 394 logged out. Waiting for processes to exit. Nov 18 19:24:24 oleg228-client systemd[1]: session-394.scope: Succeeded. Nov 18 19:24:24 oleg228-client systemd-logind[1015]: Removed session 394. Nov 18 19:25:27 oleg228-client sshd[77460]: Accepted publickey for root from 192.168.202.28 port 57248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:27 oleg228-client systemd-logind[1015]: New session 395 of user root. Nov 18 19:25:27 oleg228-client systemd[1]: Started Session 395 of user root. Nov 18 19:25:27 oleg228-client sshd[77460]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:27 oleg228-client sshd[77473]: Received disconnect from 192.168.202.28 port 57248:11: disconnected by user Nov 18 19:25:27 oleg228-client sshd[77473]: Disconnected from user root 192.168.202.28 port 57248 Nov 18 19:25:27 oleg228-client sshd[77460]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:28 oleg228-client systemd-logind[1015]: Session 395 logged out. Waiting for processes to exit. Nov 18 19:25:28 oleg228-client systemd[1]: session-395.scope: Succeeded. Nov 18 19:25:28 oleg228-client systemd-logind[1015]: Removed session 395. Nov 18 19:25:28 oleg228-client sshd[77600]: Accepted publickey for root from 192.168.202.28 port 57250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:29 oleg228-client systemd[1]: Started Session 396 of user root. Nov 18 19:25:29 oleg228-client systemd-logind[1015]: New session 396 of user root. Nov 18 19:25:29 oleg228-client sshd[77600]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:29 oleg228-client sshd[77613]: Received disconnect from 192.168.202.28 port 57250:11: disconnected by user Nov 18 19:25:29 oleg228-client sshd[77613]: Disconnected from user root 192.168.202.28 port 57250 Nov 18 19:25:29 oleg228-client sshd[77600]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:29 oleg228-client systemd[1]: session-396.scope: Succeeded. Nov 18 19:25:29 oleg228-client systemd-logind[1015]: Session 396 logged out. Waiting for processes to exit. Nov 18 19:25:29 oleg228-client systemd-logind[1015]: Removed session 396. Nov 18 19:25:30 oleg228-client sshd[77746]: Accepted publickey for root from 192.168.202.28 port 57264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:30 oleg228-client systemd-logind[1015]: New session 397 of user root. Nov 18 19:25:30 oleg228-client systemd[1]: Started Session 397 of user root. Nov 18 19:25:30 oleg228-client sshd[77746]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:30 oleg228-client sshd[77759]: Received disconnect from 192.168.202.28 port 57264:11: disconnected by user Nov 18 19:25:30 oleg228-client sshd[77759]: Disconnected from user root 192.168.202.28 port 57264 Nov 18 19:25:30 oleg228-client sshd[77746]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:31 oleg228-client systemd-logind[1015]: Session 397 logged out. Waiting for processes to exit. Nov 18 19:25:31 oleg228-client systemd[1]: session-397.scope: Succeeded. Nov 18 19:25:31 oleg228-client systemd-logind[1015]: Removed session 397. Nov 18 19:25:32 oleg228-client sshd[77901]: Accepted publickey for root from 192.168.202.28 port 37224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:32 oleg228-client systemd[1]: Started Session 398 of user root. Nov 18 19:25:32 oleg228-client systemd-logind[1015]: New session 398 of user root. Nov 18 19:25:32 oleg228-client sshd[77901]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:32 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110f: remove remote directory: drop slave rep ========================================================== 19:25:31 (1763511931) Nov 18 19:25:32 oleg228-client sshd[77914]: Received disconnect from 192.168.202.28 port 37224:11: disconnected by user Nov 18 19:25:32 oleg228-client sshd[77914]: Disconnected from user root 192.168.202.28 port 37224 Nov 18 19:25:32 oleg228-client sshd[77901]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:32 oleg228-client systemd-logind[1015]: Session 398 logged out. Waiting for processes to exit. Nov 18 19:25:32 oleg228-client systemd[1]: session-398.scope: Succeeded. Nov 18 19:25:32 oleg228-client systemd-logind[1015]: Removed session 398. Nov 18 19:25:52 oleg228-client sshd[78063]: Accepted publickey for root from 192.168.202.28 port 47048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:52 oleg228-client systemd-logind[1015]: New session 399 of user root. Nov 18 19:25:52 oleg228-client systemd[1]: Started Session 399 of user root. Nov 18 19:25:52 oleg228-client sshd[78063]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:53 oleg228-client sshd[78076]: Received disconnect from 192.168.202.28 port 47048:11: disconnected by user Nov 18 19:25:53 oleg228-client sshd[78076]: Disconnected from user root 192.168.202.28 port 47048 Nov 18 19:25:53 oleg228-client sshd[78063]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:53 oleg228-client systemd-logind[1015]: Session 399 logged out. Waiting for processes to exit. Nov 18 19:25:53 oleg228-client systemd[1]: session-399.scope: Succeeded. Nov 18 19:25:53 oleg228-client systemd-logind[1015]: Removed session 399. Nov 18 19:25:54 oleg228-client sshd[78202]: Accepted publickey for root from 192.168.202.28 port 47054 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:54 oleg228-client systemd[1]: Started Session 400 of user root. Nov 18 19:25:54 oleg228-client systemd-logind[1015]: New session 400 of user root. Nov 18 19:25:54 oleg228-client sshd[78202]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:54 oleg228-client sshd[78215]: Received disconnect from 192.168.202.28 port 47054:11: disconnected by user Nov 18 19:25:54 oleg228-client sshd[78215]: Disconnected from user root 192.168.202.28 port 47054 Nov 18 19:25:54 oleg228-client sshd[78202]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:54 oleg228-client systemd[1]: session-400.scope: Succeeded. Nov 18 19:25:54 oleg228-client systemd-logind[1015]: Session 400 logged out. Waiting for processes to exit. Nov 18 19:25:54 oleg228-client systemd-logind[1015]: Removed session 400. Nov 18 19:25:55 oleg228-client sshd[78349]: Accepted publickey for root from 192.168.202.28 port 47068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:55 oleg228-client systemd[1]: Started Session 401 of user root. Nov 18 19:25:55 oleg228-client systemd-logind[1015]: New session 401 of user root. Nov 18 19:25:55 oleg228-client sshd[78349]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:56 oleg228-client sshd[78362]: Received disconnect from 192.168.202.28 port 47068:11: disconnected by user Nov 18 19:25:56 oleg228-client sshd[78362]: Disconnected from user root 192.168.202.28 port 47068 Nov 18 19:25:56 oleg228-client sshd[78349]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:56 oleg228-client systemd[1]: session-401.scope: Succeeded. Nov 18 19:25:56 oleg228-client systemd-logind[1015]: Session 401 logged out. Waiting for processes to exit. Nov 18 19:25:56 oleg228-client systemd-logind[1015]: Removed session 401. Nov 18 19:25:57 oleg228-client sshd[78505]: Accepted publickey for root from 192.168.202.28 port 47076 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:25:57 oleg228-client systemd-logind[1015]: New session 402 of user root. Nov 18 19:25:57 oleg228-client systemd[1]: Started Session 402 of user root. Nov 18 19:25:57 oleg228-client sshd[78505]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:25:58 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110g: drop reply during migration ========================================================== 19:25:56 (1763511956) Nov 18 19:25:58 oleg228-client sshd[78518]: Received disconnect from 192.168.202.28 port 47076:11: disconnected by user Nov 18 19:25:58 oleg228-client sshd[78518]: Disconnected from user root 192.168.202.28 port 47076 Nov 18 19:25:58 oleg228-client sshd[78505]: pam_unix(sshd:session): session closed for user root Nov 18 19:25:58 oleg228-client systemd-logind[1015]: Session 402 logged out. Waiting for processes to exit. Nov 18 19:25:58 oleg228-client systemd[1]: session-402.scope: Succeeded. Nov 18 19:25:58 oleg228-client systemd-logind[1015]: Removed session 402. Nov 18 19:27:01 oleg228-client sshd[78675]: Accepted publickey for root from 192.168.202.28 port 38114 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:01 oleg228-client systemd-logind[1015]: New session 403 of user root. Nov 18 19:27:01 oleg228-client systemd[1]: Started Session 403 of user root. Nov 18 19:27:01 oleg228-client sshd[78675]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:01 oleg228-client sshd[78689]: Received disconnect from 192.168.202.28 port 38114:11: disconnected by user Nov 18 19:27:01 oleg228-client sshd[78689]: Disconnected from user root 192.168.202.28 port 38114 Nov 18 19:27:01 oleg228-client sshd[78675]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:01 oleg228-client systemd-logind[1015]: Session 403 logged out. Waiting for processes to exit. Nov 18 19:27:01 oleg228-client systemd[1]: session-403.scope: Succeeded. Nov 18 19:27:01 oleg228-client systemd-logind[1015]: Removed session 403. Nov 18 19:27:03 oleg228-client sshd[78815]: Accepted publickey for root from 192.168.202.28 port 38130 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:03 oleg228-client systemd-logind[1015]: New session 404 of user root. Nov 18 19:27:03 oleg228-client systemd[1]: Started Session 404 of user root. Nov 18 19:27:03 oleg228-client sshd[78815]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:03 oleg228-client sshd[78828]: Received disconnect from 192.168.202.28 port 38130:11: disconnected by user Nov 18 19:27:03 oleg228-client sshd[78828]: Disconnected from user root 192.168.202.28 port 38130 Nov 18 19:27:03 oleg228-client sshd[78815]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:03 oleg228-client systemd[1]: session-404.scope: Succeeded. Nov 18 19:27:03 oleg228-client systemd-logind[1015]: Session 404 logged out. Waiting for processes to exit. Nov 18 19:27:03 oleg228-client systemd-logind[1015]: Removed session 404. Nov 18 19:27:04 oleg228-client sshd[78961]: Accepted publickey for root from 192.168.202.28 port 38136 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:04 oleg228-client systemd-logind[1015]: New session 405 of user root. Nov 18 19:27:04 oleg228-client systemd[1]: Started Session 405 of user root. Nov 18 19:27:04 oleg228-client sshd[78961]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:05 oleg228-client sshd[78974]: Received disconnect from 192.168.202.28 port 38136:11: disconnected by user Nov 18 19:27:05 oleg228-client sshd[78974]: Disconnected from user root 192.168.202.28 port 38136 Nov 18 19:27:05 oleg228-client sshd[78961]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:05 oleg228-client systemd-logind[1015]: Session 405 logged out. Waiting for processes to exit. Nov 18 19:27:05 oleg228-client systemd[1]: session-405.scope: Succeeded. Nov 18 19:27:05 oleg228-client systemd-logind[1015]: Removed session 405. Nov 18 19:27:06 oleg228-client sshd[79116]: Accepted publickey for root from 192.168.202.28 port 38140 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:06 oleg228-client systemd-logind[1015]: New session 406 of user root. Nov 18 19:27:06 oleg228-client systemd[1]: Started Session 406 of user root. Nov 18 19:27:06 oleg228-client sshd[79116]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110h: drop update reply during cross-MDT file rename ========================================================== 19:27:05 (1763512025) Nov 18 19:27:06 oleg228-client sshd[79129]: Received disconnect from 192.168.202.28 port 38140:11: disconnected by user Nov 18 19:27:06 oleg228-client sshd[79129]: Disconnected from user root 192.168.202.28 port 38140 Nov 18 19:27:06 oleg228-client sshd[79116]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:07 oleg228-client systemd[1]: session-406.scope: Succeeded. Nov 18 19:27:07 oleg228-client systemd-logind[1015]: Session 406 logged out. Waiting for processes to exit. Nov 18 19:27:07 oleg228-client systemd-logind[1015]: Removed session 406. Nov 18 19:27:27 oleg228-client sshd[79284]: Accepted publickey for root from 192.168.202.28 port 45350 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:27 oleg228-client systemd-logind[1015]: New session 407 of user root. Nov 18 19:27:27 oleg228-client systemd[1]: Started Session 407 of user root. Nov 18 19:27:27 oleg228-client sshd[79284]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:27 oleg228-client sshd[79297]: Received disconnect from 192.168.202.28 port 45350:11: disconnected by user Nov 18 19:27:28 oleg228-client sshd[79297]: Disconnected from user root 192.168.202.28 port 45350 Nov 18 19:27:28 oleg228-client sshd[79284]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:28 oleg228-client systemd[1]: session-407.scope: Succeeded. Nov 18 19:27:28 oleg228-client systemd-logind[1015]: Session 407 logged out. Waiting for processes to exit. Nov 18 19:27:28 oleg228-client systemd-logind[1015]: Removed session 407. Nov 18 19:27:29 oleg228-client sshd[79425]: Accepted publickey for root from 192.168.202.28 port 45366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:29 oleg228-client systemd-logind[1015]: New session 408 of user root. Nov 18 19:27:29 oleg228-client systemd[1]: Started Session 408 of user root. Nov 18 19:27:29 oleg228-client sshd[79425]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:29 oleg228-client sshd[79438]: Received disconnect from 192.168.202.28 port 45366:11: disconnected by user Nov 18 19:27:29 oleg228-client sshd[79438]: Disconnected from user root 192.168.202.28 port 45366 Nov 18 19:27:29 oleg228-client sshd[79425]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:30 oleg228-client systemd[1]: session-408.scope: Succeeded. Nov 18 19:27:30 oleg228-client systemd-logind[1015]: Session 408 logged out. Waiting for processes to exit. Nov 18 19:27:30 oleg228-client systemd-logind[1015]: Removed session 408. Nov 18 19:27:31 oleg228-client sshd[79571]: Accepted publickey for root from 192.168.202.28 port 34452 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:31 oleg228-client systemd[1]: Started Session 409 of user root. Nov 18 19:27:31 oleg228-client systemd-logind[1015]: New session 409 of user root. Nov 18 19:27:31 oleg228-client sshd[79571]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:31 oleg228-client sshd[79584]: Received disconnect from 192.168.202.28 port 34452:11: disconnected by user Nov 18 19:27:31 oleg228-client sshd[79584]: Disconnected from user root 192.168.202.28 port 34452 Nov 18 19:27:31 oleg228-client sshd[79571]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:31 oleg228-client systemd[1]: session-409.scope: Succeeded. Nov 18 19:27:31 oleg228-client systemd-logind[1015]: Session 409 logged out. Waiting for processes to exit. Nov 18 19:27:31 oleg228-client systemd-logind[1015]: Removed session 409. Nov 18 19:27:33 oleg228-client sshd[79727]: Accepted publickey for root from 192.168.202.28 port 34464 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:33 oleg228-client systemd-logind[1015]: New session 410 of user root. Nov 18 19:27:33 oleg228-client systemd[1]: Started Session 410 of user root. Nov 18 19:27:33 oleg228-client sshd[79727]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:33 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110i: drop update reply during cross-MDT dir rename ========================================================== 19:27:32 (1763512052) Nov 18 19:27:33 oleg228-client sshd[79740]: Received disconnect from 192.168.202.28 port 34464:11: disconnected by user Nov 18 19:27:33 oleg228-client sshd[79740]: Disconnected from user root 192.168.202.28 port 34464 Nov 18 19:27:33 oleg228-client sshd[79727]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:33 oleg228-client systemd[1]: session-410.scope: Succeeded. Nov 18 19:27:33 oleg228-client systemd-logind[1015]: Session 410 logged out. Waiting for processes to exit. Nov 18 19:27:33 oleg228-client systemd-logind[1015]: Removed session 410. Nov 18 19:27:54 oleg228-client sshd[79897]: Accepted publickey for root from 192.168.202.28 port 43982 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:54 oleg228-client systemd-logind[1015]: New session 411 of user root. Nov 18 19:27:54 oleg228-client systemd[1]: Started Session 411 of user root. Nov 18 19:27:54 oleg228-client sshd[79897]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:54 oleg228-client sshd[79911]: Received disconnect from 192.168.202.28 port 43982:11: disconnected by user Nov 18 19:27:54 oleg228-client sshd[79911]: Disconnected from user root 192.168.202.28 port 43982 Nov 18 19:27:55 oleg228-client sshd[79897]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:55 oleg228-client systemd[1]: session-411.scope: Succeeded. Nov 18 19:27:55 oleg228-client systemd-logind[1015]: Session 411 logged out. Waiting for processes to exit. Nov 18 19:27:55 oleg228-client systemd-logind[1015]: Removed session 411. Nov 18 19:27:56 oleg228-client sshd[80037]: Accepted publickey for root from 192.168.202.28 port 43992 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:56 oleg228-client systemd-logind[1015]: New session 412 of user root. Nov 18 19:27:56 oleg228-client systemd[1]: Started Session 412 of user root. Nov 18 19:27:56 oleg228-client sshd[80037]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:57 oleg228-client sshd[80050]: Received disconnect from 192.168.202.28 port 43992:11: disconnected by user Nov 18 19:27:57 oleg228-client sshd[80050]: Disconnected from user root 192.168.202.28 port 43992 Nov 18 19:27:57 oleg228-client sshd[80037]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:57 oleg228-client systemd[1]: session-412.scope: Succeeded. Nov 18 19:27:57 oleg228-client systemd-logind[1015]: Session 412 logged out. Waiting for processes to exit. Nov 18 19:27:57 oleg228-client systemd-logind[1015]: Removed session 412. Nov 18 19:27:58 oleg228-client sshd[80183]: Accepted publickey for root from 192.168.202.28 port 44008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:27:58 oleg228-client systemd[1]: Started Session 413 of user root. Nov 18 19:27:58 oleg228-client systemd-logind[1015]: New session 413 of user root. Nov 18 19:27:58 oleg228-client sshd[80183]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:27:59 oleg228-client sshd[80196]: Received disconnect from 192.168.202.28 port 44008:11: disconnected by user Nov 18 19:27:59 oleg228-client sshd[80196]: Disconnected from user root 192.168.202.28 port 44008 Nov 18 19:27:59 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:27:59 oleg228-client sshd[80183]: pam_unix(sshd:session): session closed for user root Nov 18 19:27:59 oleg228-client systemd[1]: session-413.scope: Succeeded. Nov 18 19:27:59 oleg228-client systemd-logind[1015]: Session 413 logged out. Waiting for processes to exit. Nov 18 19:27:59 oleg228-client systemd-logind[1015]: Removed session 413. Nov 18 19:28:00 oleg228-client sshd[80339]: Accepted publickey for root from 192.168.202.28 port 44018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:28:00 oleg228-client systemd[1]: Started Session 414 of user root. Nov 18 19:28:00 oleg228-client systemd-logind[1015]: New session 414 of user root. Nov 18 19:28:00 oleg228-client sshd[80339]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:28:00 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110j: drop update reply during cross-MDT ln ========================================================== 19:27:59 (1763512079) Nov 18 19:28:00 oleg228-client sshd[80352]: Received disconnect from 192.168.202.28 port 44018:11: disconnected by user Nov 18 19:28:00 oleg228-client sshd[80352]: Disconnected from user root 192.168.202.28 port 44018 Nov 18 19:28:00 oleg228-client sshd[80339]: pam_unix(sshd:session): session closed for user root Nov 18 19:28:01 oleg228-client systemd[1]: session-414.scope: Succeeded. Nov 18 19:28:01 oleg228-client systemd-logind[1015]: Session 414 logged out. Waiting for processes to exit. Nov 18 19:28:01 oleg228-client systemd-logind[1015]: Removed session 414. Nov 18 19:28:22 oleg228-client sshd[80507]: Accepted publickey for root from 192.168.202.28 port 56244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:28:22 oleg228-client systemd[1]: Started Session 415 of user root. Nov 18 19:28:22 oleg228-client systemd-logind[1015]: New session 415 of user root. Nov 18 19:28:22 oleg228-client sshd[80507]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:28:22 oleg228-client sshd[80520]: Received disconnect from 192.168.202.28 port 56244:11: disconnected by user Nov 18 19:28:22 oleg228-client sshd[80520]: Disconnected from user root 192.168.202.28 port 56244 Nov 18 19:28:22 oleg228-client sshd[80507]: pam_unix(sshd:session): session closed for user root Nov 18 19:28:22 oleg228-client systemd[1]: session-415.scope: Succeeded. Nov 18 19:28:22 oleg228-client systemd-logind[1015]: Session 415 logged out. Waiting for processes to exit. Nov 18 19:28:22 oleg228-client systemd-logind[1015]: Removed session 415. Nov 18 19:28:23 oleg228-client sshd[80646]: Accepted publickey for root from 192.168.202.28 port 56248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:28:23 oleg228-client systemd-logind[1015]: New session 416 of user root. Nov 18 19:28:23 oleg228-client systemd[1]: Started Session 416 of user root. Nov 18 19:28:23 oleg228-client sshd[80646]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:28:24 oleg228-client sshd[80659]: Received disconnect from 192.168.202.28 port 56248:11: disconnected by user Nov 18 19:28:24 oleg228-client sshd[80659]: Disconnected from user root 192.168.202.28 port 56248 Nov 18 19:28:24 oleg228-client sshd[80646]: pam_unix(sshd:session): session closed for user root Nov 18 19:28:24 oleg228-client systemd[1]: session-416.scope: Succeeded. Nov 18 19:28:24 oleg228-client systemd-logind[1015]: Session 416 logged out. Waiting for processes to exit. Nov 18 19:28:24 oleg228-client systemd-logind[1015]: Removed session 416. Nov 18 19:28:25 oleg228-client sshd[80792]: Accepted publickey for root from 192.168.202.28 port 56254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:28:25 oleg228-client systemd-logind[1015]: New session 417 of user root. Nov 18 19:28:25 oleg228-client systemd[1]: Started Session 417 of user root. Nov 18 19:28:25 oleg228-client sshd[80792]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:28:26 oleg228-client sshd[80805]: Received disconnect from 192.168.202.28 port 56254:11: disconnected by user Nov 18 19:28:26 oleg228-client sshd[80805]: Disconnected from user root 192.168.202.28 port 56254 Nov 18 19:28:26 oleg228-client sshd[80792]: pam_unix(sshd:session): session closed for user root Nov 18 19:28:26 oleg228-client systemd[1]: session-417.scope: Succeeded. Nov 18 19:28:26 oleg228-client systemd-logind[1015]: Session 417 logged out. Waiting for processes to exit. Nov 18 19:28:26 oleg228-client systemd-logind[1015]: Removed session 417. Nov 18 19:28:28 oleg228-client sshd[80948]: Accepted publickey for root from 192.168.202.28 port 56260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:28:28 oleg228-client systemd-logind[1015]: New session 418 of user root. Nov 18 19:28:28 oleg228-client systemd[1]: Started Session 418 of user root. Nov 18 19:28:28 oleg228-client sshd[80948]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:28:28 oleg228-client sshd[80962]: Received disconnect from 192.168.202.28 port 56260:11: disconnected by user Nov 18 19:28:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110k: FID_QUERY failed during recovery ========================================================== 19:28:26 (1763512106) Nov 18 19:28:28 oleg228-client sshd[80962]: Disconnected from user root 192.168.202.28 port 56260 Nov 18 19:28:28 oleg228-client sshd[80948]: pam_unix(sshd:session): session closed for user root Nov 18 19:28:28 oleg228-client systemd[1]: session-418.scope: Succeeded. Nov 18 19:28:28 oleg228-client systemd-logind[1015]: Session 418 logged out. Waiting for processes to exit. Nov 18 19:28:28 oleg228-client systemd-logind[1015]: Removed session 418. Nov 18 19:28:28 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 19:28:29 oleg228-client kernel: LustreError: 81000:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc7bdb800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:28:29 oleg228-client kernel: LustreError: 81000:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:28:29 oleg228-client kernel: LustreError: 81000:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 19:28:29 oleg228-client kernel: LustreError: 81000:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:28:29 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:29:12 oleg228-client systemd-udevd[81508]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:29:12 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:29:14 oleg228-client sshd[81530]: Accepted publickey for root from 192.168.202.28 port 51014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:14 oleg228-client systemd[1]: Started Session 419 of user root. Nov 18 19:29:14 oleg228-client systemd-logind[1015]: New session 419 of user root. Nov 18 19:29:14 oleg228-client sshd[81530]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:14 oleg228-client sshd[81543]: Received disconnect from 192.168.202.28 port 51014:11: disconnected by user Nov 18 19:29:14 oleg228-client sshd[81543]: Disconnected from user root 192.168.202.28 port 51014 Nov 18 19:29:14 oleg228-client sshd[81530]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:15 oleg228-client systemd[1]: session-419.scope: Succeeded. Nov 18 19:29:15 oleg228-client systemd-logind[1015]: Session 419 logged out. Waiting for processes to exit. Nov 18 19:29:15 oleg228-client systemd-logind[1015]: Removed session 419. Nov 18 19:29:24 oleg228-client sshd[81774]: Accepted publickey for root from 192.168.202.28 port 53802 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:25 oleg228-client systemd-logind[1015]: New session 420 of user root. Nov 18 19:29:25 oleg228-client systemd[1]: Started Session 420 of user root. Nov 18 19:29:25 oleg228-client sshd[81774]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:25 oleg228-client sshd[81787]: Received disconnect from 192.168.202.28 port 53802:11: disconnected by user Nov 18 19:29:25 oleg228-client sshd[81787]: Disconnected from user root 192.168.202.28 port 53802 Nov 18 19:29:25 oleg228-client sshd[81774]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:25 oleg228-client systemd[1]: session-420.scope: Succeeded. Nov 18 19:29:25 oleg228-client systemd-logind[1015]: Session 420 logged out. Waiting for processes to exit. Nov 18 19:29:25 oleg228-client systemd-logind[1015]: Removed session 420. Nov 18 19:29:26 oleg228-client sshd[81913]: Accepted publickey for root from 192.168.202.28 port 53818 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:26 oleg228-client systemd-logind[1015]: New session 421 of user root. Nov 18 19:29:26 oleg228-client systemd[1]: Started Session 421 of user root. Nov 18 19:29:26 oleg228-client sshd[81913]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:27 oleg228-client sshd[81926]: Received disconnect from 192.168.202.28 port 53818:11: disconnected by user Nov 18 19:29:27 oleg228-client sshd[81926]: Disconnected from user root 192.168.202.28 port 53818 Nov 18 19:29:27 oleg228-client sshd[81913]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:27 oleg228-client systemd[1]: session-421.scope: Succeeded. Nov 18 19:29:27 oleg228-client systemd-logind[1015]: Session 421 logged out. Waiting for processes to exit. Nov 18 19:29:27 oleg228-client systemd-logind[1015]: Removed session 421. Nov 18 19:29:28 oleg228-client sshd[82059]: Accepted publickey for root from 192.168.202.28 port 53828 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:28 oleg228-client systemd[1]: Started Session 422 of user root. Nov 18 19:29:28 oleg228-client systemd-logind[1015]: New session 422 of user root. Nov 18 19:29:28 oleg228-client sshd[82059]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:28 oleg228-client sshd[82072]: Received disconnect from 192.168.202.28 port 53828:11: disconnected by user Nov 18 19:29:28 oleg228-client sshd[82072]: Disconnected from user root 192.168.202.28 port 53828 Nov 18 19:29:28 oleg228-client sshd[82059]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:29 oleg228-client systemd[1]: session-422.scope: Succeeded. Nov 18 19:29:29 oleg228-client systemd-logind[1015]: Session 422 logged out. Waiting for processes to exit. Nov 18 19:29:29 oleg228-client systemd-logind[1015]: Removed session 422. Nov 18 19:29:30 oleg228-client sshd[82215]: Accepted publickey for root from 192.168.202.28 port 53840 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:30 oleg228-client systemd[1]: Started Session 423 of user root. Nov 18 19:29:30 oleg228-client systemd-logind[1015]: New session 423 of user root. Nov 18 19:29:30 oleg228-client sshd[82215]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:30 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 110m: update resent vs original RPC race ========================================================== 19:29:29 (1763512169) Nov 18 19:29:30 oleg228-client sshd[82228]: Received disconnect from 192.168.202.28 port 53840:11: disconnected by user Nov 18 19:29:30 oleg228-client sshd[82228]: Disconnected from user root 192.168.202.28 port 53840 Nov 18 19:29:30 oleg228-client sshd[82215]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:30 oleg228-client systemd[1]: session-423.scope: Succeeded. Nov 18 19:29:30 oleg228-client systemd-logind[1015]: Session 423 logged out. Waiting for processes to exit. Nov 18 19:29:30 oleg228-client systemd-logind[1015]: Removed session 423. Nov 18 19:29:42 oleg228-client sshd[82417]: Accepted publickey for root from 192.168.202.28 port 48180 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:42 oleg228-client systemd-logind[1015]: New session 424 of user root. Nov 18 19:29:42 oleg228-client systemd[1]: Started Session 424 of user root. Nov 18 19:29:42 oleg228-client sshd[82417]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:43 oleg228-client sshd[82430]: Received disconnect from 192.168.202.28 port 48180:11: disconnected by user Nov 18 19:29:43 oleg228-client sshd[82430]: Disconnected from user root 192.168.202.28 port 48180 Nov 18 19:29:43 oleg228-client sshd[82417]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:43 oleg228-client systemd[1]: session-424.scope: Succeeded. Nov 18 19:29:43 oleg228-client systemd-logind[1015]: Session 424 logged out. Waiting for processes to exit. Nov 18 19:29:43 oleg228-client systemd-logind[1015]: Removed session 424. Nov 18 19:29:44 oleg228-client sshd[82557]: Accepted publickey for root from 192.168.202.28 port 48196 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:44 oleg228-client systemd-logind[1015]: New session 425 of user root. Nov 18 19:29:44 oleg228-client systemd[1]: Started Session 425 of user root. Nov 18 19:29:44 oleg228-client sshd[82557]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:44 oleg228-client sshd[82570]: Received disconnect from 192.168.202.28 port 48196:11: disconnected by user Nov 18 19:29:44 oleg228-client sshd[82570]: Disconnected from user root 192.168.202.28 port 48196 Nov 18 19:29:44 oleg228-client sshd[82557]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:44 oleg228-client systemd[1]: session-425.scope: Succeeded. Nov 18 19:29:44 oleg228-client systemd-logind[1015]: Session 425 logged out. Waiting for processes to exit. Nov 18 19:29:44 oleg228-client systemd-logind[1015]: Removed session 425. Nov 18 19:29:45 oleg228-client sshd[82703]: Accepted publickey for root from 192.168.202.28 port 48206 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:45 oleg228-client systemd[1]: Started Session 426 of user root. Nov 18 19:29:45 oleg228-client systemd-logind[1015]: New session 426 of user root. Nov 18 19:29:45 oleg228-client sshd[82703]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:46 oleg228-client sshd[82716]: Received disconnect from 192.168.202.28 port 48206:11: disconnected by user Nov 18 19:29:46 oleg228-client sshd[82716]: Disconnected from user root 192.168.202.28 port 48206 Nov 18 19:29:46 oleg228-client sshd[82703]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:46 oleg228-client systemd[1]: session-426.scope: Succeeded. Nov 18 19:29:46 oleg228-client systemd-logind[1015]: Session 426 logged out. Waiting for processes to exit. Nov 18 19:29:46 oleg228-client systemd-logind[1015]: Removed session 426. Nov 18 19:29:47 oleg228-client sshd[82858]: Accepted publickey for root from 192.168.202.28 port 48214 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:29:47 oleg228-client systemd-logind[1015]: New session 427 of user root. Nov 18 19:29:47 oleg228-client systemd[1]: Started Session 427 of user root. Nov 18 19:29:47 oleg228-client sshd[82858]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:29:48 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 111: mdd setup fail should not cause umount oops ========================================================== 19:29:46 (1763512186) Nov 18 19:29:48 oleg228-client sshd[82871]: Received disconnect from 192.168.202.28 port 48214:11: disconnected by user Nov 18 19:29:48 oleg228-client sshd[82871]: Disconnected from user root 192.168.202.28 port 48214 Nov 18 19:29:48 oleg228-client sshd[82858]: pam_unix(sshd:session): session closed for user root Nov 18 19:29:48 oleg228-client systemd[1]: session-427.scope: Succeeded. Nov 18 19:29:48 oleg228-client systemd-logind[1015]: Session 427 logged out. Waiting for processes to exit. Nov 18 19:29:48 oleg228-client systemd-logind[1015]: Removed session 427. Nov 18 19:30:10 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:30:10 oleg228-client kernel: LustreError: Skipped 1 previous similar message Nov 18 19:30:18 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc80e4000: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:30:18 oleg228-client kernel: Lustre: Skipped 11 previous similar messages Nov 18 19:30:20 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25f3a0ec to 0x2622672b25f3a7ec Nov 18 19:30:20 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 19:30:21 oleg228-client sshd[83324]: Accepted publickey for root from 192.168.202.28 port 47358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:21 oleg228-client systemd[1]: Started Session 428 of user root. Nov 18 19:30:21 oleg228-client systemd-logind[1015]: New session 428 of user root. Nov 18 19:30:21 oleg228-client sshd[83324]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:21 oleg228-client sshd[83338]: Received disconnect from 192.168.202.28 port 47358:11: disconnected by user Nov 18 19:30:21 oleg228-client sshd[83338]: Disconnected from user root 192.168.202.28 port 47358 Nov 18 19:30:21 oleg228-client sshd[83324]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:21 oleg228-client systemd[1]: session-428.scope: Succeeded. Nov 18 19:30:21 oleg228-client systemd-logind[1015]: Session 428 logged out. Waiting for processes to exit. Nov 18 19:30:21 oleg228-client systemd-logind[1015]: Removed session 428. Nov 18 19:30:22 oleg228-client sshd[83468]: Accepted publickey for root from 192.168.202.28 port 47370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:22 oleg228-client systemd-logind[1015]: New session 429 of user root. Nov 18 19:30:22 oleg228-client systemd[1]: Started Session 429 of user root. Nov 18 19:30:22 oleg228-client sshd[83468]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:23 oleg228-client sshd[83481]: Received disconnect from 192.168.202.28 port 47370:11: disconnected by user Nov 18 19:30:23 oleg228-client sshd[83481]: Disconnected from user root 192.168.202.28 port 47370 Nov 18 19:30:23 oleg228-client sshd[83468]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:23 oleg228-client systemd[1]: session-429.scope: Succeeded. Nov 18 19:30:23 oleg228-client systemd-logind[1015]: Session 429 logged out. Waiting for processes to exit. Nov 18 19:30:23 oleg228-client systemd-logind[1015]: Removed session 429. Nov 18 19:30:24 oleg228-client sshd[83614]: Accepted publickey for root from 192.168.202.28 port 47386 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:24 oleg228-client systemd[1]: Started Session 430 of user root. Nov 18 19:30:24 oleg228-client systemd-logind[1015]: New session 430 of user root. Nov 18 19:30:24 oleg228-client sshd[83614]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:24 oleg228-client sshd[83628]: Received disconnect from 192.168.202.28 port 47386:11: disconnected by user Nov 18 19:30:24 oleg228-client sshd[83628]: Disconnected from user root 192.168.202.28 port 47386 Nov 18 19:30:25 oleg228-client sshd[83614]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:25 oleg228-client systemd[1]: session-430.scope: Succeeded. Nov 18 19:30:25 oleg228-client systemd-logind[1015]: Session 430 logged out. Waiting for processes to exit. Nov 18 19:30:25 oleg228-client systemd-logind[1015]: Removed session 430. Nov 18 19:30:26 oleg228-client sshd[83770]: Accepted publickey for root from 192.168.202.28 port 47398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:27 oleg228-client systemd[1]: Started Session 431 of user root. Nov 18 19:30:27 oleg228-client systemd-logind[1015]: New session 431 of user root. Nov 18 19:30:27 oleg228-client sshd[83770]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:27 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 112a: bulk resend while orignal request is in progress ========================================================== 19:30:25 (1763512225) Nov 18 19:30:27 oleg228-client sshd[83783]: Received disconnect from 192.168.202.28 port 47398:11: disconnected by user Nov 18 19:30:27 oleg228-client sshd[83783]: Disconnected from user root 192.168.202.28 port 47398 Nov 18 19:30:27 oleg228-client sshd[83770]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:27 oleg228-client systemd[1]: session-431.scope: Succeeded. Nov 18 19:30:27 oleg228-client systemd-logind[1015]: Session 431 logged out. Waiting for processes to exit. Nov 18 19:30:27 oleg228-client systemd-logind[1015]: Removed session 431. Nov 18 19:30:51 oleg228-client sshd[83978]: Accepted publickey for root from 192.168.202.28 port 50368 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:51 oleg228-client systemd[1]: Started Session 432 of user root. Nov 18 19:30:51 oleg228-client systemd-logind[1015]: New session 432 of user root. Nov 18 19:30:51 oleg228-client sshd[83978]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:51 oleg228-client sshd[83991]: Received disconnect from 192.168.202.28 port 50368:11: disconnected by user Nov 18 19:30:51 oleg228-client sshd[83991]: Disconnected from user root 192.168.202.28 port 50368 Nov 18 19:30:51 oleg228-client sshd[83978]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:52 oleg228-client systemd[1]: session-432.scope: Succeeded. Nov 18 19:30:52 oleg228-client systemd-logind[1015]: Session 432 logged out. Waiting for processes to exit. Nov 18 19:30:52 oleg228-client systemd-logind[1015]: Removed session 432. Nov 18 19:30:52 oleg228-client sshd[84117]: Accepted publickey for root from 192.168.202.28 port 50380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:52 oleg228-client systemd-logind[1015]: New session 433 of user root. Nov 18 19:30:52 oleg228-client systemd[1]: Started Session 433 of user root. Nov 18 19:30:52 oleg228-client sshd[84117]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:53 oleg228-client sshd[84130]: Received disconnect from 192.168.202.28 port 50380:11: disconnected by user Nov 18 19:30:53 oleg228-client sshd[84130]: Disconnected from user root 192.168.202.28 port 50380 Nov 18 19:30:53 oleg228-client sshd[84117]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:53 oleg228-client systemd[1]: session-433.scope: Succeeded. Nov 18 19:30:53 oleg228-client systemd-logind[1015]: Session 433 logged out. Waiting for processes to exit. Nov 18 19:30:53 oleg228-client systemd-logind[1015]: Removed session 433. Nov 18 19:30:54 oleg228-client sshd[84263]: Accepted publickey for root from 192.168.202.28 port 50392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:54 oleg228-client systemd-logind[1015]: New session 434 of user root. Nov 18 19:30:54 oleg228-client systemd[1]: Started Session 434 of user root. Nov 18 19:30:54 oleg228-client sshd[84263]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:54 oleg228-client sshd[84276]: Received disconnect from 192.168.202.28 port 50392:11: disconnected by user Nov 18 19:30:54 oleg228-client sshd[84276]: Disconnected from user root 192.168.202.28 port 50392 Nov 18 19:30:54 oleg228-client sshd[84263]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:55 oleg228-client systemd[1]: session-434.scope: Succeeded. Nov 18 19:30:55 oleg228-client systemd-logind[1015]: Session 434 logged out. Waiting for processes to exit. Nov 18 19:30:55 oleg228-client systemd-logind[1015]: Removed session 434. Nov 18 19:30:56 oleg228-client sshd[84418]: Accepted publickey for root from 192.168.202.28 port 50398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:30:56 oleg228-client systemd[1]: Started Session 435 of user root. Nov 18 19:30:56 oleg228-client systemd-logind[1015]: New session 435 of user root. Nov 18 19:30:56 oleg228-client sshd[84418]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:30:56 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115a: read: late REQ MDunlink and no bulk ========================================================== 19:30:55 (1763512255) Nov 18 19:30:56 oleg228-client sshd[84431]: Received disconnect from 192.168.202.28 port 50398:11: disconnected by user Nov 18 19:30:56 oleg228-client sshd[84431]: Disconnected from user root 192.168.202.28 port 50398 Nov 18 19:30:56 oleg228-client sshd[84418]: pam_unix(sshd:session): session closed for user root Nov 18 19:30:56 oleg228-client systemd[1]: session-435.scope: Succeeded. Nov 18 19:30:56 oleg228-client systemd-logind[1015]: Session 435 logged out. Waiting for processes to exit. Nov 18 19:30:56 oleg228-client systemd-logind[1015]: Removed session 435. Nov 18 19:30:57 oleg228-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** Nov 18 19:31:02 oleg228-client sshd[84634]: Accepted publickey for root from 192.168.202.28 port 58418 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:02 oleg228-client systemd-logind[1015]: New session 436 of user root. Nov 18 19:31:02 oleg228-client systemd[1]: Started Session 436 of user root. Nov 18 19:31:02 oleg228-client sshd[84634]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:02 oleg228-client sshd[84647]: Received disconnect from 192.168.202.28 port 58418:11: disconnected by user Nov 18 19:31:02 oleg228-client sshd[84647]: Disconnected from user root 192.168.202.28 port 58418 Nov 18 19:31:02 oleg228-client sshd[84634]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:02 oleg228-client systemd-logind[1015]: Session 436 logged out. Waiting for processes to exit. Nov 18 19:31:02 oleg228-client systemd[1]: session-436.scope: Succeeded. Nov 18 19:31:02 oleg228-client systemd-logind[1015]: Removed session 436. Nov 18 19:31:03 oleg228-client sshd[84775]: Accepted publickey for root from 192.168.202.28 port 58428 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:03 oleg228-client systemd-logind[1015]: New session 437 of user root. Nov 18 19:31:03 oleg228-client systemd[1]: Started Session 437 of user root. Nov 18 19:31:03 oleg228-client sshd[84775]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:04 oleg228-client sshd[84788]: Received disconnect from 192.168.202.28 port 58428:11: disconnected by user Nov 18 19:31:04 oleg228-client sshd[84788]: Disconnected from user root 192.168.202.28 port 58428 Nov 18 19:31:04 oleg228-client sshd[84775]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:04 oleg228-client systemd-logind[1015]: Session 437 logged out. Waiting for processes to exit. Nov 18 19:31:04 oleg228-client systemd[1]: session-437.scope: Succeeded. Nov 18 19:31:04 oleg228-client systemd-logind[1015]: Removed session 437. Nov 18 19:31:05 oleg228-client sshd[84921]: Accepted publickey for root from 192.168.202.28 port 58430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:05 oleg228-client systemd-logind[1015]: New session 438 of user root. Nov 18 19:31:05 oleg228-client systemd[1]: Started Session 438 of user root. Nov 18 19:31:05 oleg228-client sshd[84921]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:06 oleg228-client sshd[84934]: Received disconnect from 192.168.202.28 port 58430:11: disconnected by user Nov 18 19:31:06 oleg228-client sshd[84934]: Disconnected from user root 192.168.202.28 port 58430 Nov 18 19:31:06 oleg228-client sshd[84921]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:06 oleg228-client systemd[1]: session-438.scope: Succeeded. Nov 18 19:31:06 oleg228-client systemd-logind[1015]: Session 438 logged out. Waiting for processes to exit. Nov 18 19:31:06 oleg228-client systemd-logind[1015]: Removed session 438. Nov 18 19:31:07 oleg228-client sshd[85076]: Accepted publickey for root from 192.168.202.28 port 58440 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:07 oleg228-client systemd[1]: Started Session 439 of user root. Nov 18 19:31:07 oleg228-client systemd-logind[1015]: New session 439 of user root. Nov 18 19:31:07 oleg228-client sshd[85076]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:08 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115b: write: late REQ MDunlink and no bulk ========================================================== 19:31:06 (1763512266) Nov 18 19:31:08 oleg228-client sshd[85089]: Received disconnect from 192.168.202.28 port 58440:11: disconnected by user Nov 18 19:31:08 oleg228-client sshd[85089]: Disconnected from user root 192.168.202.28 port 58440 Nov 18 19:31:08 oleg228-client sshd[85076]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:08 oleg228-client systemd[1]: session-439.scope: Succeeded. Nov 18 19:31:08 oleg228-client systemd-logind[1015]: Session 439 logged out. Waiting for processes to exit. Nov 18 19:31:08 oleg228-client systemd-logind[1015]: Removed session 439. Nov 18 19:31:08 oleg228-client kernel: Lustre: *** cfs_fail_loc=51b, val=4*** Nov 18 19:31:14 oleg228-client sshd[85288]: Accepted publickey for root from 192.168.202.28 port 56246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:14 oleg228-client systemd[1]: Started Session 440 of user root. Nov 18 19:31:14 oleg228-client systemd-logind[1015]: New session 440 of user root. Nov 18 19:31:14 oleg228-client sshd[85288]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:14 oleg228-client sshd[85301]: Received disconnect from 192.168.202.28 port 56246:11: disconnected by user Nov 18 19:31:14 oleg228-client sshd[85301]: Disconnected from user root 192.168.202.28 port 56246 Nov 18 19:31:14 oleg228-client sshd[85288]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:14 oleg228-client systemd-logind[1015]: Session 440 logged out. Waiting for processes to exit. Nov 18 19:31:14 oleg228-client systemd[1]: session-440.scope: Succeeded. Nov 18 19:31:14 oleg228-client systemd-logind[1015]: Removed session 440. Nov 18 19:31:15 oleg228-client sshd[85427]: Accepted publickey for root from 192.168.202.28 port 56248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:15 oleg228-client systemd-logind[1015]: New session 441 of user root. Nov 18 19:31:15 oleg228-client systemd[1]: Started Session 441 of user root. Nov 18 19:31:15 oleg228-client sshd[85427]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:16 oleg228-client sshd[85440]: Received disconnect from 192.168.202.28 port 56248:11: disconnected by user Nov 18 19:31:16 oleg228-client sshd[85440]: Disconnected from user root 192.168.202.28 port 56248 Nov 18 19:31:16 oleg228-client sshd[85427]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:16 oleg228-client systemd-logind[1015]: Session 441 logged out. Waiting for processes to exit. Nov 18 19:31:16 oleg228-client systemd[1]: session-441.scope: Succeeded. Nov 18 19:31:16 oleg228-client systemd-logind[1015]: Removed session 441. Nov 18 19:31:17 oleg228-client sshd[85574]: Accepted publickey for root from 192.168.202.28 port 56254 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:18 oleg228-client systemd-logind[1015]: New session 442 of user root. Nov 18 19:31:18 oleg228-client systemd[1]: Started Session 442 of user root. Nov 18 19:31:18 oleg228-client sshd[85574]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:18 oleg228-client sshd[85587]: Received disconnect from 192.168.202.28 port 56254:11: disconnected by user Nov 18 19:31:18 oleg228-client sshd[85587]: Disconnected from user root 192.168.202.28 port 56254 Nov 18 19:31:18 oleg228-client sshd[85574]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:18 oleg228-client systemd-logind[1015]: Session 442 logged out. Waiting for processes to exit. Nov 18 19:31:18 oleg228-client systemd[1]: session-442.scope: Succeeded. Nov 18 19:31:18 oleg228-client systemd-logind[1015]: Removed session 442. Nov 18 19:31:20 oleg228-client sshd[85729]: Accepted publickey for root from 192.168.202.28 port 56260 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:20 oleg228-client systemd[1]: Started Session 443 of user root. Nov 18 19:31:20 oleg228-client systemd-logind[1015]: New session 443 of user root. Nov 18 19:31:20 oleg228-client sshd[85729]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:20 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115c: read: late Reply MDunlink and no bulk ========================================================== 19:31:18 (1763512278) Nov 18 19:31:20 oleg228-client sshd[85742]: Received disconnect from 192.168.202.28 port 56260:11: disconnected by user Nov 18 19:31:20 oleg228-client sshd[85742]: Disconnected from user root 192.168.202.28 port 56260 Nov 18 19:31:20 oleg228-client sshd[85729]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:20 oleg228-client systemd-logind[1015]: Session 443 logged out. Waiting for processes to exit. Nov 18 19:31:20 oleg228-client systemd[1]: session-443.scope: Succeeded. Nov 18 19:31:20 oleg228-client systemd-logind[1015]: Removed session 443. Nov 18 19:31:21 oleg228-client kernel: Lustre: *** cfs_fail_loc=50f, val=3*** Nov 18 19:31:25 oleg228-client sshd[85946]: Accepted publickey for root from 192.168.202.28 port 48022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:25 oleg228-client systemd[1]: Started Session 444 of user root. Nov 18 19:31:25 oleg228-client systemd-logind[1015]: New session 444 of user root. Nov 18 19:31:25 oleg228-client sshd[85946]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:26 oleg228-client sshd[85959]: Received disconnect from 192.168.202.28 port 48022:11: disconnected by user Nov 18 19:31:26 oleg228-client sshd[85959]: Disconnected from user root 192.168.202.28 port 48022 Nov 18 19:31:26 oleg228-client sshd[85946]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:26 oleg228-client systemd[1]: session-444.scope: Succeeded. Nov 18 19:31:26 oleg228-client systemd-logind[1015]: Session 444 logged out. Waiting for processes to exit. Nov 18 19:31:26 oleg228-client systemd-logind[1015]: Removed session 444. Nov 18 19:31:27 oleg228-client sshd[86085]: Accepted publickey for root from 192.168.202.28 port 48028 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:27 oleg228-client systemd[1]: Started Session 445 of user root. Nov 18 19:31:27 oleg228-client systemd-logind[1015]: New session 445 of user root. Nov 18 19:31:27 oleg228-client sshd[86085]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:27 oleg228-client sshd[86099]: Received disconnect from 192.168.202.28 port 48028:11: disconnected by user Nov 18 19:31:27 oleg228-client sshd[86099]: Disconnected from user root 192.168.202.28 port 48028 Nov 18 19:31:27 oleg228-client sshd[86085]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:27 oleg228-client systemd[1]: session-445.scope: Succeeded. Nov 18 19:31:27 oleg228-client systemd-logind[1015]: Session 445 logged out. Waiting for processes to exit. Nov 18 19:31:27 oleg228-client systemd-logind[1015]: Removed session 445. Nov 18 19:31:28 oleg228-client sshd[86232]: Accepted publickey for root from 192.168.202.28 port 48042 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:29 oleg228-client systemd-logind[1015]: New session 446 of user root. Nov 18 19:31:29 oleg228-client systemd[1]: Started Session 446 of user root. Nov 18 19:31:29 oleg228-client sshd[86232]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:29 oleg228-client sshd[86245]: Received disconnect from 192.168.202.28 port 48042:11: disconnected by user Nov 18 19:31:29 oleg228-client sshd[86245]: Disconnected from user root 192.168.202.28 port 48042 Nov 18 19:31:29 oleg228-client sshd[86232]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:29 oleg228-client systemd[1]: session-446.scope: Succeeded. Nov 18 19:31:29 oleg228-client systemd-logind[1015]: Session 446 logged out. Waiting for processes to exit. Nov 18 19:31:29 oleg228-client systemd-logind[1015]: Removed session 446. Nov 18 19:31:31 oleg228-client sshd[86387]: Accepted publickey for root from 192.168.202.28 port 56636 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:31 oleg228-client systemd[1]: Started Session 447 of user root. Nov 18 19:31:31 oleg228-client systemd-logind[1015]: New session 447 of user root. Nov 18 19:31:31 oleg228-client sshd[86387]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:31 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115d: write: late Reply MDunlink and no bulk ========================================================== 19:31:29 (1763512289) Nov 18 19:31:31 oleg228-client sshd[86400]: Received disconnect from 192.168.202.28 port 56636:11: disconnected by user Nov 18 19:31:31 oleg228-client sshd[86400]: Disconnected from user root 192.168.202.28 port 56636 Nov 18 19:31:31 oleg228-client sshd[86387]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:31 oleg228-client systemd[1]: session-447.scope: Succeeded. Nov 18 19:31:31 oleg228-client systemd-logind[1015]: Session 447 logged out. Waiting for processes to exit. Nov 18 19:31:31 oleg228-client systemd-logind[1015]: Removed session 447. Nov 18 19:31:31 oleg228-client kernel: Lustre: *** cfs_fail_loc=50f, val=4*** Nov 18 19:31:35 oleg228-client sshd[86599]: Accepted publickey for root from 192.168.202.28 port 56650 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:35 oleg228-client systemd-logind[1015]: New session 448 of user root. Nov 18 19:31:35 oleg228-client systemd[1]: Started Session 448 of user root. Nov 18 19:31:35 oleg228-client sshd[86599]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:35 oleg228-client sshd[86612]: Received disconnect from 192.168.202.28 port 56650:11: disconnected by user Nov 18 19:31:35 oleg228-client sshd[86612]: Disconnected from user root 192.168.202.28 port 56650 Nov 18 19:31:35 oleg228-client sshd[86599]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:35 oleg228-client systemd[1]: session-448.scope: Succeeded. Nov 18 19:31:35 oleg228-client systemd-logind[1015]: Session 448 logged out. Waiting for processes to exit. Nov 18 19:31:35 oleg228-client systemd-logind[1015]: Removed session 448. Nov 18 19:31:36 oleg228-client sshd[86738]: Accepted publickey for root from 192.168.202.28 port 56666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:36 oleg228-client systemd[1]: Started Session 449 of user root. Nov 18 19:31:36 oleg228-client systemd-logind[1015]: New session 449 of user root. Nov 18 19:31:36 oleg228-client sshd[86738]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:37 oleg228-client sshd[86751]: Received disconnect from 192.168.202.28 port 56666:11: disconnected by user Nov 18 19:31:37 oleg228-client sshd[86751]: Disconnected from user root 192.168.202.28 port 56666 Nov 18 19:31:37 oleg228-client sshd[86738]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:37 oleg228-client systemd[1]: session-449.scope: Succeeded. Nov 18 19:31:37 oleg228-client systemd-logind[1015]: Session 449 logged out. Waiting for processes to exit. Nov 18 19:31:37 oleg228-client systemd-logind[1015]: Removed session 449. Nov 18 19:31:38 oleg228-client sshd[86885]: Accepted publickey for root from 192.168.202.28 port 56672 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:38 oleg228-client systemd[1]: Started Session 450 of user root. Nov 18 19:31:38 oleg228-client systemd-logind[1015]: New session 450 of user root. Nov 18 19:31:38 oleg228-client sshd[86885]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:38 oleg228-client sshd[86898]: Received disconnect from 192.168.202.28 port 56672:11: disconnected by user Nov 18 19:31:38 oleg228-client sshd[86898]: Disconnected from user root 192.168.202.28 port 56672 Nov 18 19:31:38 oleg228-client sshd[86885]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:38 oleg228-client systemd[1]: session-450.scope: Succeeded. Nov 18 19:31:38 oleg228-client systemd-logind[1015]: Session 450 logged out. Waiting for processes to exit. Nov 18 19:31:39 oleg228-client systemd-logind[1015]: Removed session 450. Nov 18 19:31:40 oleg228-client sshd[87040]: Accepted publickey for root from 192.168.202.28 port 56680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:40 oleg228-client systemd-logind[1015]: New session 451 of user root. Nov 18 19:31:40 oleg228-client systemd[1]: Started Session 451 of user root. Nov 18 19:31:40 oleg228-client sshd[87040]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:40 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115e: read: late Bulk MDunlink and no reply ========================================================== 19:31:39 (1763512299) Nov 18 19:31:40 oleg228-client sshd[87053]: Received disconnect from 192.168.202.28 port 56680:11: disconnected by user Nov 18 19:31:41 oleg228-client sshd[87053]: Disconnected from user root 192.168.202.28 port 56680 Nov 18 19:31:41 oleg228-client sshd[87040]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:41 oleg228-client systemd[1]: session-451.scope: Succeeded. Nov 18 19:31:41 oleg228-client systemd-logind[1015]: Session 451 logged out. Waiting for processes to exit. Nov 18 19:31:41 oleg228-client systemd-logind[1015]: Removed session 451. Nov 18 19:31:41 oleg228-client kernel: Lustre: *** cfs_fail_loc=510, val=3*** Nov 18 19:31:44 oleg228-client sshd[87256]: Accepted publickey for root from 192.168.202.28 port 39664 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:44 oleg228-client systemd[1]: Started Session 452 of user root. Nov 18 19:31:44 oleg228-client systemd-logind[1015]: New session 452 of user root. Nov 18 19:31:44 oleg228-client sshd[87256]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:45 oleg228-client sshd[87269]: Received disconnect from 192.168.202.28 port 39664:11: disconnected by user Nov 18 19:31:45 oleg228-client sshd[87269]: Disconnected from user root 192.168.202.28 port 39664 Nov 18 19:31:45 oleg228-client sshd[87256]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:45 oleg228-client systemd-logind[1015]: Session 452 logged out. Waiting for processes to exit. Nov 18 19:31:45 oleg228-client systemd[1]: session-452.scope: Succeeded. Nov 18 19:31:45 oleg228-client systemd-logind[1015]: Removed session 452. Nov 18 19:31:46 oleg228-client sshd[87395]: Accepted publickey for root from 192.168.202.28 port 39670 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:46 oleg228-client systemd-logind[1015]: New session 453 of user root. Nov 18 19:31:46 oleg228-client systemd[1]: Started Session 453 of user root. Nov 18 19:31:46 oleg228-client sshd[87395]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:46 oleg228-client sshd[87408]: Received disconnect from 192.168.202.28 port 39670:11: disconnected by user Nov 18 19:31:46 oleg228-client sshd[87408]: Disconnected from user root 192.168.202.28 port 39670 Nov 18 19:31:46 oleg228-client sshd[87395]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:46 oleg228-client systemd-logind[1015]: Session 453 logged out. Waiting for processes to exit. Nov 18 19:31:46 oleg228-client systemd[1]: session-453.scope: Succeeded. Nov 18 19:31:46 oleg228-client systemd-logind[1015]: Removed session 453. Nov 18 19:31:47 oleg228-client sshd[87541]: Accepted publickey for root from 192.168.202.28 port 39686 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:47 oleg228-client systemd-logind[1015]: New session 454 of user root. Nov 18 19:31:47 oleg228-client systemd[1]: Started Session 454 of user root. Nov 18 19:31:47 oleg228-client sshd[87541]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:48 oleg228-client sshd[87555]: Received disconnect from 192.168.202.28 port 39686:11: disconnected by user Nov 18 19:31:48 oleg228-client sshd[87555]: Disconnected from user root 192.168.202.28 port 39686 Nov 18 19:31:48 oleg228-client sshd[87541]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:48 oleg228-client systemd[1]: session-454.scope: Succeeded. Nov 18 19:31:48 oleg228-client systemd-logind[1015]: Session 454 logged out. Waiting for processes to exit. Nov 18 19:31:48 oleg228-client systemd-logind[1015]: Removed session 454. Nov 18 19:31:49 oleg228-client sshd[87697]: Accepted publickey for root from 192.168.202.28 port 39698 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:49 oleg228-client systemd[1]: Started Session 455 of user root. Nov 18 19:31:49 oleg228-client systemd-logind[1015]: New session 455 of user root. Nov 18 19:31:49 oleg228-client sshd[87697]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:50 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115f: read: late REQ MDunlink and no reply ========================================================== 19:31:48 (1763512308) Nov 18 19:31:50 oleg228-client sshd[87710]: Received disconnect from 192.168.202.28 port 39698:11: disconnected by user Nov 18 19:31:50 oleg228-client sshd[87710]: Disconnected from user root 192.168.202.28 port 39698 Nov 18 19:31:50 oleg228-client sshd[87697]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:50 oleg228-client systemd-logind[1015]: Session 455 logged out. Waiting for processes to exit. Nov 18 19:31:50 oleg228-client systemd[1]: session-455.scope: Succeeded. Nov 18 19:31:50 oleg228-client systemd-logind[1015]: Removed session 455. Nov 18 19:31:50 oleg228-client kernel: Lustre: *** cfs_fail_loc=51b, val=3*** Nov 18 19:31:55 oleg228-client sshd[87913]: Accepted publickey for root from 192.168.202.28 port 38398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:55 oleg228-client systemd-logind[1015]: New session 456 of user root. Nov 18 19:31:55 oleg228-client systemd[1]: Started Session 456 of user root. Nov 18 19:31:55 oleg228-client sshd[87913]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:56 oleg228-client sshd[87926]: Received disconnect from 192.168.202.28 port 38398:11: disconnected by user Nov 18 19:31:56 oleg228-client sshd[87926]: Disconnected from user root 192.168.202.28 port 38398 Nov 18 19:31:56 oleg228-client sshd[87913]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:56 oleg228-client systemd[1]: session-456.scope: Succeeded. Nov 18 19:31:56 oleg228-client systemd-logind[1015]: Session 456 logged out. Waiting for processes to exit. Nov 18 19:31:56 oleg228-client systemd-logind[1015]: Removed session 456. Nov 18 19:31:57 oleg228-client sshd[88052]: Accepted publickey for root from 192.168.202.28 port 38406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:57 oleg228-client systemd[1]: Started Session 457 of user root. Nov 18 19:31:57 oleg228-client systemd-logind[1015]: New session 457 of user root. Nov 18 19:31:57 oleg228-client sshd[88052]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:57 oleg228-client sshd[88065]: Received disconnect from 192.168.202.28 port 38406:11: disconnected by user Nov 18 19:31:57 oleg228-client sshd[88065]: Disconnected from user root 192.168.202.28 port 38406 Nov 18 19:31:57 oleg228-client sshd[88052]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:57 oleg228-client systemd[1]: session-457.scope: Succeeded. Nov 18 19:31:57 oleg228-client systemd-logind[1015]: Session 457 logged out. Waiting for processes to exit. Nov 18 19:31:57 oleg228-client systemd-logind[1015]: Removed session 457. Nov 18 19:31:58 oleg228-client sshd[88199]: Accepted publickey for root from 192.168.202.28 port 38422 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:31:59 oleg228-client systemd-logind[1015]: New session 458 of user root. Nov 18 19:31:59 oleg228-client systemd[1]: Started Session 458 of user root. Nov 18 19:31:59 oleg228-client sshd[88199]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:31:59 oleg228-client sshd[88212]: Received disconnect from 192.168.202.28 port 38422:11: disconnected by user Nov 18 19:31:59 oleg228-client sshd[88212]: Disconnected from user root 192.168.202.28 port 38422 Nov 18 19:31:59 oleg228-client sshd[88199]: pam_unix(sshd:session): session closed for user root Nov 18 19:31:59 oleg228-client systemd[1]: session-458.scope: Succeeded. Nov 18 19:31:59 oleg228-client systemd-logind[1015]: Session 458 logged out. Waiting for processes to exit. Nov 18 19:31:59 oleg228-client systemd-logind[1015]: Removed session 458. Nov 18 19:32:00 oleg228-client sshd[88354]: Accepted publickey for root from 192.168.202.28 port 38428 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:32:00 oleg228-client systemd-logind[1015]: New session 459 of user root. Nov 18 19:32:00 oleg228-client systemd[1]: Started Session 459 of user root. Nov 18 19:32:00 oleg228-client sshd[88354]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:32:00 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 115g: read: late REQ MDunlink and Reply MDunlink ========================================================== 19:31:59 (1763512319) Nov 18 19:32:00 oleg228-client sshd[88367]: Received disconnect from 192.168.202.28 port 38428:11: disconnected by user Nov 18 19:32:00 oleg228-client sshd[88367]: Disconnected from user root 192.168.202.28 port 38428 Nov 18 19:32:00 oleg228-client sshd[88354]: pam_unix(sshd:session): session closed for user root Nov 18 19:32:01 oleg228-client systemd[1]: session-459.scope: Succeeded. Nov 18 19:32:01 oleg228-client systemd-logind[1015]: Session 459 logged out. Waiting for processes to exit. Nov 18 19:32:01 oleg228-client systemd-logind[1015]: Removed session 459. Nov 18 19:32:01 oleg228-client kernel: Lustre: *** cfs_fail_loc=51c, val=3*** Nov 18 19:33:01 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc80e4000: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 19:33:01 oleg228-client kernel: Lustre: Skipped 5 previous similar messages Nov 18 19:33:02 oleg228-client sshd[88578]: Accepted publickey for root from 192.168.202.28 port 39170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:33:02 oleg228-client systemd-logind[1015]: New session 460 of user root. Nov 18 19:33:02 oleg228-client systemd[1]: Started Session 460 of user root. Nov 18 19:33:02 oleg228-client sshd[88578]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:33:02 oleg228-client sshd[88591]: Received disconnect from 192.168.202.28 port 39170:11: disconnected by user Nov 18 19:33:03 oleg228-client sshd[88591]: Disconnected from user root 192.168.202.28 port 39170 Nov 18 19:33:03 oleg228-client sshd[88578]: pam_unix(sshd:session): session closed for user root Nov 18 19:33:03 oleg228-client systemd[1]: session-460.scope: Succeeded. Nov 18 19:33:03 oleg228-client systemd-logind[1015]: Session 460 logged out. Waiting for processes to exit. Nov 18 19:33:03 oleg228-client systemd-logind[1015]: Removed session 460. Nov 18 19:33:04 oleg228-client sshd[88718]: Accepted publickey for root from 192.168.202.28 port 39184 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:33:04 oleg228-client systemd-logind[1015]: New session 461 of user root. Nov 18 19:33:04 oleg228-client systemd[1]: Started Session 461 of user root. Nov 18 19:33:04 oleg228-client sshd[88718]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:33:05 oleg228-client sshd[88731]: Received disconnect from 192.168.202.28 port 39184:11: disconnected by user Nov 18 19:33:05 oleg228-client sshd[88731]: Disconnected from user root 192.168.202.28 port 39184 Nov 18 19:33:05 oleg228-client sshd[88718]: pam_unix(sshd:session): session closed for user root Nov 18 19:33:05 oleg228-client systemd[1]: session-461.scope: Succeeded. Nov 18 19:33:05 oleg228-client systemd-logind[1015]: Session 461 logged out. Waiting for processes to exit. Nov 18 19:33:05 oleg228-client systemd-logind[1015]: Removed session 461. Nov 18 19:33:06 oleg228-client sshd[88864]: Accepted publickey for root from 192.168.202.28 port 39194 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:33:06 oleg228-client systemd[1]: Started Session 462 of user root. Nov 18 19:33:06 oleg228-client systemd-logind[1015]: New session 462 of user root. Nov 18 19:33:06 oleg228-client sshd[88864]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:33:06 oleg228-client sshd[88877]: Received disconnect from 192.168.202.28 port 39194:11: disconnected by user Nov 18 19:33:06 oleg228-client sshd[88877]: Disconnected from user root 192.168.202.28 port 39194 Nov 18 19:33:06 oleg228-client sshd[88864]: pam_unix(sshd:session): session closed for user root Nov 18 19:33:06 oleg228-client systemd[1]: session-462.scope: Succeeded. Nov 18 19:33:06 oleg228-client systemd-logind[1015]: Session 462 logged out. Waiting for processes to exit. Nov 18 19:33:06 oleg228-client systemd-logind[1015]: Removed session 462. Nov 18 19:33:08 oleg228-client sshd[89019]: Accepted publickey for root from 192.168.202.28 port 39204 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:33:08 oleg228-client systemd[1]: Started Session 463 of user root. Nov 18 19:33:08 oleg228-client systemd-logind[1015]: New session 463 of user root. Nov 18 19:33:08 oleg228-client sshd[89019]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:33:08 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 120: flock race: completion vs. evict ========================================================== 19:33:07 (1763512387) Nov 18 19:33:08 oleg228-client sshd[89032]: Received disconnect from 192.168.202.28 port 39204:11: disconnected by user Nov 18 19:33:08 oleg228-client sshd[89032]: Disconnected from user root 192.168.202.28 port 39204 Nov 18 19:33:08 oleg228-client sshd[89019]: pam_unix(sshd:session): session closed for user root Nov 18 19:33:08 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:33:08 oleg228-client systemd[1]: session-463.scope: Succeeded. Nov 18 19:33:08 oleg228-client systemd-logind[1015]: Session 463 logged out. Waiting for processes to exit. Nov 18 19:33:08 oleg228-client systemd-logind[1015]: Removed session 463. Nov 18 19:33:08 oleg228-client kernel: LustreError: 89074:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Nov 18 19:33:11 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 19:33:11 oleg228-client kernel: LustreError: Skipped 3 previous similar messages Nov 18 19:33:11 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:11 oleg228-client kernel: LustreError: 89089:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc80e4000: inode [0x20000afe2:0x3:0x0] mdc close failed: rc = -108 Nov 18 19:33:11 oleg228-client kernel: LustreError: 89089:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9ccbc80e4000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9ccbc413da00) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:33:12 oleg228-client kernel: LustreError: 89074:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Nov 18 19:33:15 oleg228-client kernel: LustreError: 89104:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Nov 18 19:33:18 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:18 oleg228-client kernel: LustreError: 89119:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9ccbc80e4000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9ccbc413d700) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:33:18 oleg228-client kernel: LustreError: 89119:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 1 previous similar message Nov 18 19:33:18 oleg228-client kernel: LustreError: 89124:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:33:18 oleg228-client kernel: LustreError: 89124:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Nov 18 19:33:19 oleg228-client kernel: LustreError: 89104:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Nov 18 19:33:26 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:26 oleg228-client kernel: LustreError: 89160:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms Nov 18 19:33:29 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:29 oleg228-client kernel: LustreError: 89180:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:33:30 oleg228-client kernel: LustreError: 89160:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake Nov 18 19:33:30 oleg228-client kernel: LustreError: 89160:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc80e4000: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Nov 18 19:33:31 oleg228-client kernel: LustreError: 89197:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:33:31 oleg228-client kernel: LustreError: 89197:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 12 previous similar messages Nov 18 19:33:36 oleg228-client kernel: LustreError: 89235:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 sleeping for 4000ms Nov 18 19:33:39 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:39 oleg228-client kernel: LustreError: 89250:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9ccbc80e4000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9ccbcb83f300) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:33:39 oleg228-client kernel: LustreError: 89250:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 1 previous similar message Nov 18 19:33:40 oleg228-client kernel: LustreError: 89235:0:(ldlm_flock.c:807:ldlm_flock_completion_ast()) cfs_fail_timeout id 321 awake Nov 18 19:33:48 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:48 oleg228-client kernel: LustreError: 89291:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 sleeping for 4000ms Nov 18 19:33:51 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:51 oleg228-client kernel: LustreError: 89306:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-MDT0000-mdc-ffff9ccbc80e4000: namespace resource [0x20000afe2:0xc:0x0].0xc (ffff9ccbc413dc00) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:33:51 oleg228-client kernel: LustreError: 89306:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 1 previous similar message Nov 18 19:33:51 oleg228-client kernel: LustreError: 89311:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:33:51 oleg228-client kernel: LustreError: 89311:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 13 previous similar messages Nov 18 19:33:52 oleg228-client kernel: LustreError: 89291:0:(ldlm_flock.c:856:ldlm_flock_completion_ast()) cfs_fail_timeout id 322 awake Nov 18 19:33:55 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:33:56 oleg228-client kernel: LustreError: 89319:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc80e4000: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Nov 18 19:34:04 oleg228-client kernel: LustreError: 89391:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 sleeping for 4000ms Nov 18 19:34:04 oleg228-client kernel: LustreError: 89391:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message Nov 18 19:34:08 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc80e4000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:34:08 oleg228-client kernel: LustreError: 89413:0:(file.c:6099:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 Nov 18 19:34:08 oleg228-client kernel: LustreError: 89413:0:(file.c:6099:ll_inode_revalidate_fini()) Skipped 27 previous similar messages Nov 18 19:34:08 oleg228-client kernel: LustreError: 89391:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) cfs_fail_timeout id 320 awake Nov 18 19:34:08 oleg228-client kernel: LustreError: 89391:0:(ldlm_flock.c:802:ldlm_flock_completion_ast()) Skipped 1 previous similar message Nov 18 19:34:08 oleg228-client kernel: LustreError: 89391:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc80e4000: inode [0x20000afe2:0xc:0x0] mdc close failed: rc = -108 Nov 18 19:34:14 oleg228-client sshd[89551]: Accepted publickey for root from 192.168.202.28 port 55924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:34:14 oleg228-client systemd-logind[1015]: New session 464 of user root. Nov 18 19:34:14 oleg228-client systemd[1]: Started Session 464 of user root. Nov 18 19:34:14 oleg228-client sshd[89551]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:34:14 oleg228-client sshd[89564]: Received disconnect from 192.168.202.28 port 55924:11: disconnected by user Nov 18 19:34:15 oleg228-client sshd[89564]: Disconnected from user root 192.168.202.28 port 55924 Nov 18 19:34:15 oleg228-client sshd[89551]: pam_unix(sshd:session): session closed for user root Nov 18 19:34:15 oleg228-client systemd[1]: session-464.scope: Succeeded. Nov 18 19:34:15 oleg228-client systemd-logind[1015]: Session 464 logged out. Waiting for processes to exit. Nov 18 19:34:15 oleg228-client systemd-logind[1015]: Removed session 464. Nov 18 19:34:16 oleg228-client sshd[89691]: Accepted publickey for root from 192.168.202.28 port 55936 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:34:16 oleg228-client systemd-logind[1015]: New session 465 of user root. Nov 18 19:34:16 oleg228-client systemd[1]: Started Session 465 of user root. Nov 18 19:34:16 oleg228-client sshd[89691]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:34:16 oleg228-client sshd[89704]: Received disconnect from 192.168.202.28 port 55936:11: disconnected by user Nov 18 19:34:16 oleg228-client sshd[89704]: Disconnected from user root 192.168.202.28 port 55936 Nov 18 19:34:16 oleg228-client sshd[89691]: pam_unix(sshd:session): session closed for user root Nov 18 19:34:16 oleg228-client systemd[1]: session-465.scope: Succeeded. Nov 18 19:34:16 oleg228-client systemd-logind[1015]: Session 465 logged out. Waiting for processes to exit. Nov 18 19:34:16 oleg228-client systemd-logind[1015]: Removed session 465. Nov 18 19:34:17 oleg228-client sshd[89838]: Accepted publickey for root from 192.168.202.28 port 55944 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:34:17 oleg228-client systemd-logind[1015]: New session 466 of user root. Nov 18 19:34:17 oleg228-client systemd[1]: Started Session 466 of user root. Nov 18 19:34:17 oleg228-client sshd[89838]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:34:18 oleg228-client sshd[89851]: Received disconnect from 192.168.202.28 port 55944:11: disconnected by user Nov 18 19:34:18 oleg228-client sshd[89851]: Disconnected from user root 192.168.202.28 port 55944 Nov 18 19:34:18 oleg228-client sshd[89838]: pam_unix(sshd:session): session closed for user root Nov 18 19:34:18 oleg228-client systemd[1]: session-466.scope: Succeeded. Nov 18 19:34:18 oleg228-client systemd-logind[1015]: Session 466 logged out. Waiting for processes to exit. Nov 18 19:34:18 oleg228-client systemd-logind[1015]: Removed session 466. Nov 18 19:34:19 oleg228-client sshd[89993]: Accepted publickey for root from 192.168.202.28 port 55950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:34:19 oleg228-client systemd-logind[1015]: New session 467 of user root. Nov 18 19:34:19 oleg228-client systemd[1]: Started Session 467 of user root. Nov 18 19:34:19 oleg228-client sshd[89993]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:34:20 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 113: ldlm enqueue dropped reply should not cause deadlocks ========================================================== 19:34:18 (1763512458) Nov 18 19:34:20 oleg228-client sshd[90006]: Received disconnect from 192.168.202.28 port 55950:11: disconnected by user Nov 18 19:34:20 oleg228-client sshd[90006]: Disconnected from user root 192.168.202.28 port 55950 Nov 18 19:34:20 oleg228-client sshd[89993]: pam_unix(sshd:session): session closed for user root Nov 18 19:34:20 oleg228-client systemd[1]: session-467.scope: Succeeded. Nov 18 19:34:20 oleg228-client systemd-logind[1015]: Session 467 logged out. Waiting for processes to exit. Nov 18 19:34:20 oleg228-client systemd-logind[1015]: Removed session 467. Nov 18 19:34:51 oleg228-client kernel: Lustre: 90111:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763512461/real 1763512461] req@ffff9ccbd1405c00 x1849171069024896/t0(0) o101->lustre-MDT0000-mdc-ffff9ccbc80e4000@192.168.202.128@tcp:12/10 lens 576/1152 e 0 to 1 dl 1763512491 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'stat.0' uid:0 gid:0 projid:0 Nov 18 19:34:51 oleg228-client kernel: Lustre: 90111:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Nov 18 19:34:53 oleg228-client kernel: LustreError: 81489:0:(ldlm_lockd.c:2882:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f sleeping for 4000ms Nov 18 19:34:53 oleg228-client kernel: LustreError: 81489:0:(ldlm_lockd.c:2882:ldlm_bl_thread_blwi()) Skipped 1 previous similar message Nov 18 19:34:57 oleg228-client kernel: LustreError: 81489:0:(ldlm_lockd.c:2882:ldlm_bl_thread_blwi()) cfs_fail_timeout id 31f awake Nov 18 19:34:57 oleg228-client kernel: LustreError: 81489:0:(ldlm_lockd.c:2882:ldlm_bl_thread_blwi()) Skipped 1 previous similar message Nov 18 19:34:58 oleg228-client sshd[90257]: Accepted publickey for root from 192.168.202.28 port 52834 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:34:58 oleg228-client systemd-logind[1015]: New session 468 of user root. Nov 18 19:34:58 oleg228-client systemd[1]: Started Session 468 of user root. Nov 18 19:34:58 oleg228-client sshd[90257]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:34:59 oleg228-client sshd[90270]: Received disconnect from 192.168.202.28 port 52834:11: disconnected by user Nov 18 19:34:59 oleg228-client sshd[90270]: Disconnected from user root 192.168.202.28 port 52834 Nov 18 19:34:59 oleg228-client sshd[90257]: pam_unix(sshd:session): session closed for user root Nov 18 19:34:59 oleg228-client systemd-logind[1015]: Session 468 logged out. Waiting for processes to exit. Nov 18 19:34:59 oleg228-client systemd[1]: session-468.scope: Succeeded. Nov 18 19:34:59 oleg228-client systemd-logind[1015]: Removed session 468. Nov 18 19:35:00 oleg228-client sshd[90397]: Accepted publickey for root from 192.168.202.28 port 52848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:00 oleg228-client systemd-logind[1015]: New session 469 of user root. Nov 18 19:35:00 oleg228-client systemd[1]: Started Session 469 of user root. Nov 18 19:35:00 oleg228-client sshd[90397]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:00 oleg228-client sshd[90410]: Received disconnect from 192.168.202.28 port 52848:11: disconnected by user Nov 18 19:35:00 oleg228-client sshd[90410]: Disconnected from user root 192.168.202.28 port 52848 Nov 18 19:35:00 oleg228-client sshd[90397]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:00 oleg228-client systemd[1]: session-469.scope: Succeeded. Nov 18 19:35:00 oleg228-client systemd-logind[1015]: Session 469 logged out. Waiting for processes to exit. Nov 18 19:35:00 oleg228-client systemd-logind[1015]: Removed session 469. Nov 18 19:35:01 oleg228-client sshd[90543]: Accepted publickey for root from 192.168.202.28 port 60048 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:01 oleg228-client systemd-logind[1015]: New session 470 of user root. Nov 18 19:35:01 oleg228-client systemd[1]: Started Session 470 of user root. Nov 18 19:35:01 oleg228-client sshd[90543]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:02 oleg228-client sshd[90556]: Received disconnect from 192.168.202.28 port 60048:11: disconnected by user Nov 18 19:35:02 oleg228-client sshd[90556]: Disconnected from user root 192.168.202.28 port 60048 Nov 18 19:35:02 oleg228-client sshd[90543]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:02 oleg228-client systemd-logind[1015]: Session 470 logged out. Waiting for processes to exit. Nov 18 19:35:02 oleg228-client systemd[1]: session-470.scope: Succeeded. Nov 18 19:35:02 oleg228-client systemd-logind[1015]: Removed session 470. Nov 18 19:35:03 oleg228-client sshd[90698]: Accepted publickey for root from 192.168.202.28 port 60056 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:03 oleg228-client systemd-logind[1015]: New session 471 of user root. Nov 18 19:35:03 oleg228-client systemd[1]: Started Session 471 of user root. Nov 18 19:35:03 oleg228-client sshd[90698]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:03 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130a: enqueue resend on not existing file ========================================================== 19:35:02 (1763512502) Nov 18 19:35:03 oleg228-client sshd[90711]: Received disconnect from 192.168.202.28 port 60056:11: disconnected by user Nov 18 19:35:03 oleg228-client sshd[90711]: Disconnected from user root 192.168.202.28 port 60056 Nov 18 19:35:03 oleg228-client sshd[90698]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:03 oleg228-client systemd[1]: session-471.scope: Succeeded. Nov 18 19:35:03 oleg228-client systemd-logind[1015]: Session 471 logged out. Waiting for processes to exit. Nov 18 19:35:03 oleg228-client systemd-logind[1015]: Removed session 471. Nov 18 19:35:36 oleg228-client sshd[91004]: Accepted publickey for root from 192.168.202.28 port 39896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:36 oleg228-client systemd-logind[1015]: New session 472 of user root. Nov 18 19:35:36 oleg228-client systemd[1]: Started Session 472 of user root. Nov 18 19:35:36 oleg228-client sshd[91004]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:36 oleg228-client sshd[91017]: Received disconnect from 192.168.202.28 port 39896:11: disconnected by user Nov 18 19:35:36 oleg228-client sshd[91017]: Disconnected from user root 192.168.202.28 port 39896 Nov 18 19:35:36 oleg228-client sshd[91004]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:37 oleg228-client systemd[1]: session-472.scope: Succeeded. Nov 18 19:35:37 oleg228-client systemd-logind[1015]: Session 472 logged out. Waiting for processes to exit. Nov 18 19:35:37 oleg228-client systemd-logind[1015]: Removed session 472. Nov 18 19:35:38 oleg228-client sshd[91143]: Accepted publickey for root from 192.168.202.28 port 39906 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:38 oleg228-client systemd[1]: Started Session 473 of user root. Nov 18 19:35:38 oleg228-client systemd-logind[1015]: New session 473 of user root. Nov 18 19:35:38 oleg228-client sshd[91143]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:38 oleg228-client sshd[91156]: Received disconnect from 192.168.202.28 port 39906:11: disconnected by user Nov 18 19:35:38 oleg228-client sshd[91156]: Disconnected from user root 192.168.202.28 port 39906 Nov 18 19:35:38 oleg228-client sshd[91143]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:39 oleg228-client systemd[1]: session-473.scope: Succeeded. Nov 18 19:35:39 oleg228-client systemd-logind[1015]: Session 473 logged out. Waiting for processes to exit. Nov 18 19:35:39 oleg228-client systemd-logind[1015]: Removed session 473. Nov 18 19:35:39 oleg228-client sshd[91290]: Accepted publickey for root from 192.168.202.28 port 39922 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:40 oleg228-client systemd-logind[1015]: New session 474 of user root. Nov 18 19:35:40 oleg228-client systemd[1]: Started Session 474 of user root. Nov 18 19:35:40 oleg228-client sshd[91290]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:40 oleg228-client sshd[91303]: Received disconnect from 192.168.202.28 port 39922:11: disconnected by user Nov 18 19:35:40 oleg228-client sshd[91303]: Disconnected from user root 192.168.202.28 port 39922 Nov 18 19:35:40 oleg228-client sshd[91290]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:40 oleg228-client systemd[1]: session-474.scope: Succeeded. Nov 18 19:35:40 oleg228-client systemd-logind[1015]: Session 474 logged out. Waiting for processes to exit. Nov 18 19:35:40 oleg228-client systemd-logind[1015]: Removed session 474. Nov 18 19:35:41 oleg228-client sshd[91445]: Accepted publickey for root from 192.168.202.28 port 46122 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:35:41 oleg228-client systemd-logind[1015]: New session 475 of user root. Nov 18 19:35:41 oleg228-client systemd[1]: Started Session 475 of user root. Nov 18 19:35:41 oleg228-client sshd[91445]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:35:41 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130b: enqueue resend on a stale inode ========================================================== 19:35:40 (1763512540) Nov 18 19:35:41 oleg228-client sshd[91458]: Received disconnect from 192.168.202.28 port 46122:11: disconnected by user Nov 18 19:35:41 oleg228-client sshd[91458]: Disconnected from user root 192.168.202.28 port 46122 Nov 18 19:35:41 oleg228-client sshd[91445]: pam_unix(sshd:session): session closed for user root Nov 18 19:35:42 oleg228-client systemd-logind[1015]: Session 475 logged out. Waiting for processes to exit. Nov 18 19:35:42 oleg228-client systemd[1]: session-475.scope: Succeeded. Nov 18 19:35:42 oleg228-client systemd-logind[1015]: Removed session 475. Nov 18 19:36:14 oleg228-client sshd[91819]: Accepted publickey for root from 192.168.202.28 port 54226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:14 oleg228-client systemd-logind[1015]: New session 476 of user root. Nov 18 19:36:14 oleg228-client systemd[1]: Started Session 476 of user root. Nov 18 19:36:14 oleg228-client sshd[91819]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:15 oleg228-client sshd[91832]: Received disconnect from 192.168.202.28 port 54226:11: disconnected by user Nov 18 19:36:15 oleg228-client sshd[91832]: Disconnected from user root 192.168.202.28 port 54226 Nov 18 19:36:15 oleg228-client sshd[91819]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:15 oleg228-client systemd-logind[1015]: Session 476 logged out. Waiting for processes to exit. Nov 18 19:36:15 oleg228-client systemd[1]: session-476.scope: Succeeded. Nov 18 19:36:15 oleg228-client systemd-logind[1015]: Removed session 476. Nov 18 19:36:16 oleg228-client sshd[91959]: Accepted publickey for root from 192.168.202.28 port 54230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:17 oleg228-client systemd[1]: Started Session 477 of user root. Nov 18 19:36:17 oleg228-client systemd-logind[1015]: New session 477 of user root. Nov 18 19:36:17 oleg228-client sshd[91959]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:17 oleg228-client sshd[91972]: Received disconnect from 192.168.202.28 port 54230:11: disconnected by user Nov 18 19:36:17 oleg228-client sshd[91972]: Disconnected from user root 192.168.202.28 port 54230 Nov 18 19:36:17 oleg228-client sshd[91959]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:17 oleg228-client systemd-logind[1015]: Session 477 logged out. Waiting for processes to exit. Nov 18 19:36:18 oleg228-client systemd[1]: session-477.scope: Succeeded. Nov 18 19:36:18 oleg228-client systemd-logind[1015]: Removed session 477. Nov 18 19:36:19 oleg228-client sshd[92106]: Accepted publickey for root from 192.168.202.28 port 54246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:19 oleg228-client systemd-logind[1015]: New session 478 of user root. Nov 18 19:36:19 oleg228-client systemd[1]: Started Session 478 of user root. Nov 18 19:36:19 oleg228-client sshd[92106]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:19 oleg228-client sshd[92119]: Received disconnect from 192.168.202.28 port 54246:11: disconnected by user Nov 18 19:36:19 oleg228-client sshd[92119]: Disconnected from user root 192.168.202.28 port 54246 Nov 18 19:36:19 oleg228-client sshd[92106]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:19 oleg228-client systemd[1]: session-478.scope: Succeeded. Nov 18 19:36:19 oleg228-client systemd-logind[1015]: Session 478 logged out. Waiting for processes to exit. Nov 18 19:36:19 oleg228-client systemd-logind[1015]: Removed session 478. Nov 18 19:36:21 oleg228-client sshd[92261]: Accepted publickey for root from 192.168.202.28 port 56224 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:21 oleg228-client systemd[1]: Started Session 479 of user root. Nov 18 19:36:21 oleg228-client systemd-logind[1015]: New session 479 of user root. Nov 18 19:36:21 oleg228-client sshd[92261]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:21 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 130c: layout intent resend on a stale inode ========================================================== 19:36:19 (1763512579) Nov 18 19:36:21 oleg228-client sshd[92274]: Received disconnect from 192.168.202.28 port 56224:11: disconnected by user Nov 18 19:36:21 oleg228-client sshd[92274]: Disconnected from user root 192.168.202.28 port 56224 Nov 18 19:36:21 oleg228-client sshd[92261]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:21 oleg228-client systemd[1]: session-479.scope: Succeeded. Nov 18 19:36:21 oleg228-client systemd-logind[1015]: Session 479 logged out. Waiting for processes to exit. Nov 18 19:36:21 oleg228-client systemd-logind[1015]: Removed session 479. Nov 18 19:36:50 oleg228-client sshd[92595]: Accepted publickey for root from 192.168.202.28 port 34138 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:50 oleg228-client systemd[1]: Started Session 480 of user root. Nov 18 19:36:50 oleg228-client systemd-logind[1015]: New session 480 of user root. Nov 18 19:36:50 oleg228-client sshd[92595]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:51 oleg228-client sshd[92608]: Received disconnect from 192.168.202.28 port 34138:11: disconnected by user Nov 18 19:36:51 oleg228-client sshd[92608]: Disconnected from user root 192.168.202.28 port 34138 Nov 18 19:36:51 oleg228-client sshd[92595]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:51 oleg228-client systemd-logind[1015]: Session 480 logged out. Waiting for processes to exit. Nov 18 19:36:51 oleg228-client systemd[1]: session-480.scope: Succeeded. Nov 18 19:36:51 oleg228-client systemd-logind[1015]: Removed session 480. Nov 18 19:36:52 oleg228-client sshd[92734]: Accepted publickey for root from 192.168.202.28 port 32958 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:52 oleg228-client systemd[1]: Started Session 481 of user root. Nov 18 19:36:52 oleg228-client systemd-logind[1015]: New session 481 of user root. Nov 18 19:36:52 oleg228-client sshd[92734]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:52 oleg228-client sshd[92747]: Received disconnect from 192.168.202.28 port 32958:11: disconnected by user Nov 18 19:36:52 oleg228-client sshd[92747]: Disconnected from user root 192.168.202.28 port 32958 Nov 18 19:36:52 oleg228-client sshd[92734]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:52 oleg228-client systemd[1]: session-481.scope: Succeeded. Nov 18 19:36:52 oleg228-client systemd-logind[1015]: Session 481 logged out. Waiting for processes to exit. Nov 18 19:36:52 oleg228-client systemd-logind[1015]: Removed session 481. Nov 18 19:36:53 oleg228-client sshd[92880]: Accepted publickey for root from 192.168.202.28 port 32972 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:53 oleg228-client systemd-logind[1015]: New session 482 of user root. Nov 18 19:36:53 oleg228-client systemd[1]: Started Session 482 of user root. Nov 18 19:36:53 oleg228-client sshd[92880]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:54 oleg228-client sshd[92893]: Received disconnect from 192.168.202.28 port 32972:11: disconnected by user Nov 18 19:36:54 oleg228-client sshd[92893]: Disconnected from user root 192.168.202.28 port 32972 Nov 18 19:36:54 oleg228-client sshd[92880]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:54 oleg228-client systemd[1]: session-482.scope: Succeeded. Nov 18 19:36:54 oleg228-client systemd-logind[1015]: Session 482 logged out. Waiting for processes to exit. Nov 18 19:36:54 oleg228-client systemd-logind[1015]: Removed session 482. Nov 18 19:36:55 oleg228-client sshd[93035]: Accepted publickey for root from 192.168.202.28 port 32986 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:36:55 oleg228-client systemd-logind[1015]: New session 483 of user root. Nov 18 19:36:55 oleg228-client systemd[1]: Started Session 483 of user root. Nov 18 19:36:55 oleg228-client sshd[93035]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:36:56 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 132: long punch =================== 19:36:54 (1763512614) Nov 18 19:36:56 oleg228-client sshd[93048]: Received disconnect from 192.168.202.28 port 32986:11: disconnected by user Nov 18 19:36:56 oleg228-client sshd[93048]: Disconnected from user root 192.168.202.28 port 32986 Nov 18 19:36:56 oleg228-client sshd[93035]: pam_unix(sshd:session): session closed for user root Nov 18 19:36:56 oleg228-client systemd[1]: session-483.scope: Succeeded. Nov 18 19:36:56 oleg228-client systemd-logind[1015]: Session 483 logged out. Waiting for processes to exit. Nov 18 19:36:56 oleg228-client systemd-logind[1015]: Removed session 483. Nov 18 19:36:56 oleg228-client systemd-udevd[93105]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:36:56 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:38:59 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 19:38:59 oleg228-client kernel: LustreError: 93171:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc551f800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:38:59 oleg228-client kernel: LustreError: 93171:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:38:59 oleg228-client kernel: LustreError: 93171:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 19:38:59 oleg228-client kernel: LustreError: 93171:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages Nov 18 19:38:59 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:39:00 oleg228-client sshd[93268]: Accepted publickey for root from 192.168.202.28 port 33308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:00 oleg228-client systemd[1]: Started Session 484 of user root. Nov 18 19:39:00 oleg228-client systemd-logind[1015]: New session 484 of user root. Nov 18 19:39:00 oleg228-client sshd[93268]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:00 oleg228-client sshd[93281]: Received disconnect from 192.168.202.28 port 33308:11: disconnected by user Nov 18 19:39:00 oleg228-client sshd[93281]: Disconnected from user root 192.168.202.28 port 33308 Nov 18 19:39:00 oleg228-client sshd[93268]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:01 oleg228-client systemd-logind[1015]: Session 484 logged out. Waiting for processes to exit. Nov 18 19:39:01 oleg228-client systemd[1]: session-484.scope: Succeeded. Nov 18 19:39:01 oleg228-client systemd-logind[1015]: Removed session 484. Nov 18 19:39:02 oleg228-client sshd[93407]: Accepted publickey for root from 192.168.202.28 port 37880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:02 oleg228-client systemd-logind[1015]: New session 485 of user root. Nov 18 19:39:02 oleg228-client systemd[1]: Started Session 485 of user root. Nov 18 19:39:02 oleg228-client sshd[93407]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:03 oleg228-client sshd[93420]: Received disconnect from 192.168.202.28 port 37880:11: disconnected by user Nov 18 19:39:03 oleg228-client sshd[93420]: Disconnected from user root 192.168.202.28 port 37880 Nov 18 19:39:03 oleg228-client sshd[93407]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:03 oleg228-client systemd[1]: session-485.scope: Succeeded. Nov 18 19:39:03 oleg228-client systemd-logind[1015]: Session 485 logged out. Waiting for processes to exit. Nov 18 19:39:03 oleg228-client systemd-logind[1015]: Removed session 485. Nov 18 19:39:04 oleg228-client sshd[93553]: Accepted publickey for root from 192.168.202.28 port 37892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:04 oleg228-client systemd-logind[1015]: New session 486 of user root. Nov 18 19:39:04 oleg228-client systemd[1]: Started Session 486 of user root. Nov 18 19:39:04 oleg228-client sshd[93553]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:04 oleg228-client sshd[93567]: Received disconnect from 192.168.202.28 port 37892:11: disconnected by user Nov 18 19:39:04 oleg228-client sshd[93567]: Disconnected from user root 192.168.202.28 port 37892 Nov 18 19:39:04 oleg228-client sshd[93553]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:04 oleg228-client systemd[1]: session-486.scope: Succeeded. Nov 18 19:39:04 oleg228-client systemd-logind[1015]: Session 486 logged out. Waiting for processes to exit. Nov 18 19:39:04 oleg228-client systemd-logind[1015]: Removed session 486. Nov 18 19:39:05 oleg228-client sshd[93709]: Accepted publickey for root from 192.168.202.28 port 37898 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:06 oleg228-client systemd-logind[1015]: New session 487 of user root. Nov 18 19:39:06 oleg228-client systemd[1]: Started Session 487 of user root. Nov 18 19:39:06 oleg228-client sshd[93709]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 131: IO vs evict results to IO under staled lock ========================================================== 19:39:05 (1763512745) Nov 18 19:39:06 oleg228-client sshd[93722]: Received disconnect from 192.168.202.28 port 37898:11: disconnected by user Nov 18 19:39:06 oleg228-client sshd[93722]: Disconnected from user root 192.168.202.28 port 37898 Nov 18 19:39:06 oleg228-client sshd[93709]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:06 oleg228-client systemd[1]: session-487.scope: Succeeded. Nov 18 19:39:06 oleg228-client systemd-logind[1015]: Session 487 logged out. Waiting for processes to exit. Nov 18 19:39:06 oleg228-client systemd-logind[1015]: Removed session 487. Nov 18 19:39:06 oleg228-client kernel: LustreError: 93793:0:(osc_request.c:2944:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 4000ms Nov 18 19:39:09 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc80e4000: operation ost_statfs to node 192.168.202.128@tcp failed: rc = -107 Nov 18 19:39:09 oleg228-client kernel: LustreError: Skipped 8 previous similar messages Nov 18 19:39:09 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc80e4000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 19:39:09 oleg228-client kernel: LustreError: 93880:0:(ldlm_resource.c:981:ldlm_resource_complain()) lustre-OST0000-osc-ffff9ccbc80e4000: namespace resource [0x280000401:0x1b6d:0x0].0x0 (ffff9ccbcb83f300) refcount nonzero (1) after lock cleanup; forcing cleanup. Nov 18 19:39:09 oleg228-client kernel: LustreError: 93880:0:(ldlm_resource.c:981:ldlm_resource_complain()) Skipped 1 previous similar message Nov 18 19:39:10 oleg228-client kernel: LustreError: 93793:0:(osc_request.c:2944:osc_build_rpc()) cfs_fail_timeout id 414 awake Nov 18 19:39:10 oleg228-client kernel: Lustre: 2407:0:(llite_lib.c:4226:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.128@tcp:/lustre/fid: [0x20000bf89:0x9:0x0]// may get corrupted (rc -108) Nov 18 19:39:11 oleg228-client sshd[93972]: Accepted publickey for root from 192.168.202.28 port 51978 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:11 oleg228-client systemd-logind[1015]: New session 488 of user root. Nov 18 19:39:11 oleg228-client systemd[1]: Started Session 488 of user root. Nov 18 19:39:11 oleg228-client sshd[93972]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:12 oleg228-client sshd[93985]: Received disconnect from 192.168.202.28 port 51978:11: disconnected by user Nov 18 19:39:12 oleg228-client sshd[93985]: Disconnected from user root 192.168.202.28 port 51978 Nov 18 19:39:12 oleg228-client sshd[93972]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:12 oleg228-client systemd[1]: session-488.scope: Succeeded. Nov 18 19:39:12 oleg228-client systemd-logind[1015]: Session 488 logged out. Waiting for processes to exit. Nov 18 19:39:12 oleg228-client systemd-logind[1015]: Removed session 488. Nov 18 19:39:13 oleg228-client sshd[94111]: Accepted publickey for root from 192.168.202.28 port 51990 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:13 oleg228-client systemd[1]: Started Session 489 of user root. Nov 18 19:39:13 oleg228-client systemd-logind[1015]: New session 489 of user root. Nov 18 19:39:13 oleg228-client sshd[94111]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:13 oleg228-client sshd[94124]: Received disconnect from 192.168.202.28 port 51990:11: disconnected by user Nov 18 19:39:13 oleg228-client sshd[94124]: Disconnected from user root 192.168.202.28 port 51990 Nov 18 19:39:13 oleg228-client sshd[94111]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:13 oleg228-client systemd-logind[1015]: Session 489 logged out. Waiting for processes to exit. Nov 18 19:39:13 oleg228-client systemd[1]: session-489.scope: Succeeded. Nov 18 19:39:13 oleg228-client systemd-logind[1015]: Removed session 489. Nov 18 19:39:14 oleg228-client sshd[94257]: Accepted publickey for root from 192.168.202.28 port 51994 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:14 oleg228-client systemd[1]: Started Session 490 of user root. Nov 18 19:39:14 oleg228-client systemd-logind[1015]: New session 490 of user root. Nov 18 19:39:14 oleg228-client sshd[94257]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:14 oleg228-client sshd[94270]: Received disconnect from 192.168.202.28 port 51994:11: disconnected by user Nov 18 19:39:14 oleg228-client sshd[94270]: Disconnected from user root 192.168.202.28 port 51994 Nov 18 19:39:14 oleg228-client sshd[94257]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:15 oleg228-client systemd[1]: session-490.scope: Succeeded. Nov 18 19:39:15 oleg228-client systemd-logind[1015]: Session 490 logged out. Waiting for processes to exit. Nov 18 19:39:15 oleg228-client systemd-logind[1015]: Removed session 490. Nov 18 19:39:17 oleg228-client sshd[94413]: Accepted publickey for root from 192.168.202.28 port 52008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:17 oleg228-client systemd-logind[1015]: New session 491 of user root. Nov 18 19:39:17 oleg228-client systemd[1]: Started Session 491 of user root. Nov 18 19:39:17 oleg228-client sshd[94413]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:17 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 133: don't fail on flock resend === 19:39:15 (1763512755) Nov 18 19:39:17 oleg228-client sshd[94426]: Received disconnect from 192.168.202.28 port 52008:11: disconnected by user Nov 18 19:39:17 oleg228-client sshd[94426]: Disconnected from user root 192.168.202.28 port 52008 Nov 18 19:39:17 oleg228-client sshd[94413]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:17 oleg228-client systemd[1]: session-491.scope: Succeeded. Nov 18 19:39:17 oleg228-client systemd-logind[1015]: Session 491 logged out. Waiting for processes to exit. Nov 18 19:39:17 oleg228-client systemd-logind[1015]: Removed session 491. Nov 18 19:39:58 oleg228-client sshd[94624]: Accepted publickey for root from 192.168.202.28 port 42730 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:39:58 oleg228-client systemd-logind[1015]: New session 492 of user root. Nov 18 19:39:58 oleg228-client systemd[1]: Started Session 492 of user root. Nov 18 19:39:59 oleg228-client sshd[94624]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:39:59 oleg228-client sshd[94638]: Received disconnect from 192.168.202.28 port 42730:11: disconnected by user Nov 18 19:39:59 oleg228-client sshd[94638]: Disconnected from user root 192.168.202.28 port 42730 Nov 18 19:39:59 oleg228-client sshd[94624]: pam_unix(sshd:session): session closed for user root Nov 18 19:39:59 oleg228-client systemd[1]: session-492.scope: Succeeded. Nov 18 19:39:59 oleg228-client systemd-logind[1015]: Session 492 logged out. Waiting for processes to exit. Nov 18 19:39:59 oleg228-client systemd-logind[1015]: Removed session 492. Nov 18 19:40:00 oleg228-client sshd[94766]: Accepted publickey for root from 192.168.202.28 port 46242 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:00 oleg228-client systemd[1]: Started Session 493 of user root. Nov 18 19:40:00 oleg228-client systemd-logind[1015]: New session 493 of user root. Nov 18 19:40:00 oleg228-client sshd[94766]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:01 oleg228-client sshd[94779]: Received disconnect from 192.168.202.28 port 46242:11: disconnected by user Nov 18 19:40:01 oleg228-client sshd[94779]: Disconnected from user root 192.168.202.28 port 46242 Nov 18 19:40:01 oleg228-client sshd[94766]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:01 oleg228-client systemd[1]: session-493.scope: Succeeded. Nov 18 19:40:01 oleg228-client systemd-logind[1015]: Session 493 logged out. Waiting for processes to exit. Nov 18 19:40:01 oleg228-client systemd-logind[1015]: Removed session 493. Nov 18 19:40:02 oleg228-client sshd[94912]: Accepted publickey for root from 192.168.202.28 port 46258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:02 oleg228-client systemd[1]: Started Session 494 of user root. Nov 18 19:40:02 oleg228-client systemd-logind[1015]: New session 494 of user root. Nov 18 19:40:02 oleg228-client sshd[94912]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:03 oleg228-client sshd[94925]: Received disconnect from 192.168.202.28 port 46258:11: disconnected by user Nov 18 19:40:03 oleg228-client sshd[94925]: Disconnected from user root 192.168.202.28 port 46258 Nov 18 19:40:03 oleg228-client sshd[94912]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:03 oleg228-client systemd[1]: session-494.scope: Succeeded. Nov 18 19:40:03 oleg228-client systemd-logind[1015]: Session 494 logged out. Waiting for processes to exit. Nov 18 19:40:03 oleg228-client systemd-logind[1015]: Removed session 494. Nov 18 19:40:04 oleg228-client sshd[95068]: Accepted publickey for root from 192.168.202.28 port 46272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:04 oleg228-client systemd[1]: Started Session 495 of user root. Nov 18 19:40:04 oleg228-client systemd-logind[1015]: New session 495 of user root. Nov 18 19:40:04 oleg228-client sshd[95068]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:05 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 134: race between failover and search for reply data free slot ========================================================== 19:40:03 (1763512803) Nov 18 19:40:05 oleg228-client sshd[95081]: Received disconnect from 192.168.202.28 port 46272:11: disconnected by user Nov 18 19:40:05 oleg228-client sshd[95081]: Disconnected from user root 192.168.202.28 port 46272 Nov 18 19:40:05 oleg228-client sshd[95068]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:05 oleg228-client systemd[1]: session-495.scope: Succeeded. Nov 18 19:40:05 oleg228-client systemd-logind[1015]: Session 495 logged out. Waiting for processes to exit. Nov 18 19:40:05 oleg228-client systemd-logind[1015]: Removed session 495. Nov 18 19:40:05 oleg228-client sshd[95206]: Accepted publickey for root from 192.168.202.28 port 46288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:06 oleg228-client systemd[1]: Started Session 496 of user root. Nov 18 19:40:06 oleg228-client systemd-logind[1015]: New session 496 of user root. Nov 18 19:40:06 oleg228-client sshd[95206]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:06 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_134 Need 2+ clients, have 1 Nov 18 19:40:06 oleg228-client sshd[95220]: Received disconnect from 192.168.202.28 port 46288:11: disconnected by user Nov 18 19:40:06 oleg228-client sshd[95220]: Disconnected from user root 192.168.202.28 port 46288 Nov 18 19:40:06 oleg228-client sshd[95206]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:06 oleg228-client systemd-logind[1015]: Session 496 logged out. Waiting for processes to exit. Nov 18 19:40:06 oleg228-client systemd[1]: session-496.scope: Succeeded. Nov 18 19:40:06 oleg228-client systemd-logind[1015]: Removed session 496. Nov 18 19:40:08 oleg228-client sshd[95361]: Accepted publickey for root from 192.168.202.28 port 46290 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:08 oleg228-client systemd[1]: Started Session 497 of user root. Nov 18 19:40:08 oleg228-client sshd[95361]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:08 oleg228-client systemd-logind[1015]: New session 497 of user root. Nov 18 19:40:08 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 135: DOM: open/create resend to return size ========================================================== 19:40:06 (1763512806) Nov 18 19:40:08 oleg228-client sshd[95374]: Received disconnect from 192.168.202.28 port 46290:11: disconnected by user Nov 18 19:40:08 oleg228-client sshd[95374]: Disconnected from user root 192.168.202.28 port 46290 Nov 18 19:40:08 oleg228-client sshd[95361]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:08 oleg228-client systemd[1]: session-497.scope: Succeeded. Nov 18 19:40:08 oleg228-client systemd-logind[1015]: Session 497 logged out. Waiting for processes to exit. Nov 18 19:40:08 oleg228-client systemd-logind[1015]: Removed session 497. Nov 18 19:40:32 oleg228-client kernel: Lustre: lustre-MDT0001-mdc-ffff9ccbc80e4000: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:40:32 oleg228-client kernel: Lustre: Skipped 15 previous similar messages Nov 18 19:40:33 oleg228-client sshd[95569]: Accepted publickey for root from 192.168.202.28 port 55514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:34 oleg228-client systemd-logind[1015]: New session 498 of user root. Nov 18 19:40:34 oleg228-client systemd[1]: Started Session 498 of user root. Nov 18 19:40:34 oleg228-client sshd[95569]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:34 oleg228-client sshd[95582]: Received disconnect from 192.168.202.28 port 55514:11: disconnected by user Nov 18 19:40:34 oleg228-client sshd[95582]: Disconnected from user root 192.168.202.28 port 55514 Nov 18 19:40:34 oleg228-client sshd[95569]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:34 oleg228-client systemd[1]: session-498.scope: Succeeded. Nov 18 19:40:34 oleg228-client systemd-logind[1015]: Session 498 logged out. Waiting for processes to exit. Nov 18 19:40:34 oleg228-client systemd-logind[1015]: Removed session 498. Nov 18 19:40:36 oleg228-client sshd[95709]: Accepted publickey for root from 192.168.202.28 port 55518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:36 oleg228-client systemd[1]: Started Session 499 of user root. Nov 18 19:40:36 oleg228-client systemd-logind[1015]: New session 499 of user root. Nov 18 19:40:36 oleg228-client sshd[95709]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:36 oleg228-client sshd[95722]: Received disconnect from 192.168.202.28 port 55518:11: disconnected by user Nov 18 19:40:36 oleg228-client sshd[95722]: Disconnected from user root 192.168.202.28 port 55518 Nov 18 19:40:36 oleg228-client sshd[95709]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:37 oleg228-client systemd[1]: session-499.scope: Succeeded. Nov 18 19:40:37 oleg228-client systemd-logind[1015]: Session 499 logged out. Waiting for processes to exit. Nov 18 19:40:37 oleg228-client systemd-logind[1015]: Removed session 499. Nov 18 19:40:38 oleg228-client sshd[95855]: Accepted publickey for root from 192.168.202.28 port 55522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:38 oleg228-client systemd-logind[1015]: New session 500 of user root. Nov 18 19:40:38 oleg228-client systemd[1]: Started Session 500 of user root. Nov 18 19:40:38 oleg228-client sshd[95855]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:38 oleg228-client sshd[95868]: Received disconnect from 192.168.202.28 port 55522:11: disconnected by user Nov 18 19:40:38 oleg228-client sshd[95868]: Disconnected from user root 192.168.202.28 port 55522 Nov 18 19:40:38 oleg228-client sshd[95855]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:38 oleg228-client systemd[1]: session-500.scope: Succeeded. Nov 18 19:40:38 oleg228-client systemd-logind[1015]: Session 500 logged out. Waiting for processes to exit. Nov 18 19:40:38 oleg228-client systemd-logind[1015]: Removed session 500. Nov 18 19:40:39 oleg228-client sshd[96000]: Accepted publickey for root from 192.168.202.28 port 55536 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:39 oleg228-client systemd-logind[1015]: New session 501 of user root. Nov 18 19:40:39 oleg228-client systemd[1]: Started Session 501 of user root. Nov 18 19:40:39 oleg228-client sshd[96000]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:40 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_136 skipping excluded test 136 Nov 18 19:40:40 oleg228-client sshd[96013]: Received disconnect from 192.168.202.28 port 55536:11: disconnected by user Nov 18 19:40:40 oleg228-client sshd[96013]: Disconnected from user root 192.168.202.28 port 55536 Nov 18 19:40:40 oleg228-client sshd[96000]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:40 oleg228-client systemd[1]: session-501.scope: Succeeded. Nov 18 19:40:40 oleg228-client systemd-logind[1015]: Session 501 logged out. Waiting for processes to exit. Nov 18 19:40:40 oleg228-client systemd-logind[1015]: Removed session 501. Nov 18 19:40:41 oleg228-client sshd[96153]: Accepted publickey for root from 192.168.202.28 port 40538 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:41 oleg228-client systemd[1]: Started Session 502 of user root. Nov 18 19:40:41 oleg228-client systemd-logind[1015]: New session 502 of user root. Nov 18 19:40:41 oleg228-client sshd[96153]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:41 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 137: late resend must be skipped if already applied ========================================================== 19:40:40 (1763512840) Nov 18 19:40:41 oleg228-client sshd[96166]: Received disconnect from 192.168.202.28 port 40538:11: disconnected by user Nov 18 19:40:41 oleg228-client sshd[96166]: Disconnected from user root 192.168.202.28 port 40538 Nov 18 19:40:41 oleg228-client sshd[96153]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:41 oleg228-client systemd[1]: session-502.scope: Succeeded. Nov 18 19:40:41 oleg228-client systemd-logind[1015]: Session 502 logged out. Waiting for processes to exit. Nov 18 19:40:41 oleg228-client systemd-logind[1015]: Removed session 502. Nov 18 19:40:55 oleg228-client sshd[96314]: Accepted publickey for root from 192.168.202.28 port 52864 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:55 oleg228-client systemd[1]: Started Session 503 of user root. Nov 18 19:40:55 oleg228-client systemd-logind[1015]: New session 503 of user root. Nov 18 19:40:55 oleg228-client sshd[96314]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:55 oleg228-client sshd[96327]: Received disconnect from 192.168.202.28 port 52864:11: disconnected by user Nov 18 19:40:55 oleg228-client sshd[96327]: Disconnected from user root 192.168.202.28 port 52864 Nov 18 19:40:55 oleg228-client sshd[96314]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:55 oleg228-client systemd-logind[1015]: Session 503 logged out. Waiting for processes to exit. Nov 18 19:40:55 oleg228-client systemd[1]: session-503.scope: Succeeded. Nov 18 19:40:55 oleg228-client systemd-logind[1015]: Removed session 503. Nov 18 19:40:57 oleg228-client sshd[96453]: Accepted publickey for root from 192.168.202.28 port 52868 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:57 oleg228-client systemd-logind[1015]: New session 504 of user root. Nov 18 19:40:57 oleg228-client systemd[1]: Started Session 504 of user root. Nov 18 19:40:57 oleg228-client sshd[96453]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:57 oleg228-client sshd[96466]: Received disconnect from 192.168.202.28 port 52868:11: disconnected by user Nov 18 19:40:57 oleg228-client sshd[96466]: Disconnected from user root 192.168.202.28 port 52868 Nov 18 19:40:57 oleg228-client sshd[96453]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:58 oleg228-client systemd-logind[1015]: Session 504 logged out. Waiting for processes to exit. Nov 18 19:40:58 oleg228-client systemd[1]: session-504.scope: Succeeded. Nov 18 19:40:58 oleg228-client systemd-logind[1015]: Removed session 504. Nov 18 19:40:59 oleg228-client sshd[96599]: Accepted publickey for root from 192.168.202.28 port 52882 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:40:59 oleg228-client systemd-logind[1015]: New session 505 of user root. Nov 18 19:40:59 oleg228-client systemd[1]: Started Session 505 of user root. Nov 18 19:40:59 oleg228-client sshd[96599]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:40:59 oleg228-client sshd[96612]: Received disconnect from 192.168.202.28 port 52882:11: disconnected by user Nov 18 19:40:59 oleg228-client sshd[96612]: Disconnected from user root 192.168.202.28 port 52882 Nov 18 19:40:59 oleg228-client sshd[96599]: pam_unix(sshd:session): session closed for user root Nov 18 19:40:59 oleg228-client systemd[1]: session-505.scope: Succeeded. Nov 18 19:40:59 oleg228-client systemd-logind[1015]: Session 505 logged out. Waiting for processes to exit. Nov 18 19:40:59 oleg228-client systemd-logind[1015]: Removed session 505. Nov 18 19:41:05 oleg228-client sshd[96756]: Accepted publickey for root from 192.168.202.28 port 53466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:41:06 oleg228-client systemd-logind[1015]: New session 506 of user root. Nov 18 19:41:06 oleg228-client systemd[1]: Started Session 506 of user root. Nov 18 19:41:06 oleg228-client sshd[96756]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:41:06 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 138: Umount MDT during recovery === 19:41:05 (1763512865) Nov 18 19:41:06 oleg228-client sshd[96769]: Received disconnect from 192.168.202.28 port 53466:11: disconnected by user Nov 18 19:41:06 oleg228-client sshd[96769]: Disconnected from user root 192.168.202.28 port 53466 Nov 18 19:41:06 oleg228-client sshd[96756]: pam_unix(sshd:session): session closed for user root Nov 18 19:41:06 oleg228-client systemd[1]: session-506.scope: Succeeded. Nov 18 19:41:06 oleg228-client systemd-logind[1015]: Session 506 logged out. Waiting for processes to exit. Nov 18 19:41:06 oleg228-client systemd-logind[1015]: Removed session 506. Nov 18 19:41:07 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 19:41:07 oleg228-client kernel: LustreError: 96848:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc80e4000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 19:41:07 oleg228-client kernel: LustreError: 96848:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 19:41:07 oleg228-client kernel: LustreError: 96848:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 19:41:07 oleg228-client kernel: LustreError: 96848:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages Nov 18 19:41:08 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 19:43:06 oleg228-client systemd-udevd[97386]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 19:43:06 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc7526000: operation mds_connect to node 192.168.202.128@tcp failed: rc = -16 Nov 18 19:43:11 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 19:43:12 oleg228-client sshd[97495]: Accepted publickey for root from 192.168.202.28 port 55272 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:12 oleg228-client systemd-logind[1015]: New session 507 of user root. Nov 18 19:43:12 oleg228-client systemd[1]: Started Session 507 of user root. Nov 18 19:43:12 oleg228-client sshd[97495]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:12 oleg228-client sshd[97508]: Received disconnect from 192.168.202.28 port 55272:11: disconnected by user Nov 18 19:43:12 oleg228-client sshd[97508]: Disconnected from user root 192.168.202.28 port 55272 Nov 18 19:43:12 oleg228-client sshd[97495]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:12 oleg228-client systemd-logind[1015]: Session 507 logged out. Waiting for processes to exit. Nov 18 19:43:12 oleg228-client systemd[1]: session-507.scope: Succeeded. Nov 18 19:43:12 oleg228-client systemd-logind[1015]: Removed session 507. Nov 18 19:43:13 oleg228-client sshd[97634]: Accepted publickey for root from 192.168.202.28 port 55274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:13 oleg228-client systemd[1]: Started Session 508 of user root. Nov 18 19:43:13 oleg228-client systemd-logind[1015]: New session 508 of user root. Nov 18 19:43:13 oleg228-client sshd[97634]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:13 oleg228-client sshd[97647]: Received disconnect from 192.168.202.28 port 55274:11: disconnected by user Nov 18 19:43:13 oleg228-client sshd[97647]: Disconnected from user root 192.168.202.28 port 55274 Nov 18 19:43:13 oleg228-client sshd[97634]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:14 oleg228-client systemd-logind[1015]: Session 508 logged out. Waiting for processes to exit. Nov 18 19:43:14 oleg228-client systemd[1]: session-508.scope: Succeeded. Nov 18 19:43:14 oleg228-client systemd-logind[1015]: Removed session 508. Nov 18 19:43:14 oleg228-client sshd[97780]: Accepted publickey for root from 192.168.202.28 port 55278 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:15 oleg228-client systemd-logind[1015]: New session 509 of user root. Nov 18 19:43:15 oleg228-client systemd[1]: Started Session 509 of user root. Nov 18 19:43:15 oleg228-client sshd[97780]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:15 oleg228-client sshd[97794]: Received disconnect from 192.168.202.28 port 55278:11: disconnected by user Nov 18 19:43:15 oleg228-client sshd[97794]: Disconnected from user root 192.168.202.28 port 55278 Nov 18 19:43:15 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:43:15 oleg228-client sshd[97780]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:15 oleg228-client systemd-logind[1015]: Session 509 logged out. Waiting for processes to exit. Nov 18 19:43:15 oleg228-client systemd[1]: session-509.scope: Succeeded. Nov 18 19:43:15 oleg228-client systemd-logind[1015]: Removed session 509. Nov 18 19:43:16 oleg228-client sshd[97937]: Accepted publickey for root from 192.168.202.28 port 55280 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:16 oleg228-client systemd[1]: Started Session 510 of user root. Nov 18 19:43:16 oleg228-client systemd-logind[1015]: New session 510 of user root. Nov 18 19:43:16 oleg228-client sshd[97937]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:16 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 139: corrupted catid won't cause crash ========================================================== 19:43:15 (1763512995) Nov 18 19:43:16 oleg228-client sshd[97950]: Received disconnect from 192.168.202.28 port 55280:11: disconnected by user Nov 18 19:43:16 oleg228-client sshd[97950]: Disconnected from user root 192.168.202.28 port 55280 Nov 18 19:43:16 oleg228-client sshd[97937]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:16 oleg228-client systemd-logind[1015]: Session 510 logged out. Waiting for processes to exit. Nov 18 19:43:16 oleg228-client systemd[1]: session-510.scope: Succeeded. Nov 18 19:43:16 oleg228-client systemd-logind[1015]: Removed session 510. Nov 18 19:43:21 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc7526000: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 19:43:21 oleg228-client kernel: Lustre: Skipped 16 previous similar messages Nov 18 19:43:26 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:43:26 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25f3c0c0 to 0x2622672b25f3c352 Nov 18 19:43:31 oleg228-client sshd[98297]: Accepted publickey for root from 192.168.202.28 port 51998 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:31 oleg228-client systemd-logind[1015]: New session 511 of user root. Nov 18 19:43:31 oleg228-client systemd[1]: Started Session 511 of user root. Nov 18 19:43:31 oleg228-client sshd[98297]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:32 oleg228-client sshd[98310]: Received disconnect from 192.168.202.28 port 51998:11: disconnected by user Nov 18 19:43:32 oleg228-client sshd[98310]: Disconnected from user root 192.168.202.28 port 51998 Nov 18 19:43:32 oleg228-client sshd[98297]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:32 oleg228-client systemd[1]: session-511.scope: Succeeded. Nov 18 19:43:32 oleg228-client systemd-logind[1015]: Session 511 logged out. Waiting for processes to exit. Nov 18 19:43:32 oleg228-client systemd-logind[1015]: Removed session 511. Nov 18 19:43:33 oleg228-client sshd[98436]: Accepted publickey for root from 192.168.202.28 port 52014 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:33 oleg228-client systemd[1]: Started Session 512 of user root. Nov 18 19:43:33 oleg228-client systemd-logind[1015]: New session 512 of user root. Nov 18 19:43:33 oleg228-client sshd[98436]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:33 oleg228-client sshd[98449]: Received disconnect from 192.168.202.28 port 52014:11: disconnected by user Nov 18 19:43:33 oleg228-client sshd[98449]: Disconnected from user root 192.168.202.28 port 52014 Nov 18 19:43:33 oleg228-client sshd[98436]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:33 oleg228-client systemd[1]: session-512.scope: Succeeded. Nov 18 19:43:33 oleg228-client systemd-logind[1015]: Session 512 logged out. Waiting for processes to exit. Nov 18 19:43:33 oleg228-client systemd-logind[1015]: Removed session 512. Nov 18 19:43:34 oleg228-client sshd[98582]: Accepted publickey for root from 192.168.202.28 port 52030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:34 oleg228-client systemd-logind[1015]: New session 513 of user root. Nov 18 19:43:34 oleg228-client systemd[1]: Started Session 513 of user root. Nov 18 19:43:34 oleg228-client sshd[98582]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:34 oleg228-client sshd[98595]: Received disconnect from 192.168.202.28 port 52030:11: disconnected by user Nov 18 19:43:34 oleg228-client sshd[98595]: Disconnected from user root 192.168.202.28 port 52030 Nov 18 19:43:34 oleg228-client sshd[98582]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:34 oleg228-client systemd-logind[1015]: Session 513 logged out. Waiting for processes to exit. Nov 18 19:43:34 oleg228-client systemd[1]: session-513.scope: Succeeded. Nov 18 19:43:34 oleg228-client systemd-logind[1015]: Removed session 513. Nov 18 19:43:35 oleg228-client sshd[98738]: Accepted publickey for root from 192.168.202.28 port 52034 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:35 oleg228-client systemd[1]: Started Session 514 of user root. Nov 18 19:43:35 oleg228-client systemd-logind[1015]: New session 514 of user root. Nov 18 19:43:35 oleg228-client sshd[98738]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:36 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140a: local mount is flagged properly ========================================================== 19:43:35 (1763513015) Nov 18 19:43:36 oleg228-client sshd[98751]: Received disconnect from 192.168.202.28 port 52034:11: disconnected by user Nov 18 19:43:36 oleg228-client sshd[98751]: Disconnected from user root 192.168.202.28 port 52034 Nov 18 19:43:36 oleg228-client sshd[98738]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:36 oleg228-client systemd-logind[1015]: Session 514 logged out. Waiting for processes to exit. Nov 18 19:43:36 oleg228-client systemd[1]: session-514.scope: Succeeded. Nov 18 19:43:36 oleg228-client systemd-logind[1015]: Removed session 514. Nov 18 19:43:59 oleg228-client sshd[99089]: Accepted publickey for root from 192.168.202.28 port 33820 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:43:59 oleg228-client systemd-logind[1015]: New session 515 of user root. Nov 18 19:43:59 oleg228-client systemd[1]: Started Session 515 of user root. Nov 18 19:43:59 oleg228-client sshd[99089]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:43:59 oleg228-client sshd[99102]: Received disconnect from 192.168.202.28 port 33820:11: disconnected by user Nov 18 19:43:59 oleg228-client sshd[99102]: Disconnected from user root 192.168.202.28 port 33820 Nov 18 19:43:59 oleg228-client sshd[99089]: pam_unix(sshd:session): session closed for user root Nov 18 19:43:59 oleg228-client systemd-logind[1015]: Session 515 logged out. Waiting for processes to exit. Nov 18 19:43:59 oleg228-client systemd[1]: session-515.scope: Succeeded. Nov 18 19:43:59 oleg228-client systemd-logind[1015]: Removed session 515. Nov 18 19:44:00 oleg228-client sshd[99228]: Accepted publickey for root from 192.168.202.28 port 33832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:44:00 oleg228-client systemd-logind[1015]: New session 516 of user root. Nov 18 19:44:00 oleg228-client systemd[1]: Started Session 516 of user root. Nov 18 19:44:00 oleg228-client sshd[99228]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:44:00 oleg228-client sshd[99241]: Received disconnect from 192.168.202.28 port 33832:11: disconnected by user Nov 18 19:44:00 oleg228-client sshd[99241]: Disconnected from user root 192.168.202.28 port 33832 Nov 18 19:44:00 oleg228-client sshd[99228]: pam_unix(sshd:session): session closed for user root Nov 18 19:44:01 oleg228-client systemd[1]: session-516.scope: Succeeded. Nov 18 19:44:01 oleg228-client systemd-logind[1015]: Session 516 logged out. Waiting for processes to exit. Nov 18 19:44:01 oleg228-client systemd-logind[1015]: Removed session 516. Nov 18 19:44:02 oleg228-client sshd[99376]: Accepted publickey for root from 192.168.202.28 port 46680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:44:02 oleg228-client systemd-logind[1015]: New session 517 of user root. Nov 18 19:44:02 oleg228-client systemd[1]: Started Session 517 of user root. Nov 18 19:44:02 oleg228-client sshd[99376]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:44:02 oleg228-client anacron[51137]: Job `cron.weekly' started Nov 18 19:44:02 oleg228-client anacron[51137]: Job `cron.weekly' terminated Nov 18 19:44:02 oleg228-client sshd[99389]: Received disconnect from 192.168.202.28 port 46680:11: disconnected by user Nov 18 19:44:02 oleg228-client sshd[99389]: Disconnected from user root 192.168.202.28 port 46680 Nov 18 19:44:02 oleg228-client sshd[99376]: pam_unix(sshd:session): session closed for user root Nov 18 19:44:02 oleg228-client systemd[1]: session-517.scope: Succeeded. Nov 18 19:44:02 oleg228-client systemd-logind[1015]: Session 517 logged out. Waiting for processes to exit. Nov 18 19:44:02 oleg228-client systemd-logind[1015]: Removed session 517. Nov 18 19:44:04 oleg228-client sshd[99541]: Accepted publickey for root from 192.168.202.28 port 46692 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:44:04 oleg228-client systemd-logind[1015]: New session 518 of user root. Nov 18 19:44:04 oleg228-client systemd[1]: Started Session 518 of user root. Nov 18 19:44:04 oleg228-client sshd[99541]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:44:04 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 140b: local mount is excluded from recovery ========================================================== 19:44:03 (1763513043) Nov 18 19:44:04 oleg228-client sshd[99554]: Received disconnect from 192.168.202.28 port 46692:11: disconnected by user Nov 18 19:44:04 oleg228-client sshd[99554]: Disconnected from user root 192.168.202.28 port 46692 Nov 18 19:44:04 oleg228-client sshd[99541]: pam_unix(sshd:session): session closed for user root Nov 18 19:44:04 oleg228-client systemd[1]: session-518.scope: Succeeded. Nov 18 19:44:04 oleg228-client systemd-logind[1015]: Session 518 logged out. Waiting for processes to exit. Nov 18 19:44:04 oleg228-client systemd-logind[1015]: Removed session 518. Nov 18 19:44:16 oleg228-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Nov 18 19:44:57 oleg228-client sshd[100090]: Accepted publickey for root from 192.168.202.28 port 53320 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:44:57 oleg228-client systemd[1]: Started Session 519 of user root. Nov 18 19:44:57 oleg228-client systemd-logind[1015]: New session 519 of user root. Nov 18 19:44:57 oleg228-client sshd[100090]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:44:57 oleg228-client sshd[100103]: Received disconnect from 192.168.202.28 port 53320:11: disconnected by user Nov 18 19:44:57 oleg228-client sshd[100103]: Disconnected from user root 192.168.202.28 port 53320 Nov 18 19:44:57 oleg228-client sshd[100090]: pam_unix(sshd:session): session closed for user root Nov 18 19:44:57 oleg228-client systemd[1]: session-519.scope: Succeeded. Nov 18 19:44:57 oleg228-client systemd-logind[1015]: Session 519 logged out. Waiting for processes to exit. Nov 18 19:44:57 oleg228-client systemd-logind[1015]: Removed session 519. Nov 18 19:44:59 oleg228-client sshd[100326]: Accepted publickey for root from 192.168.202.28 port 53336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:44:59 oleg228-client systemd-logind[1015]: New session 520 of user root. Nov 18 19:44:59 oleg228-client systemd[1]: Started Session 520 of user root. Nov 18 19:44:59 oleg228-client sshd[100326]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:00 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 19:45:00 oleg228-client sshd[100339]: Received disconnect from 192.168.202.28 port 53336:11: disconnected by user Nov 18 19:45:00 oleg228-client sshd[100339]: Disconnected from user root 192.168.202.28 port 53336 Nov 18 19:45:00 oleg228-client sshd[100326]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:00 oleg228-client systemd[1]: session-520.scope: Succeeded. Nov 18 19:45:00 oleg228-client systemd-logind[1015]: Session 520 logged out. Waiting for processes to exit. Nov 18 19:45:00 oleg228-client systemd-logind[1015]: Removed session 520. Nov 18 19:45:00 oleg228-client sshd[100482]: Accepted publickey for root from 192.168.202.28 port 36066 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:00 oleg228-client systemd-logind[1015]: New session 521 of user root. Nov 18 19:45:00 oleg228-client systemd[1]: Started Session 521 of user root. Nov 18 19:45:00 oleg228-client sshd[100482]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:01 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 19:45:01 oleg228-client sshd[100495]: Received disconnect from 192.168.202.28 port 36066:11: disconnected by user Nov 18 19:45:01 oleg228-client sshd[100495]: Disconnected from user root 192.168.202.28 port 36066 Nov 18 19:45:01 oleg228-client sshd[100482]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:01 oleg228-client systemd[1]: session-521.scope: Succeeded. Nov 18 19:45:01 oleg228-client systemd-logind[1015]: Session 521 logged out. Waiting for processes to exit. Nov 18 19:45:01 oleg228-client systemd-logind[1015]: Removed session 521. Nov 18 19:45:02 oleg228-client sshd[100536]: Accepted publickey for root from 192.168.202.28 port 36070 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:02 oleg228-client systemd-logind[1015]: New session 522 of user root. Nov 18 19:45:02 oleg228-client systemd[1]: Started Session 522 of user root. Nov 18 19:45:02 oleg228-client sshd[100536]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:03 oleg228-client sshd[100549]: Received disconnect from 192.168.202.28 port 36070:11: disconnected by user Nov 18 19:45:03 oleg228-client sshd[100549]: Disconnected from user root 192.168.202.28 port 36070 Nov 18 19:45:03 oleg228-client sshd[100536]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:03 oleg228-client systemd[1]: session-522.scope: Succeeded. Nov 18 19:45:03 oleg228-client systemd-logind[1015]: Session 522 logged out. Waiting for processes to exit. Nov 18 19:45:03 oleg228-client systemd-logind[1015]: Removed session 522. Nov 18 19:45:05 oleg228-client sshd[100681]: Accepted publickey for root from 192.168.202.28 port 36074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:05 oleg228-client systemd[1]: Started Session 523 of user root. Nov 18 19:45:05 oleg228-client systemd-logind[1015]: New session 523 of user root. Nov 18 19:45:05 oleg228-client sshd[100681]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:05 oleg228-client sshd[100694]: Received disconnect from 192.168.202.28 port 36074:11: disconnected by user Nov 18 19:45:05 oleg228-client sshd[100694]: Disconnected from user root 192.168.202.28 port 36074 Nov 18 19:45:05 oleg228-client sshd[100681]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:05 oleg228-client systemd[1]: session-523.scope: Succeeded. Nov 18 19:45:05 oleg228-client systemd-logind[1015]: Session 523 logged out. Waiting for processes to exit. Nov 18 19:45:05 oleg228-client systemd-logind[1015]: Removed session 523. Nov 18 19:45:06 oleg228-client sshd[100820]: Accepted publickey for root from 192.168.202.28 port 36082 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:06 oleg228-client systemd-logind[1015]: New session 524 of user root. Nov 18 19:45:06 oleg228-client systemd[1]: Started Session 524 of user root. Nov 18 19:45:06 oleg228-client sshd[100820]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:06 oleg228-client sshd[100833]: Received disconnect from 192.168.202.28 port 36082:11: disconnected by user Nov 18 19:45:06 oleg228-client sshd[100833]: Disconnected from user root 192.168.202.28 port 36082 Nov 18 19:45:06 oleg228-client sshd[100820]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:07 oleg228-client systemd[1]: session-524.scope: Succeeded. Nov 18 19:45:07 oleg228-client systemd-logind[1015]: Session 524 logged out. Waiting for processes to exit. Nov 18 19:45:07 oleg228-client systemd-logind[1015]: Removed session 524. Nov 18 19:45:08 oleg228-client sshd[100967]: Accepted publickey for root from 192.168.202.28 port 36098 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:08 oleg228-client systemd-logind[1015]: New session 525 of user root. Nov 18 19:45:08 oleg228-client systemd[1]: Started Session 525 of user root. Nov 18 19:45:08 oleg228-client sshd[100967]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:08 oleg228-client sshd[100980]: Received disconnect from 192.168.202.28 port 36098:11: disconnected by user Nov 18 19:45:08 oleg228-client sshd[100980]: Disconnected from user root 192.168.202.28 port 36098 Nov 18 19:45:08 oleg228-client sshd[100967]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:08 oleg228-client systemd[1]: session-525.scope: Succeeded. Nov 18 19:45:08 oleg228-client systemd-logind[1015]: Session 525 logged out. Waiting for processes to exit. Nov 18 19:45:08 oleg228-client systemd-logind[1015]: Removed session 525. Nov 18 19:45:10 oleg228-client sshd[101130]: Accepted publickey for root from 192.168.202.28 port 36100 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:10 oleg228-client systemd-logind[1015]: New session 526 of user root. Nov 18 19:45:10 oleg228-client systemd[1]: Started Session 526 of user root. Nov 18 19:45:10 oleg228-client sshd[101130]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:10 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 141: do not lose locks on MGS restart ========================================================== 19:45:09 (1763513109) Nov 18 19:45:11 oleg228-client sshd[101143]: Received disconnect from 192.168.202.28 port 36100:11: disconnected by user Nov 18 19:45:11 oleg228-client sshd[101143]: Disconnected from user root 192.168.202.28 port 36100 Nov 18 19:45:11 oleg228-client sshd[101130]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:11 oleg228-client systemd[1]: session-526.scope: Succeeded. Nov 18 19:45:11 oleg228-client systemd-logind[1015]: Session 526 logged out. Waiting for processes to exit. Nov 18 19:45:11 oleg228-client systemd-logind[1015]: Removed session 526. Nov 18 19:45:12 oleg228-client sshd[101396]: Accepted publickey for root from 192.168.202.28 port 34764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:12 oleg228-client systemd-logind[1015]: New session 527 of user root. Nov 18 19:45:12 oleg228-client systemd[1]: Started Session 527 of user root. Nov 18 19:45:12 oleg228-client sshd[101396]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:13 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_141 cannot run in local mode or from build tree Nov 18 19:45:13 oleg228-client sshd[101409]: Received disconnect from 192.168.202.28 port 34764:11: disconnected by user Nov 18 19:45:13 oleg228-client sshd[101409]: Disconnected from user root 192.168.202.28 port 34764 Nov 18 19:45:13 oleg228-client sshd[101396]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:13 oleg228-client systemd[1]: session-527.scope: Succeeded. Nov 18 19:45:13 oleg228-client systemd-logind[1015]: Session 527 logged out. Waiting for processes to exit. Nov 18 19:45:13 oleg228-client systemd-logind[1015]: Removed session 527. Nov 18 19:45:14 oleg228-client sshd[101551]: Accepted publickey for root from 192.168.202.28 port 34766 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:14 oleg228-client systemd-logind[1015]: New session 528 of user root. Nov 18 19:45:14 oleg228-client systemd[1]: Started Session 528 of user root. Nov 18 19:45:14 oleg228-client sshd[101551]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:14 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 142: orphan name stub can be cleaned up in startup ========================================================== 19:45:13 (1763513113) Nov 18 19:45:14 oleg228-client sshd[101564]: Received disconnect from 192.168.202.28 port 34766:11: disconnected by user Nov 18 19:45:14 oleg228-client sshd[101564]: Disconnected from user root 192.168.202.28 port 34766 Nov 18 19:45:14 oleg228-client sshd[101551]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:14 oleg228-client systemd[1]: session-528.scope: Succeeded. Nov 18 19:45:14 oleg228-client systemd-logind[1015]: Session 528 logged out. Waiting for processes to exit. Nov 18 19:45:14 oleg228-client systemd-logind[1015]: Removed session 528. Nov 18 19:45:34 oleg228-client sshd[101922]: Accepted publickey for root from 192.168.202.28 port 44806 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:34 oleg228-client systemd[1]: Started Session 529 of user root. Nov 18 19:45:34 oleg228-client systemd-logind[1015]: New session 529 of user root. Nov 18 19:45:34 oleg228-client sshd[101922]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:34 oleg228-client sshd[101935]: Received disconnect from 192.168.202.28 port 44806:11: disconnected by user Nov 18 19:45:34 oleg228-client sshd[101935]: Disconnected from user root 192.168.202.28 port 44806 Nov 18 19:45:34 oleg228-client sshd[101922]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:35 oleg228-client systemd[1]: session-529.scope: Succeeded. Nov 18 19:45:35 oleg228-client systemd-logind[1015]: Session 529 logged out. Waiting for processes to exit. Nov 18 19:45:35 oleg228-client systemd-logind[1015]: Removed session 529. Nov 18 19:45:35 oleg228-client sshd[102062]: Accepted publickey for root from 192.168.202.28 port 44816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:36 oleg228-client systemd-logind[1015]: New session 530 of user root. Nov 18 19:45:36 oleg228-client systemd[1]: Started Session 530 of user root. Nov 18 19:45:36 oleg228-client sshd[102062]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:36 oleg228-client sshd[102075]: Received disconnect from 192.168.202.28 port 44816:11: disconnected by user Nov 18 19:45:36 oleg228-client sshd[102075]: Disconnected from user root 192.168.202.28 port 44816 Nov 18 19:45:36 oleg228-client sshd[102062]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:36 oleg228-client systemd-logind[1015]: Session 530 logged out. Waiting for processes to exit. Nov 18 19:45:36 oleg228-client systemd[1]: session-530.scope: Succeeded. Nov 18 19:45:36 oleg228-client systemd-logind[1015]: Removed session 530. Nov 18 19:45:37 oleg228-client sshd[102208]: Accepted publickey for root from 192.168.202.28 port 44822 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:37 oleg228-client systemd-logind[1015]: New session 531 of user root. Nov 18 19:45:37 oleg228-client systemd[1]: Started Session 531 of user root. Nov 18 19:45:37 oleg228-client sshd[102208]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:38 oleg228-client sshd[102221]: Received disconnect from 192.168.202.28 port 44822:11: disconnected by user Nov 18 19:45:38 oleg228-client sshd[102221]: Disconnected from user root 192.168.202.28 port 44822 Nov 18 19:45:38 oleg228-client sshd[102208]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:38 oleg228-client systemd[1]: session-531.scope: Succeeded. Nov 18 19:45:38 oleg228-client systemd-logind[1015]: Session 531 logged out. Waiting for processes to exit. Nov 18 19:45:38 oleg228-client systemd-logind[1015]: Removed session 531. Nov 18 19:45:39 oleg228-client sshd[102363]: Accepted publickey for root from 192.168.202.28 port 44832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:45:39 oleg228-client systemd-logind[1015]: New session 532 of user root. Nov 18 19:45:39 oleg228-client systemd[1]: Started Session 532 of user root. Nov 18 19:45:39 oleg228-client sshd[102363]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:45:39 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 143: orphan cleanup thread shouldn't be blocked even delete failed ========================================================== 19:45:38 (1763513138) Nov 18 19:45:39 oleg228-client sshd[102376]: Received disconnect from 192.168.202.28 port 44832:11: disconnected by user Nov 18 19:45:40 oleg228-client sshd[102376]: Disconnected from user root 192.168.202.28 port 44832 Nov 18 19:45:40 oleg228-client sshd[102363]: pam_unix(sshd:session): session closed for user root Nov 18 19:45:40 oleg228-client systemd[1]: session-532.scope: Succeeded. Nov 18 19:45:40 oleg228-client systemd-logind[1015]: Session 532 logged out. Waiting for processes to exit. Nov 18 19:45:40 oleg228-client systemd-logind[1015]: Removed session 532. Nov 18 19:45:58 oleg228-client kernel: Lustre: 2407:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763513142/real 1763513142] req@ffff9ccbd15a8a80 x1849171069150464/t0(0) o400->MGC192.168.202.128@tcp@192.168.202.128@tcp:26/25 lens 224/224 e 0 to 1 dl 1763513158 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Nov 18 19:45:58 oleg228-client kernel: Lustre: 2407:0:(client.c:2478:ptlrpc_expire_one_request()) Skipped 6 previous similar messages Nov 18 19:46:06 oleg228-client sshd[102853]: Accepted publickey for root from 192.168.202.28 port 37504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:06 oleg228-client systemd-logind[1015]: New session 533 of user root. Nov 18 19:46:06 oleg228-client systemd[1]: Started Session 533 of user root. Nov 18 19:46:06 oleg228-client sshd[102853]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:06 oleg228-client sshd[102866]: Received disconnect from 192.168.202.28 port 37504:11: disconnected by user Nov 18 19:46:06 oleg228-client sshd[102866]: Disconnected from user root 192.168.202.28 port 37504 Nov 18 19:46:06 oleg228-client sshd[102853]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:06 oleg228-client systemd[1]: session-533.scope: Succeeded. Nov 18 19:46:06 oleg228-client systemd-logind[1015]: Session 533 logged out. Waiting for processes to exit. Nov 18 19:46:06 oleg228-client systemd-logind[1015]: Removed session 533. Nov 18 19:46:07 oleg228-client sshd[102992]: Accepted publickey for root from 192.168.202.28 port 37516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:07 oleg228-client systemd-logind[1015]: New session 534 of user root. Nov 18 19:46:07 oleg228-client systemd[1]: Started Session 534 of user root. Nov 18 19:46:07 oleg228-client sshd[102992]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:07 oleg228-client sshd[103005]: Received disconnect from 192.168.202.28 port 37516:11: disconnected by user Nov 18 19:46:07 oleg228-client sshd[103005]: Disconnected from user root 192.168.202.28 port 37516 Nov 18 19:46:07 oleg228-client sshd[102992]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:07 oleg228-client systemd[1]: session-534.scope: Succeeded. Nov 18 19:46:07 oleg228-client systemd-logind[1015]: Session 534 logged out. Waiting for processes to exit. Nov 18 19:46:07 oleg228-client systemd-logind[1015]: Removed session 534. Nov 18 19:46:08 oleg228-client sshd[103138]: Accepted publickey for root from 192.168.202.28 port 37532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:08 oleg228-client systemd[1]: Started Session 535 of user root. Nov 18 19:46:08 oleg228-client systemd-logind[1015]: New session 535 of user root. Nov 18 19:46:08 oleg228-client sshd[103138]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:09 oleg228-client sshd[103151]: Received disconnect from 192.168.202.28 port 37532:11: disconnected by user Nov 18 19:46:09 oleg228-client sshd[103151]: Disconnected from user root 192.168.202.28 port 37532 Nov 18 19:46:09 oleg228-client sshd[103138]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:09 oleg228-client systemd[1]: session-535.scope: Succeeded. Nov 18 19:46:09 oleg228-client systemd-logind[1015]: Session 535 logged out. Waiting for processes to exit. Nov 18 19:46:09 oleg228-client systemd-logind[1015]: Removed session 535. Nov 18 19:46:10 oleg228-client sshd[103295]: Accepted publickey for root from 192.168.202.28 port 37548 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:10 oleg228-client systemd-logind[1015]: New session 536 of user root. Nov 18 19:46:10 oleg228-client systemd[1]: Started Session 536 of user root. Nov 18 19:46:10 oleg228-client sshd[103295]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:11 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144a: MDT failover should stop precreation threads ========================================================== 19:46:09 (1763513169) Nov 18 19:46:11 oleg228-client sshd[103308]: Received disconnect from 192.168.202.28 port 37548:11: disconnected by user Nov 18 19:46:11 oleg228-client sshd[103308]: Disconnected from user root 192.168.202.28 port 37548 Nov 18 19:46:11 oleg228-client sshd[103295]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:11 oleg228-client systemd[1]: session-536.scope: Succeeded. Nov 18 19:46:11 oleg228-client systemd-logind[1015]: Session 536 logged out. Waiting for processes to exit. Nov 18 19:46:11 oleg228-client systemd-logind[1015]: Removed session 536. Nov 18 19:46:50 oleg228-client sshd[103765]: Accepted publickey for root from 192.168.202.28 port 60666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:50 oleg228-client systemd-logind[1015]: New session 537 of user root. Nov 18 19:46:50 oleg228-client systemd[1]: Started Session 537 of user root. Nov 18 19:46:50 oleg228-client sshd[103765]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:52 oleg228-client sshd[103778]: Received disconnect from 192.168.202.28 port 60666:11: disconnected by user Nov 18 19:46:52 oleg228-client sshd[103778]: Disconnected from user root 192.168.202.28 port 60666 Nov 18 19:46:52 oleg228-client sshd[103765]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:52 oleg228-client systemd[1]: session-537.scope: Succeeded. Nov 18 19:46:52 oleg228-client systemd-logind[1015]: Session 537 logged out. Waiting for processes to exit. Nov 18 19:46:52 oleg228-client systemd-logind[1015]: Removed session 537. Nov 18 19:46:57 oleg228-client sshd[104003]: Accepted publickey for root from 192.168.202.28 port 48744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:46:57 oleg228-client systemd[1]: Started Session 538 of user root. Nov 18 19:46:57 oleg228-client systemd-logind[1015]: New session 538 of user root. Nov 18 19:46:57 oleg228-client sshd[104003]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:46:58 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:46:58 oleg228-client sshd[104016]: Received disconnect from 192.168.202.28 port 48744:11: disconnected by user Nov 18 19:46:58 oleg228-client sshd[104016]: Disconnected from user root 192.168.202.28 port 48744 Nov 18 19:46:58 oleg228-client sshd[104003]: pam_unix(sshd:session): session closed for user root Nov 18 19:46:58 oleg228-client systemd-logind[1015]: Session 538 logged out. Waiting for processes to exit. Nov 18 19:46:58 oleg228-client systemd[1]: session-538.scope: Succeeded. Nov 18 19:46:58 oleg228-client systemd-logind[1015]: Removed session 538. Nov 18 19:47:00 oleg228-client sshd[104160]: Accepted publickey for root from 192.168.202.28 port 48746 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:47:00 oleg228-client systemd-logind[1015]: New session 539 of user root. Nov 18 19:47:00 oleg228-client systemd[1]: Started Session 539 of user root. Nov 18 19:47:00 oleg228-client sshd[104160]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:47:01 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:47:01 oleg228-client sshd[104173]: Received disconnect from 192.168.202.28 port 48746:11: disconnected by user Nov 18 19:47:01 oleg228-client sshd[104173]: Disconnected from user root 192.168.202.28 port 48746 Nov 18 19:47:01 oleg228-client sshd[104160]: pam_unix(sshd:session): session closed for user root Nov 18 19:47:01 oleg228-client systemd[1]: session-539.scope: Succeeded. Nov 18 19:47:01 oleg228-client systemd-logind[1015]: Session 539 logged out. Waiting for processes to exit. Nov 18 19:47:01 oleg228-client systemd-logind[1015]: Removed session 539. Nov 18 19:47:03 oleg228-client sshd[104216]: Accepted publickey for root from 192.168.202.28 port 55526 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:47:03 oleg228-client systemd[1]: Started Session 540 of user root. Nov 18 19:47:03 oleg228-client systemd-logind[1015]: New session 540 of user root. Nov 18 19:47:03 oleg228-client sshd[104216]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:47:04 oleg228-client sshd[104229]: Received disconnect from 192.168.202.28 port 55526:11: disconnected by user Nov 18 19:47:04 oleg228-client sshd[104229]: Disconnected from user root 192.168.202.28 port 55526 Nov 18 19:47:04 oleg228-client sshd[104216]: pam_unix(sshd:session): session closed for user root Nov 18 19:47:04 oleg228-client systemd[1]: session-540.scope: Succeeded. Nov 18 19:47:04 oleg228-client systemd-logind[1015]: Session 540 logged out. Waiting for processes to exit. Nov 18 19:47:04 oleg228-client systemd-logind[1015]: Removed session 540. Nov 18 19:48:42 oleg228-client sshd[104544]: Accepted publickey for root from 192.168.202.28 port 49480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:48:42 oleg228-client systemd[1]: Started Session 541 of user root. Nov 18 19:48:42 oleg228-client systemd-logind[1015]: New session 541 of user root. Nov 18 19:48:42 oleg228-client sshd[104544]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:48:43 oleg228-client sshd[104557]: Received disconnect from 192.168.202.28 port 49480:11: disconnected by user Nov 18 19:48:43 oleg228-client sshd[104557]: Disconnected from user root 192.168.202.28 port 49480 Nov 18 19:48:43 oleg228-client sshd[104544]: pam_unix(sshd:session): session closed for user root Nov 18 19:48:43 oleg228-client systemd-logind[1015]: Session 541 logged out. Waiting for processes to exit. Nov 18 19:48:43 oleg228-client systemd[1]: session-541.scope: Succeeded. Nov 18 19:48:43 oleg228-client systemd-logind[1015]: Removed session 541. Nov 18 19:48:46 oleg228-client sshd[104780]: Accepted publickey for root from 192.168.202.28 port 49488 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:48:46 oleg228-client systemd-logind[1015]: New session 542 of user root. Nov 18 19:48:46 oleg228-client systemd[1]: Started Session 542 of user root. Nov 18 19:48:46 oleg228-client sshd[104780]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:48:46 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 19:48:46 oleg228-client sshd[104793]: Received disconnect from 192.168.202.28 port 49488:11: disconnected by user Nov 18 19:48:46 oleg228-client sshd[104793]: Disconnected from user root 192.168.202.28 port 49488 Nov 18 19:48:46 oleg228-client sshd[104780]: pam_unix(sshd:session): session closed for user root Nov 18 19:48:46 oleg228-client systemd[1]: session-542.scope: Succeeded. Nov 18 19:48:46 oleg228-client systemd-logind[1015]: Session 542 logged out. Waiting for processes to exit. Nov 18 19:48:46 oleg228-client systemd-logind[1015]: Removed session 542. Nov 18 19:48:48 oleg228-client sshd[104936]: Accepted publickey for root from 192.168.202.28 port 49502 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:48:48 oleg228-client systemd-logind[1015]: New session 543 of user root. Nov 18 19:48:48 oleg228-client systemd[1]: Started Session 543 of user root. Nov 18 19:48:48 oleg228-client sshd[104936]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:48:48 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 19:48:48 oleg228-client sshd[104950]: Received disconnect from 192.168.202.28 port 49502:11: disconnected by user Nov 18 19:48:48 oleg228-client sshd[104950]: Disconnected from user root 192.168.202.28 port 49502 Nov 18 19:48:48 oleg228-client sshd[104936]: pam_unix(sshd:session): session closed for user root Nov 18 19:48:48 oleg228-client systemd[1]: session-543.scope: Succeeded. Nov 18 19:48:48 oleg228-client systemd-logind[1015]: Session 543 logged out. Waiting for processes to exit. Nov 18 19:48:48 oleg228-client systemd-logind[1015]: Removed session 543. Nov 18 19:48:50 oleg228-client sshd[104991]: Accepted publickey for root from 192.168.202.28 port 49516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:48:50 oleg228-client systemd-logind[1015]: New session 544 of user root. Nov 18 19:48:50 oleg228-client systemd[1]: Started Session 544 of user root. Nov 18 19:48:50 oleg228-client sshd[104991]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:48:50 oleg228-client sshd[105004]: Received disconnect from 192.168.202.28 port 49516:11: disconnected by user Nov 18 19:48:50 oleg228-client sshd[105004]: Disconnected from user root 192.168.202.28 port 49516 Nov 18 19:48:50 oleg228-client sshd[104991]: pam_unix(sshd:session): session closed for user root Nov 18 19:48:50 oleg228-client systemd[1]: session-544.scope: Succeeded. Nov 18 19:48:50 oleg228-client systemd-logind[1015]: Session 544 logged out. Waiting for processes to exit. Nov 18 19:48:50 oleg228-client systemd-logind[1015]: Removed session 544. Nov 18 19:49:18 oleg228-client sshd[105308]: Accepted publickey for root from 192.168.202.28 port 34064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:18 oleg228-client systemd[1]: Started Session 545 of user root. Nov 18 19:49:18 oleg228-client systemd-logind[1015]: New session 545 of user root. Nov 18 19:49:18 oleg228-client sshd[105308]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:18 oleg228-client sshd[105322]: Received disconnect from 192.168.202.28 port 34064:11: disconnected by user Nov 18 19:49:18 oleg228-client sshd[105322]: Disconnected from user root 192.168.202.28 port 34064 Nov 18 19:49:18 oleg228-client sshd[105308]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:18 oleg228-client systemd[1]: session-545.scope: Succeeded. Nov 18 19:49:18 oleg228-client systemd-logind[1015]: Session 545 logged out. Waiting for processes to exit. Nov 18 19:49:18 oleg228-client systemd-logind[1015]: Removed session 545. Nov 18 19:49:21 oleg228-client sshd[105545]: Accepted publickey for root from 192.168.202.28 port 59258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:21 oleg228-client systemd[1]: Started Session 546 of user root. Nov 18 19:49:21 oleg228-client systemd-logind[1015]: New session 546 of user root. Nov 18 19:49:21 oleg228-client sshd[105545]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:22 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Nov 18 19:49:22 oleg228-client sshd[105558]: Received disconnect from 192.168.202.28 port 59258:11: disconnected by user Nov 18 19:49:22 oleg228-client sshd[105558]: Disconnected from user root 192.168.202.28 port 59258 Nov 18 19:49:22 oleg228-client sshd[105545]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:22 oleg228-client systemd[1]: session-546.scope: Succeeded. Nov 18 19:49:22 oleg228-client systemd-logind[1015]: Session 546 logged out. Waiting for processes to exit. Nov 18 19:49:22 oleg228-client systemd-logind[1015]: Removed session 546. Nov 18 19:49:23 oleg228-client sshd[105701]: Accepted publickey for root from 192.168.202.28 port 59274 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:23 oleg228-client systemd-logind[1015]: New session 547 of user root. Nov 18 19:49:23 oleg228-client systemd[1]: Started Session 547 of user root. Nov 18 19:49:23 oleg228-client sshd[105701]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:23 oleg228-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Nov 18 19:49:23 oleg228-client sshd[105715]: Received disconnect from 192.168.202.28 port 59274:11: disconnected by user Nov 18 19:49:23 oleg228-client sshd[105715]: Disconnected from user root 192.168.202.28 port 59274 Nov 18 19:49:23 oleg228-client sshd[105701]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:23 oleg228-client systemd-logind[1015]: Session 547 logged out. Waiting for processes to exit. Nov 18 19:49:23 oleg228-client systemd[1]: session-547.scope: Succeeded. Nov 18 19:49:23 oleg228-client systemd-logind[1015]: Removed session 547. Nov 18 19:49:25 oleg228-client sshd[105756]: Accepted publickey for root from 192.168.202.28 port 59282 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:25 oleg228-client systemd-logind[1015]: New session 548 of user root. Nov 18 19:49:25 oleg228-client systemd[1]: Started Session 548 of user root. Nov 18 19:49:25 oleg228-client sshd[105756]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:25 oleg228-client sshd[105769]: Received disconnect from 192.168.202.28 port 59282:11: disconnected by user Nov 18 19:49:25 oleg228-client sshd[105769]: Disconnected from user root 192.168.202.28 port 59282 Nov 18 19:49:25 oleg228-client sshd[105756]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:25 oleg228-client systemd[1]: session-548.scope: Succeeded. Nov 18 19:49:25 oleg228-client systemd-logind[1015]: Session 548 logged out. Waiting for processes to exit. Nov 18 19:49:25 oleg228-client systemd-logind[1015]: Removed session 548. Nov 18 19:49:26 oleg228-client sshd[105888]: Accepted publickey for root from 192.168.202.28 port 59288 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:26 oleg228-client systemd[1]: Started Session 549 of user root. Nov 18 19:49:26 oleg228-client systemd-logind[1015]: New session 549 of user root. Nov 18 19:49:26 oleg228-client sshd[105888]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:26 oleg228-client sshd[105901]: Received disconnect from 192.168.202.28 port 59288:11: disconnected by user Nov 18 19:49:26 oleg228-client sshd[105901]: Disconnected from user root 192.168.202.28 port 59288 Nov 18 19:49:26 oleg228-client sshd[105888]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:26 oleg228-client systemd[1]: session-549.scope: Succeeded. Nov 18 19:49:26 oleg228-client systemd-logind[1015]: Session 549 logged out. Waiting for processes to exit. Nov 18 19:49:26 oleg228-client systemd-logind[1015]: Removed session 549. Nov 18 19:49:27 oleg228-client sshd[106028]: Accepted publickey for root from 192.168.202.28 port 59292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:27 oleg228-client systemd-logind[1015]: New session 550 of user root. Nov 18 19:49:27 oleg228-client systemd[1]: Started Session 550 of user root. Nov 18 19:49:27 oleg228-client sshd[106028]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:28 oleg228-client sshd[106041]: Received disconnect from 192.168.202.28 port 59292:11: disconnected by user Nov 18 19:49:28 oleg228-client sshd[106041]: Disconnected from user root 192.168.202.28 port 59292 Nov 18 19:49:28 oleg228-client sshd[106028]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:28 oleg228-client systemd[1]: session-550.scope: Succeeded. Nov 18 19:49:28 oleg228-client systemd-logind[1015]: Session 550 logged out. Waiting for processes to exit. Nov 18 19:49:28 oleg228-client systemd-logind[1015]: Removed session 550. Nov 18 19:49:29 oleg228-client sshd[106175]: Accepted publickey for root from 192.168.202.28 port 59302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:49:29 oleg228-client systemd-logind[1015]: New session 551 of user root. Nov 18 19:49:29 oleg228-client systemd[1]: Started Session 551 of user root. Nov 18 19:49:29 oleg228-client sshd[106175]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:49:29 oleg228-client sshd[106188]: Received disconnect from 192.168.202.28 port 59302:11: disconnected by user Nov 18 19:49:29 oleg228-client sshd[106188]: Disconnected from user root 192.168.202.28 port 59302 Nov 18 19:49:29 oleg228-client sshd[106175]: pam_unix(sshd:session): session closed for user root Nov 18 19:49:29 oleg228-client systemd-logind[1015]: Session 551 logged out. Waiting for processes to exit. Nov 18 19:49:29 oleg228-client systemd[1]: session-551.scope: Succeeded. Nov 18 19:49:29 oleg228-client systemd-logind[1015]: Removed session 551. Nov 18 19:50:43 oleg228-client sshd[106376]: Accepted publickey for root from 192.168.202.28 port 33494 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:50:43 oleg228-client systemd-logind[1015]: New session 552 of user root. Nov 18 19:50:43 oleg228-client systemd[1]: Started Session 552 of user root. Nov 18 19:50:43 oleg228-client sshd[106376]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:50:43 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144b: orphan cleanup shouldn't be blocked for no objects+failover situation ========================================================== 19:50:42 (1763513442) Nov 18 19:50:43 oleg228-client sshd[106390]: Received disconnect from 192.168.202.28 port 33494:11: disconnected by user Nov 18 19:50:43 oleg228-client sshd[106390]: Disconnected from user root 192.168.202.28 port 33494 Nov 18 19:50:43 oleg228-client sshd[106376]: pam_unix(sshd:session): session closed for user root Nov 18 19:50:43 oleg228-client systemd[1]: session-552.scope: Succeeded. Nov 18 19:50:43 oleg228-client systemd-logind[1015]: Session 552 logged out. Waiting for processes to exit. Nov 18 19:50:43 oleg228-client systemd-logind[1015]: Removed session 552. Nov 18 19:51:48 oleg228-client sshd[106852]: Accepted publickey for root from 192.168.202.28 port 42832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:51:48 oleg228-client systemd-logind[1015]: New session 553 of user root. Nov 18 19:51:48 oleg228-client systemd[1]: Started Session 553 of user root. Nov 18 19:51:48 oleg228-client sshd[106852]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:51:49 oleg228-client sshd[106865]: Received disconnect from 192.168.202.28 port 42832:11: disconnected by user Nov 18 19:51:49 oleg228-client sshd[106865]: Disconnected from user root 192.168.202.28 port 42832 Nov 18 19:51:49 oleg228-client sshd[106852]: pam_unix(sshd:session): session closed for user root Nov 18 19:51:50 oleg228-client systemd[1]: session-553.scope: Succeeded. Nov 18 19:51:50 oleg228-client systemd-logind[1015]: Session 553 logged out. Waiting for processes to exit. Nov 18 19:51:50 oleg228-client systemd-logind[1015]: Removed session 553. Nov 18 19:51:56 oleg228-client sshd[107089]: Accepted publickey for root from 192.168.202.28 port 50376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:51:56 oleg228-client systemd[1]: Started Session 554 of user root. Nov 18 19:51:56 oleg228-client systemd-logind[1015]: New session 554 of user root. Nov 18 19:51:56 oleg228-client sshd[107089]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:51:56 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 19:51:57 oleg228-client sshd[107103]: Received disconnect from 192.168.202.28 port 50376:11: disconnected by user Nov 18 19:51:57 oleg228-client sshd[107103]: Disconnected from user root 192.168.202.28 port 50376 Nov 18 19:51:57 oleg228-client sshd[107089]: pam_unix(sshd:session): session closed for user root Nov 18 19:51:57 oleg228-client systemd[1]: session-554.scope: Succeeded. Nov 18 19:51:57 oleg228-client systemd-logind[1015]: Session 554 logged out. Waiting for processes to exit. Nov 18 19:51:57 oleg228-client systemd-logind[1015]: Removed session 554. Nov 18 19:51:59 oleg228-client sshd[107245]: Accepted publickey for root from 192.168.202.28 port 50390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:51:59 oleg228-client systemd-logind[1015]: New session 555 of user root. Nov 18 19:51:59 oleg228-client systemd[1]: Started Session 555 of user root. Nov 18 19:51:59 oleg228-client sshd[107245]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:52:00 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 19:52:00 oleg228-client sshd[107259]: Received disconnect from 192.168.202.28 port 50390:11: disconnected by user Nov 18 19:52:00 oleg228-client sshd[107259]: Disconnected from user root 192.168.202.28 port 50390 Nov 18 19:52:00 oleg228-client sshd[107245]: pam_unix(sshd:session): session closed for user root Nov 18 19:52:00 oleg228-client systemd-logind[1015]: Session 555 logged out. Waiting for processes to exit. Nov 18 19:52:00 oleg228-client systemd[1]: session-555.scope: Succeeded. Nov 18 19:52:00 oleg228-client systemd-logind[1015]: Removed session 555. Nov 18 19:52:02 oleg228-client sshd[107300]: Accepted publickey for root from 192.168.202.28 port 35308 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:52:02 oleg228-client systemd[1]: Started Session 556 of user root. Nov 18 19:52:02 oleg228-client systemd-logind[1015]: New session 556 of user root. Nov 18 19:52:02 oleg228-client sshd[107300]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:52:04 oleg228-client sshd[107314]: Received disconnect from 192.168.202.28 port 35308:11: disconnected by user Nov 18 19:52:04 oleg228-client sshd[107314]: Disconnected from user root 192.168.202.28 port 35308 Nov 18 19:52:04 oleg228-client sshd[107300]: pam_unix(sshd:session): session closed for user root Nov 18 19:52:04 oleg228-client systemd[1]: session-556.scope: Succeeded. Nov 18 19:52:04 oleg228-client systemd-logind[1015]: Session 556 logged out. Waiting for processes to exit. Nov 18 19:52:04 oleg228-client systemd-logind[1015]: Removed session 556. Nov 18 19:53:08 oleg228-client sshd[107493]: Accepted publickey for root from 192.168.202.28 port 35068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:53:08 oleg228-client systemd-logind[1015]: New session 557 of user root. Nov 18 19:53:08 oleg228-client systemd[1]: Started Session 557 of user root. Nov 18 19:53:08 oleg228-client sshd[107493]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:53:08 oleg228-client sshd[107506]: Received disconnect from 192.168.202.28 port 35068:11: disconnected by user Nov 18 19:53:08 oleg228-client sshd[107506]: Disconnected from user root 192.168.202.28 port 35068 Nov 18 19:53:08 oleg228-client sshd[107493]: pam_unix(sshd:session): session closed for user root Nov 18 19:53:08 oleg228-client systemd[1]: session-557.scope: Succeeded. Nov 18 19:53:08 oleg228-client systemd-logind[1015]: Session 557 logged out. Waiting for processes to exit. Nov 18 19:53:08 oleg228-client systemd-logind[1015]: Removed session 557. Nov 18 19:53:09 oleg228-client sshd[107632]: Accepted publickey for root from 192.168.202.28 port 35074 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:53:09 oleg228-client systemd-logind[1015]: New session 558 of user root. Nov 18 19:53:09 oleg228-client systemd[1]: Started Session 558 of user root. Nov 18 19:53:09 oleg228-client sshd[107632]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:53:10 oleg228-client sshd[107645]: Received disconnect from 192.168.202.28 port 35074:11: disconnected by user Nov 18 19:53:10 oleg228-client sshd[107645]: Disconnected from user root 192.168.202.28 port 35074 Nov 18 19:53:10 oleg228-client sshd[107632]: pam_unix(sshd:session): session closed for user root Nov 18 19:53:10 oleg228-client systemd[1]: session-558.scope: Succeeded. Nov 18 19:53:10 oleg228-client systemd-logind[1015]: Session 558 logged out. Waiting for processes to exit. Nov 18 19:53:10 oleg228-client systemd-logind[1015]: Removed session 558. Nov 18 19:53:11 oleg228-client sshd[107778]: Accepted publickey for root from 192.168.202.28 port 41244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:53:11 oleg228-client systemd-logind[1015]: New session 559 of user root. Nov 18 19:53:11 oleg228-client systemd[1]: Started Session 559 of user root. Nov 18 19:53:11 oleg228-client sshd[107778]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:53:11 oleg228-client sshd[107791]: Received disconnect from 192.168.202.28 port 41244:11: disconnected by user Nov 18 19:53:11 oleg228-client sshd[107791]: Disconnected from user root 192.168.202.28 port 41244 Nov 18 19:53:11 oleg228-client sshd[107778]: pam_unix(sshd:session): session closed for user root Nov 18 19:53:11 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 19:53:11 oleg228-client systemd[1]: session-559.scope: Succeeded. Nov 18 19:53:11 oleg228-client systemd-logind[1015]: Session 559 logged out. Waiting for processes to exit. Nov 18 19:53:11 oleg228-client systemd-logind[1015]: Removed session 559. Nov 18 19:54:21 oleg228-client sshd[107982]: Accepted publickey for root from 192.168.202.28 port 48056 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:54:21 oleg228-client systemd-logind[1015]: New session 560 of user root. Nov 18 19:54:21 oleg228-client systemd[1]: Started Session 560 of user root. Nov 18 19:54:21 oleg228-client sshd[107982]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:54:22 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 144c: reconnection during orphan cleanup shouldn't lose LAST_ID synchronization ========================================================== 19:54:20 (1763513660) Nov 18 19:54:22 oleg228-client sshd[107995]: Received disconnect from 192.168.202.28 port 48056:11: disconnected by user Nov 18 19:54:22 oleg228-client sshd[107995]: Disconnected from user root 192.168.202.28 port 48056 Nov 18 19:54:22 oleg228-client sshd[107982]: pam_unix(sshd:session): session closed for user root Nov 18 19:54:22 oleg228-client systemd[1]: session-560.scope: Succeeded. Nov 18 19:54:22 oleg228-client systemd-logind[1015]: Session 560 logged out. Waiting for processes to exit. Nov 18 19:54:22 oleg228-client systemd-logind[1015]: Removed session 560. Nov 18 19:54:26 oleg228-client sshd[108177]: Accepted publickey for root from 192.168.202.28 port 48064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:54:26 oleg228-client systemd[1]: Started Session 561 of user root. Nov 18 19:54:26 oleg228-client systemd-logind[1015]: New session 561 of user root. Nov 18 19:54:26 oleg228-client sshd[108177]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:54:27 oleg228-client sshd[108190]: Received disconnect from 192.168.202.28 port 48064:11: disconnected by user Nov 18 19:54:27 oleg228-client sshd[108190]: Disconnected from user root 192.168.202.28 port 48064 Nov 18 19:54:27 oleg228-client sshd[108177]: pam_unix(sshd:session): session closed for user root Nov 18 19:54:27 oleg228-client systemd[1]: session-561.scope: Succeeded. Nov 18 19:54:27 oleg228-client systemd-logind[1015]: Session 561 logged out. Waiting for processes to exit. Nov 18 19:54:27 oleg228-client systemd-logind[1015]: Removed session 561. Nov 18 19:56:21 oleg228-client kernel: Lustre: lustre-MDT0000-mdc-ffff9ccbc7526000: Connection to lustre-MDT0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 19:56:21 oleg228-client kernel: Lustre: Skipped 7 previous similar messages Nov 18 19:56:32 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 19:56:32 oleg228-client kernel: LustreError: Skipped 5 previous similar messages Nov 18 19:56:32 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b25f3e5b1 to 0x2622672b260388d1 Nov 18 19:56:32 oleg228-client kernel: Lustre: Skipped 5 previous similar messages Nov 18 19:56:32 oleg228-client kernel: Lustre: MGC192.168.202.128@tcp: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 19:56:32 oleg228-client kernel: Lustre: Skipped 13 previous similar messages Nov 18 19:56:57 oleg228-client sshd[108691]: Accepted publickey for root from 192.168.202.28 port 44738 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:56:57 oleg228-client systemd[1]: Started Session 562 of user root. Nov 18 19:56:57 oleg228-client systemd-logind[1015]: New session 562 of user root. Nov 18 19:56:57 oleg228-client sshd[108691]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:56:57 oleg228-client sshd[108704]: Received disconnect from 192.168.202.28 port 44738:11: disconnected by user Nov 18 19:56:57 oleg228-client sshd[108704]: Disconnected from user root 192.168.202.28 port 44738 Nov 18 19:56:57 oleg228-client sshd[108691]: pam_unix(sshd:session): session closed for user root Nov 18 19:56:57 oleg228-client systemd[1]: session-562.scope: Succeeded. Nov 18 19:56:57 oleg228-client systemd-logind[1015]: Session 562 logged out. Waiting for processes to exit. Nov 18 19:56:57 oleg228-client systemd-logind[1015]: Removed session 562. Nov 18 19:56:58 oleg228-client sshd[108830]: Accepted publickey for root from 192.168.202.28 port 44746 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:56:58 oleg228-client systemd-logind[1015]: New session 563 of user root. Nov 18 19:56:58 oleg228-client systemd[1]: Started Session 563 of user root. Nov 18 19:56:58 oleg228-client sshd[108830]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:56:58 oleg228-client sshd[108843]: Received disconnect from 192.168.202.28 port 44746:11: disconnected by user Nov 18 19:56:58 oleg228-client sshd[108843]: Disconnected from user root 192.168.202.28 port 44746 Nov 18 19:56:58 oleg228-client sshd[108830]: pam_unix(sshd:session): session closed for user root Nov 18 19:56:58 oleg228-client systemd[1]: session-563.scope: Succeeded. Nov 18 19:56:58 oleg228-client systemd-logind[1015]: Session 563 logged out. Waiting for processes to exit. Nov 18 19:56:58 oleg228-client systemd-logind[1015]: Removed session 563. Nov 18 19:56:59 oleg228-client sshd[108976]: Accepted publickey for root from 192.168.202.28 port 44752 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:56:59 oleg228-client systemd-logind[1015]: New session 564 of user root. Nov 18 19:56:59 oleg228-client systemd[1]: Started Session 564 of user root. Nov 18 19:56:59 oleg228-client sshd[108976]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:56:59 oleg228-client sshd[108989]: Received disconnect from 192.168.202.28 port 44752:11: disconnected by user Nov 18 19:56:59 oleg228-client sshd[108989]: Disconnected from user root 192.168.202.28 port 44752 Nov 18 19:56:59 oleg228-client sshd[108976]: pam_unix(sshd:session): session closed for user root Nov 18 19:56:59 oleg228-client systemd[1]: session-564.scope: Succeeded. Nov 18 19:56:59 oleg228-client systemd-logind[1015]: Session 564 logged out. Waiting for processes to exit. Nov 18 19:56:59 oleg228-client systemd-logind[1015]: Removed session 564. Nov 18 19:57:00 oleg228-client sshd[109131]: Accepted publickey for root from 192.168.202.28 port 44762 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:00 oleg228-client systemd-logind[1015]: New session 565 of user root. Nov 18 19:57:00 oleg228-client systemd[1]: Started Session 565 of user root. Nov 18 19:57:00 oleg228-client sshd[109131]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:01 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 145: connect mdtlovs and process update logs after recovery expire ========================================================== 19:57:00 (1763513820) Nov 18 19:57:01 oleg228-client sshd[109144]: Received disconnect from 192.168.202.28 port 44762:11: disconnected by user Nov 18 19:57:01 oleg228-client sshd[109144]: Disconnected from user root 192.168.202.28 port 44762 Nov 18 19:57:01 oleg228-client sshd[109131]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:01 oleg228-client systemd[1]: session-565.scope: Succeeded. Nov 18 19:57:01 oleg228-client systemd-logind[1015]: Session 565 logged out. Waiting for processes to exit. Nov 18 19:57:01 oleg228-client systemd-logind[1015]: Removed session 565. Nov 18 19:57:01 oleg228-client sshd[109269]: Accepted publickey for root from 192.168.202.28 port 51812 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:01 oleg228-client systemd-logind[1015]: New session 566 of user root. Nov 18 19:57:01 oleg228-client systemd[1]: Started Session 566 of user root. Nov 18 19:57:01 oleg228-client sshd[109269]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:02 oleg228-client kernel: Lustre: DEBUG MARKER: SKIP: recovery-small test_145 needs >= 3 MDTs Nov 18 19:57:02 oleg228-client sshd[109282]: Received disconnect from 192.168.202.28 port 51812:11: disconnected by user Nov 18 19:57:02 oleg228-client sshd[109282]: Disconnected from user root 192.168.202.28 port 51812 Nov 18 19:57:02 oleg228-client sshd[109269]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:02 oleg228-client systemd[1]: session-566.scope: Succeeded. Nov 18 19:57:02 oleg228-client systemd-logind[1015]: Session 566 logged out. Waiting for processes to exit. Nov 18 19:57:02 oleg228-client systemd-logind[1015]: Removed session 566. Nov 18 19:57:03 oleg228-client sshd[109424]: Accepted publickey for root from 192.168.202.28 port 51816 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:03 oleg228-client systemd-logind[1015]: New session 567 of user root. Nov 18 19:57:03 oleg228-client systemd[1]: Started Session 567 of user root. Nov 18 19:57:03 oleg228-client sshd[109424]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:03 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 146: test eviction is counted properly ========================================================== 19:57:02 (1763513822) Nov 18 19:57:03 oleg228-client sshd[109437]: Received disconnect from 192.168.202.28 port 51816:11: disconnected by user Nov 18 19:57:03 oleg228-client sshd[109437]: Disconnected from user root 192.168.202.28 port 51816 Nov 18 19:57:03 oleg228-client sshd[109424]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:03 oleg228-client systemd[1]: session-567.scope: Succeeded. Nov 18 19:57:03 oleg228-client systemd-logind[1015]: Session 567 logged out. Waiting for processes to exit. Nov 18 19:57:03 oleg228-client systemd-logind[1015]: Removed session 567. Nov 18 19:57:05 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc7526000: operation ldlm_enqueue to node 192.168.202.128@tcp failed: rc = -107 Nov 18 19:57:05 oleg228-client kernel: LustreError: Skipped 425 previous similar messages Nov 18 19:57:05 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc7526000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 19:57:06 oleg228-client sshd[109602]: Accepted publickey for root from 192.168.202.28 port 51832 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:06 oleg228-client systemd-logind[1015]: New session 568 of user root. Nov 18 19:57:06 oleg228-client systemd[1]: Started Session 568 of user root. Nov 18 19:57:06 oleg228-client sshd[109602]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:07 oleg228-client sshd[109615]: Received disconnect from 192.168.202.28 port 51832:11: disconnected by user Nov 18 19:57:07 oleg228-client sshd[109615]: Disconnected from user root 192.168.202.28 port 51832 Nov 18 19:57:07 oleg228-client sshd[109602]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:07 oleg228-client systemd-logind[1015]: Session 568 logged out. Waiting for processes to exit. Nov 18 19:57:07 oleg228-client systemd[1]: session-568.scope: Succeeded. Nov 18 19:57:07 oleg228-client systemd-logind[1015]: Removed session 568. Nov 18 19:57:07 oleg228-client sshd[109741]: Accepted publickey for root from 192.168.202.28 port 51834 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:08 oleg228-client systemd-logind[1015]: New session 569 of user root. Nov 18 19:57:08 oleg228-client systemd[1]: Started Session 569 of user root. Nov 18 19:57:08 oleg228-client sshd[109741]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:08 oleg228-client sshd[109754]: Received disconnect from 192.168.202.28 port 51834:11: disconnected by user Nov 18 19:57:08 oleg228-client sshd[109754]: Disconnected from user root 192.168.202.28 port 51834 Nov 18 19:57:08 oleg228-client sshd[109741]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:08 oleg228-client systemd[1]: session-569.scope: Succeeded. Nov 18 19:57:08 oleg228-client systemd-logind[1015]: Session 569 logged out. Waiting for processes to exit. Nov 18 19:57:08 oleg228-client systemd-logind[1015]: Removed session 569. Nov 18 19:57:09 oleg228-client sshd[109885]: Accepted publickey for root from 192.168.202.28 port 51844 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:09 oleg228-client systemd-logind[1015]: New session 570 of user root. Nov 18 19:57:09 oleg228-client systemd[1]: Started Session 570 of user root. Nov 18 19:57:09 oleg228-client sshd[109885]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:09 oleg228-client sshd[109900]: Received disconnect from 192.168.202.28 port 51844:11: disconnected by user Nov 18 19:57:09 oleg228-client sshd[109900]: Disconnected from user root 192.168.202.28 port 51844 Nov 18 19:57:09 oleg228-client sshd[109885]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:09 oleg228-client systemd[1]: session-570.scope: Succeeded. Nov 18 19:57:09 oleg228-client systemd-logind[1015]: Session 570 logged out. Waiting for processes to exit. Nov 18 19:57:09 oleg228-client systemd-logind[1015]: Removed session 570. Nov 18 19:57:10 oleg228-client sshd[110043]: Accepted publickey for root from 192.168.202.28 port 51858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:57:10 oleg228-client systemd-logind[1015]: New session 571 of user root. Nov 18 19:57:10 oleg228-client systemd[1]: Started Session 571 of user root. Nov 18 19:57:10 oleg228-client sshd[110043]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:57:10 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 147: Check client reconnect ======= 19:57:09 (1763513829) Nov 18 19:57:10 oleg228-client sshd[110056]: Received disconnect from 192.168.202.28 port 51858:11: disconnected by user Nov 18 19:57:10 oleg228-client sshd[110056]: Disconnected from user root 192.168.202.28 port 51858 Nov 18 19:57:10 oleg228-client sshd[110043]: pam_unix(sshd:session): session closed for user root Nov 18 19:57:10 oleg228-client systemd[1]: session-571.scope: Succeeded. Nov 18 19:57:10 oleg228-client systemd-logind[1015]: Session 571 logged out. Waiting for processes to exit. Nov 18 19:57:10 oleg228-client systemd-logind[1015]: Removed session 571. Nov 18 19:59:42 oleg228-client sshd[110235]: Accepted publickey for root from 192.168.202.28 port 47394 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:59:42 oleg228-client systemd-logind[1015]: New session 572 of user root. Nov 18 19:59:42 oleg228-client systemd[1]: Started Session 572 of user root. Nov 18 19:59:42 oleg228-client sshd[110235]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:59:43 oleg228-client sshd[110248]: Received disconnect from 192.168.202.28 port 47394:11: disconnected by user Nov 18 19:59:43 oleg228-client sshd[110248]: Disconnected from user root 192.168.202.28 port 47394 Nov 18 19:59:43 oleg228-client sshd[110235]: pam_unix(sshd:session): session closed for user root Nov 18 19:59:43 oleg228-client systemd[1]: session-572.scope: Succeeded. Nov 18 19:59:43 oleg228-client systemd-logind[1015]: Session 572 logged out. Waiting for processes to exit. Nov 18 19:59:43 oleg228-client systemd-logind[1015]: Removed session 572. Nov 18 19:59:44 oleg228-client sshd[110376]: Accepted publickey for root from 192.168.202.28 port 47398 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:59:44 oleg228-client systemd[1]: Started Session 573 of user root. Nov 18 19:59:44 oleg228-client systemd-logind[1015]: New session 573 of user root. Nov 18 19:59:44 oleg228-client sshd[110376]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:59:44 oleg228-client sshd[110389]: Received disconnect from 192.168.202.28 port 47398:11: disconnected by user Nov 18 19:59:44 oleg228-client sshd[110389]: Disconnected from user root 192.168.202.28 port 47398 Nov 18 19:59:44 oleg228-client sshd[110376]: pam_unix(sshd:session): session closed for user root Nov 18 19:59:44 oleg228-client systemd[1]: session-573.scope: Succeeded. Nov 18 19:59:44 oleg228-client systemd-logind[1015]: Session 573 logged out. Waiting for processes to exit. Nov 18 19:59:44 oleg228-client systemd-logind[1015]: Removed session 573. Nov 18 19:59:45 oleg228-client sshd[110522]: Accepted publickey for root from 192.168.202.28 port 47406 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 19:59:45 oleg228-client systemd[1]: Started Session 574 of user root. Nov 18 19:59:45 oleg228-client systemd-logind[1015]: New session 574 of user root. Nov 18 19:59:45 oleg228-client sshd[110522]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 19:59:45 oleg228-client sshd[110535]: Received disconnect from 192.168.202.28 port 47406:11: disconnected by user Nov 18 19:59:45 oleg228-client sshd[110535]: Disconnected from user root 192.168.202.28 port 47406 Nov 18 19:59:45 oleg228-client sshd[110522]: pam_unix(sshd:session): session closed for user root Nov 18 19:59:45 oleg228-client systemd-logind[1015]: Session 574 logged out. Waiting for processes to exit. Nov 18 19:59:45 oleg228-client systemd[1]: session-574.scope: Succeeded. Nov 18 19:59:45 oleg228-client systemd-logind[1015]: Removed session 574. Nov 18 19:59:59 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc7526000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 20:00:00 oleg228-client sshd[110702]: Accepted publickey for root from 192.168.202.28 port 37326 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:00:00 oleg228-client systemd-logind[1015]: New session 575 of user root. Nov 18 20:00:00 oleg228-client systemd[1]: Started Session 575 of user root. Nov 18 20:00:00 oleg228-client sshd[110702]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:00:00 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 148: data corruption through resend ========================================================== 19:59:59 (1763513999) Nov 18 20:00:00 oleg228-client sshd[110715]: Received disconnect from 192.168.202.28 port 37326:11: disconnected by user Nov 18 20:00:00 oleg228-client sshd[110715]: Disconnected from user root 192.168.202.28 port 37326 Nov 18 20:00:00 oleg228-client sshd[110702]: pam_unix(sshd:session): session closed for user root Nov 18 20:00:00 oleg228-client systemd[1]: session-575.scope: Succeeded. Nov 18 20:00:00 oleg228-client systemd-logind[1015]: Session 575 logged out. Waiting for processes to exit. Nov 18 20:00:00 oleg228-client systemd-logind[1015]: Removed session 575. Nov 18 20:00:26 oleg228-client kernel: Lustre: 2408:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1763514006/real 1763514006] req@ffff9ccbc5e78700 x1849171086860928/t0(0) o4->lustre-OST0000-osc-ffff9ccbc7526000@192.168.202.128@tcp:6/4 lens 4584/448 e 0 to 1 dl 1763514026 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 Nov 18 20:00:37 oleg228-client sshd[111092]: Accepted publickey for root from 192.168.202.28 port 51926 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:00:37 oleg228-client systemd[1]: Started Session 576 of user root. Nov 18 20:00:37 oleg228-client systemd-logind[1015]: New session 576 of user root. Nov 18 20:00:37 oleg228-client sshd[111092]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:00:38 oleg228-client sshd[111105]: Received disconnect from 192.168.202.28 port 51926:11: disconnected by user Nov 18 20:00:38 oleg228-client sshd[111105]: Disconnected from user root 192.168.202.28 port 51926 Nov 18 20:00:38 oleg228-client sshd[111092]: pam_unix(sshd:session): session closed for user root Nov 18 20:00:38 oleg228-client systemd[1]: session-576.scope: Succeeded. Nov 18 20:00:38 oleg228-client systemd-logind[1015]: Session 576 logged out. Waiting for processes to exit. Nov 18 20:00:38 oleg228-client systemd-logind[1015]: Removed session 576. Nov 18 20:00:38 oleg228-client sshd[111231]: Accepted publickey for root from 192.168.202.28 port 51932 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:00:38 oleg228-client systemd[1]: Started Session 577 of user root. Nov 18 20:00:38 oleg228-client systemd-logind[1015]: New session 577 of user root. Nov 18 20:00:38 oleg228-client sshd[111231]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:00:38 oleg228-client sshd[111244]: Received disconnect from 192.168.202.28 port 51932:11: disconnected by user Nov 18 20:00:39 oleg228-client sshd[111244]: Disconnected from user root 192.168.202.28 port 51932 Nov 18 20:00:39 oleg228-client sshd[111231]: pam_unix(sshd:session): session closed for user root Nov 18 20:00:39 oleg228-client systemd[1]: session-577.scope: Succeeded. Nov 18 20:00:39 oleg228-client systemd-logind[1015]: Session 577 logged out. Waiting for processes to exit. Nov 18 20:00:39 oleg228-client systemd-logind[1015]: Removed session 577. Nov 18 20:00:39 oleg228-client sshd[111377]: Accepted publickey for root from 192.168.202.28 port 51938 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:00:39 oleg228-client systemd-logind[1015]: New session 578 of user root. Nov 18 20:00:39 oleg228-client systemd[1]: Started Session 578 of user root. Nov 18 20:00:39 oleg228-client sshd[111377]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:00:40 oleg228-client sshd[111390]: Received disconnect from 192.168.202.28 port 51938:11: disconnected by user Nov 18 20:00:40 oleg228-client sshd[111390]: Disconnected from user root 192.168.202.28 port 51938 Nov 18 20:00:40 oleg228-client sshd[111377]: pam_unix(sshd:session): session closed for user root Nov 18 20:00:40 oleg228-client systemd[1]: session-578.scope: Succeeded. Nov 18 20:00:40 oleg228-client systemd-logind[1015]: Session 578 logged out. Waiting for processes to exit. Nov 18 20:00:40 oleg228-client systemd-logind[1015]: Removed session 578. Nov 18 20:00:41 oleg228-client sshd[111532]: Accepted publickey for root from 192.168.202.28 port 35724 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:00:41 oleg228-client systemd-logind[1015]: New session 579 of user root. Nov 18 20:00:41 oleg228-client systemd[1]: Started Session 579 of user root. Nov 18 20:00:41 oleg228-client sshd[111532]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:00:41 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 149: skip orphan removal at umount ========================================================== 20:00:40 (1763514040) Nov 18 20:00:41 oleg228-client sshd[111545]: Received disconnect from 192.168.202.28 port 35724:11: disconnected by user Nov 18 20:00:41 oleg228-client sshd[111545]: Disconnected from user root 192.168.202.28 port 35724 Nov 18 20:00:41 oleg228-client sshd[111532]: pam_unix(sshd:session): session closed for user root Nov 18 20:00:41 oleg228-client systemd[1]: session-579.scope: Succeeded. Nov 18 20:00:41 oleg228-client systemd-logind[1015]: Session 579 logged out. Waiting for processes to exit. Nov 18 20:00:41 oleg228-client systemd-logind[1015]: Removed session 579. Nov 18 20:01:01 oleg228-client CROND[111822]: (root) CMD (run-parts /etc/cron.hourly) Nov 18 20:01:01 oleg228-client run-parts[111822]: (/etc/cron.hourly) starting 0anacron Nov 18 20:01:01 oleg228-client run-parts[111822]: (/etc/cron.hourly) finished 0anacron Nov 18 20:01:17 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc7526000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 20:01:17 oleg228-client kernel: LustreError: 111589:0:(file.c:249:ll_close_inode_openhandle()) lustre-clilmv-ffff9ccbc7526000: inode [0x2000105d1:0x6:0x0] mdc close failed: rc = -5 Nov 18 20:01:17 oleg228-client kernel: LustreError: lustre-MDT0001-mdc-ffff9ccbc7526000: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Nov 18 20:01:19 oleg228-client sshd[112054]: Accepted publickey for root from 192.168.202.28 port 33060 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:19 oleg228-client systemd-logind[1015]: New session 580 of user root. Nov 18 20:01:19 oleg228-client systemd[1]: Started Session 580 of user root. Nov 18 20:01:19 oleg228-client sshd[112054]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:19 oleg228-client sshd[112067]: Received disconnect from 192.168.202.28 port 33060:11: disconnected by user Nov 18 20:01:19 oleg228-client sshd[112067]: Disconnected from user root 192.168.202.28 port 33060 Nov 18 20:01:19 oleg228-client sshd[112054]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:19 oleg228-client systemd[1]: session-580.scope: Succeeded. Nov 18 20:01:19 oleg228-client systemd-logind[1015]: Session 580 logged out. Waiting for processes to exit. Nov 18 20:01:19 oleg228-client systemd-logind[1015]: Removed session 580. Nov 18 20:01:20 oleg228-client sshd[112186]: Accepted publickey for root from 192.168.202.28 port 33064 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:20 oleg228-client systemd-logind[1015]: New session 581 of user root. Nov 18 20:01:20 oleg228-client systemd[1]: Started Session 581 of user root. Nov 18 20:01:20 oleg228-client sshd[112186]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:20 oleg228-client sshd[112199]: Received disconnect from 192.168.202.28 port 33064:11: disconnected by user Nov 18 20:01:20 oleg228-client sshd[112199]: Disconnected from user root 192.168.202.28 port 33064 Nov 18 20:01:20 oleg228-client sshd[112186]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:20 oleg228-client systemd[1]: session-581.scope: Succeeded. Nov 18 20:01:20 oleg228-client systemd-logind[1015]: Session 581 logged out. Waiting for processes to exit. Nov 18 20:01:20 oleg228-client systemd-logind[1015]: Removed session 581. Nov 18 20:01:21 oleg228-client sshd[112325]: Accepted publickey for root from 192.168.202.28 port 48622 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:21 oleg228-client systemd-logind[1015]: New session 582 of user root. Nov 18 20:01:21 oleg228-client systemd[1]: Started Session 582 of user root. Nov 18 20:01:21 oleg228-client sshd[112325]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:21 oleg228-client sshd[112338]: Received disconnect from 192.168.202.28 port 48622:11: disconnected by user Nov 18 20:01:21 oleg228-client sshd[112338]: Disconnected from user root 192.168.202.28 port 48622 Nov 18 20:01:21 oleg228-client sshd[112325]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:21 oleg228-client systemd[1]: session-582.scope: Succeeded. Nov 18 20:01:21 oleg228-client systemd-logind[1015]: Session 582 logged out. Waiting for processes to exit. Nov 18 20:01:21 oleg228-client systemd-logind[1015]: Removed session 582. Nov 18 20:01:22 oleg228-client sshd[112473]: Accepted publickey for root from 192.168.202.28 port 48634 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:22 oleg228-client systemd-logind[1015]: New session 583 of user root. Nov 18 20:01:22 oleg228-client systemd[1]: Started Session 583 of user root. Nov 18 20:01:22 oleg228-client sshd[112473]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:22 oleg228-client sshd[112486]: Received disconnect from 192.168.202.28 port 48634:11: disconnected by user Nov 18 20:01:22 oleg228-client sshd[112486]: Disconnected from user root 192.168.202.28 port 48634 Nov 18 20:01:22 oleg228-client sshd[112473]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:22 oleg228-client systemd-logind[1015]: Session 583 logged out. Waiting for processes to exit. Nov 18 20:01:22 oleg228-client systemd[1]: session-583.scope: Succeeded. Nov 18 20:01:22 oleg228-client systemd-logind[1015]: Removed session 583. Nov 18 20:01:23 oleg228-client sshd[112628]: Accepted publickey for root from 192.168.202.28 port 48648 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:23 oleg228-client systemd[1]: Started Session 584 of user root. Nov 18 20:01:23 oleg228-client systemd-logind[1015]: New session 584 of user root. Nov 18 20:01:23 oleg228-client sshd[112628]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:24 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 150: statfs when MDT0 offline with lazystatfs option ========================================================== 20:01:23 (1763514083) Nov 18 20:01:24 oleg228-client sshd[112641]: Received disconnect from 192.168.202.28 port 48648:11: disconnected by user Nov 18 20:01:24 oleg228-client sshd[112641]: Disconnected from user root 192.168.202.28 port 48648 Nov 18 20:01:24 oleg228-client sshd[112628]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:24 oleg228-client systemd[1]: session-584.scope: Succeeded. Nov 18 20:01:24 oleg228-client systemd-logind[1015]: Session 584 logged out. Waiting for processes to exit. Nov 18 20:01:24 oleg228-client systemd-logind[1015]: Removed session 584. Nov 18 20:01:27 oleg228-client kernel: LustreError: 112731:0:(lmv_obd.c:1435:lmv_statfs()) lustre-MDT0000-mdc-ffff9ccbc7526000: can't stat MDS #0: rc = -107 Nov 18 20:01:28 oleg228-client sshd[112818]: Accepted publickey for root from 192.168.202.28 port 48660 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:28 oleg228-client systemd-logind[1015]: New session 585 of user root. Nov 18 20:01:28 oleg228-client systemd[1]: Started Session 585 of user root. Nov 18 20:01:28 oleg228-client sshd[112818]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:28 oleg228-client sshd[112831]: Received disconnect from 192.168.202.28 port 48660:11: disconnected by user Nov 18 20:01:28 oleg228-client sshd[112831]: Disconnected from user root 192.168.202.28 port 48660 Nov 18 20:01:28 oleg228-client sshd[112818]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:28 oleg228-client systemd[1]: session-585.scope: Succeeded. Nov 18 20:01:28 oleg228-client systemd-logind[1015]: Session 585 logged out. Waiting for processes to exit. Nov 18 20:01:28 oleg228-client systemd-logind[1015]: Removed session 585. Nov 18 20:01:29 oleg228-client sshd[112957]: Accepted publickey for root from 192.168.202.28 port 48670 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:29 oleg228-client systemd-logind[1015]: New session 586 of user root. Nov 18 20:01:29 oleg228-client systemd[1]: Started Session 586 of user root. Nov 18 20:01:29 oleg228-client sshd[112957]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:29 oleg228-client sshd[112970]: Received disconnect from 192.168.202.28 port 48670:11: disconnected by user Nov 18 20:01:29 oleg228-client sshd[112970]: Disconnected from user root 192.168.202.28 port 48670 Nov 18 20:01:30 oleg228-client sshd[112957]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:30 oleg228-client systemd[1]: session-586.scope: Succeeded. Nov 18 20:01:30 oleg228-client systemd-logind[1015]: Session 586 logged out. Waiting for processes to exit. Nov 18 20:01:30 oleg228-client systemd-logind[1015]: Removed session 586. Nov 18 20:01:30 oleg228-client sshd[113103]: Accepted publickey for root from 192.168.202.28 port 48682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:30 oleg228-client systemd[1]: Started Session 587 of user root. Nov 18 20:01:30 oleg228-client systemd-logind[1015]: New session 587 of user root. Nov 18 20:01:30 oleg228-client sshd[113103]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:31 oleg228-client sshd[113116]: Received disconnect from 192.168.202.28 port 48682:11: disconnected by user Nov 18 20:01:31 oleg228-client sshd[113116]: Disconnected from user root 192.168.202.28 port 48682 Nov 18 20:01:31 oleg228-client sshd[113103]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:31 oleg228-client systemd[1]: session-587.scope: Succeeded. Nov 18 20:01:31 oleg228-client systemd-logind[1015]: Session 587 logged out. Waiting for processes to exit. Nov 18 20:01:31 oleg228-client systemd-logind[1015]: Removed session 587. Nov 18 20:01:46 oleg228-client sshd[113380]: Accepted publickey for root from 192.168.202.28 port 60220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:46 oleg228-client systemd-logind[1015]: New session 588 of user root. Nov 18 20:01:46 oleg228-client systemd[1]: Started Session 588 of user root. Nov 18 20:01:46 oleg228-client sshd[113380]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:47 oleg228-client sshd[113393]: Received disconnect from 192.168.202.28 port 60220:11: disconnected by user Nov 18 20:01:47 oleg228-client sshd[113393]: Disconnected from user root 192.168.202.28 port 60220 Nov 18 20:01:47 oleg228-client sshd[113380]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:47 oleg228-client systemd[1]: session-588.scope: Succeeded. Nov 18 20:01:47 oleg228-client systemd-logind[1015]: Session 588 logged out. Waiting for processes to exit. Nov 18 20:01:47 oleg228-client systemd-logind[1015]: Removed session 588. Nov 18 20:01:48 oleg228-client sshd[113533]: Accepted publickey for root from 192.168.202.28 port 60222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:01:48 oleg228-client systemd[1]: Started Session 589 of user root. Nov 18 20:01:48 oleg228-client systemd-logind[1015]: New session 589 of user root. Nov 18 20:01:48 oleg228-client sshd[113533]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:01:48 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 152: QoS object allocation could be awakened in case of OST failover ========================================================== 20:01:47 (1763514107) Nov 18 20:01:48 oleg228-client sshd[113546]: Received disconnect from 192.168.202.28 port 60222:11: disconnected by user Nov 18 20:01:48 oleg228-client sshd[113546]: Disconnected from user root 192.168.202.28 port 60222 Nov 18 20:01:48 oleg228-client sshd[113533]: pam_unix(sshd:session): session closed for user root Nov 18 20:01:49 oleg228-client systemd[1]: session-589.scope: Succeeded. Nov 18 20:01:49 oleg228-client systemd-logind[1015]: Session 589 logged out. Waiting for processes to exit. Nov 18 20:01:49 oleg228-client systemd-logind[1015]: Removed session 589. Nov 18 20:02:14 oleg228-client sshd[113766]: Accepted publickey for root from 192.168.202.28 port 49880 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:02:14 oleg228-client systemd[1]: Started Session 590 of user root. Nov 18 20:02:14 oleg228-client systemd-logind[1015]: New session 590 of user root. Nov 18 20:02:14 oleg228-client sshd[113766]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:02:14 oleg228-client sshd[113779]: Received disconnect from 192.168.202.28 port 49880:11: disconnected by user Nov 18 20:02:14 oleg228-client sshd[113779]: Disconnected from user root 192.168.202.28 port 49880 Nov 18 20:02:14 oleg228-client sshd[113766]: pam_unix(sshd:session): session closed for user root Nov 18 20:02:14 oleg228-client systemd[1]: session-590.scope: Succeeded. Nov 18 20:02:14 oleg228-client systemd-logind[1015]: Session 590 logged out. Waiting for processes to exit. Nov 18 20:02:15 oleg228-client systemd-logind[1015]: Removed session 590. Nov 18 20:02:16 oleg228-client sshd[113905]: Accepted publickey for root from 192.168.202.28 port 49884 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:02:16 oleg228-client systemd-logind[1015]: New session 591 of user root. Nov 18 20:02:16 oleg228-client systemd[1]: Started Session 591 of user root. Nov 18 20:02:16 oleg228-client sshd[113905]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:02:16 oleg228-client sshd[113918]: Received disconnect from 192.168.202.28 port 49884:11: disconnected by user Nov 18 20:02:16 oleg228-client sshd[113918]: Disconnected from user root 192.168.202.28 port 49884 Nov 18 20:02:16 oleg228-client sshd[113905]: pam_unix(sshd:session): session closed for user root Nov 18 20:02:16 oleg228-client systemd[1]: session-591.scope: Succeeded. Nov 18 20:02:16 oleg228-client systemd-logind[1015]: Session 591 logged out. Waiting for processes to exit. Nov 18 20:02:16 oleg228-client systemd-logind[1015]: Removed session 591. Nov 18 20:02:17 oleg228-client sshd[114051]: Accepted publickey for root from 192.168.202.28 port 49886 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:02:17 oleg228-client systemd-logind[1015]: New session 592 of user root. Nov 18 20:02:17 oleg228-client systemd[1]: Started Session 592 of user root. Nov 18 20:02:17 oleg228-client sshd[114051]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:02:18 oleg228-client sshd[114064]: Received disconnect from 192.168.202.28 port 49886:11: disconnected by user Nov 18 20:02:18 oleg228-client sshd[114064]: Disconnected from user root 192.168.202.28 port 49886 Nov 18 20:02:18 oleg228-client sshd[114051]: pam_unix(sshd:session): session closed for user root Nov 18 20:02:18 oleg228-client systemd[1]: session-592.scope: Succeeded. Nov 18 20:02:18 oleg228-client systemd-logind[1015]: Session 592 logged out. Waiting for processes to exit. Nov 18 20:02:18 oleg228-client systemd-logind[1015]: Removed session 592. Nov 18 20:02:21 oleg228-client sshd[114218]: Accepted publickey for root from 192.168.202.28 port 52336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:02:21 oleg228-client systemd[1]: Started Session 593 of user root. Nov 18 20:02:21 oleg228-client systemd-logind[1015]: New session 593 of user root. Nov 18 20:02:21 oleg228-client sshd[114218]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:02:21 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 153: evict vs reconnect race ====== 20:02:20 (1763514140) Nov 18 20:02:21 oleg228-client sshd[114231]: Received disconnect from 192.168.202.28 port 52336:11: disconnected by user Nov 18 20:02:21 oleg228-client sshd[114231]: Disconnected from user root 192.168.202.28 port 52336 Nov 18 20:02:21 oleg228-client sshd[114218]: pam_unix(sshd:session): session closed for user root Nov 18 20:02:21 oleg228-client systemd[1]: session-593.scope: Succeeded. Nov 18 20:02:21 oleg228-client systemd-logind[1015]: Session 593 logged out. Waiting for processes to exit. Nov 18 20:02:21 oleg228-client systemd-logind[1015]: Removed session 593. Nov 18 20:03:09 oleg228-client sshd[114637]: Accepted publickey for root from 192.168.202.28 port 45890 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:03:09 oleg228-client systemd-logind[1015]: New session 594 of user root. Nov 18 20:03:09 oleg228-client systemd[1]: Started Session 594 of user root. Nov 18 20:03:09 oleg228-client sshd[114637]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:03:10 oleg228-client sshd[114650]: Received disconnect from 192.168.202.28 port 45890:11: disconnected by user Nov 18 20:03:10 oleg228-client sshd[114650]: Disconnected from user root 192.168.202.28 port 45890 Nov 18 20:03:10 oleg228-client sshd[114637]: pam_unix(sshd:session): session closed for user root Nov 18 20:03:10 oleg228-client systemd-logind[1015]: Session 594 logged out. Waiting for processes to exit. Nov 18 20:03:10 oleg228-client systemd[1]: session-594.scope: Succeeded. Nov 18 20:03:10 oleg228-client systemd-logind[1015]: Removed session 594. Nov 18 20:03:11 oleg228-client sshd[114776]: Accepted publickey for root from 192.168.202.28 port 36198 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:03:11 oleg228-client systemd[1]: Started Session 595 of user root. Nov 18 20:03:11 oleg228-client systemd-logind[1015]: New session 595 of user root. Nov 18 20:03:11 oleg228-client sshd[114776]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:03:11 oleg228-client sshd[114789]: Received disconnect from 192.168.202.28 port 36198:11: disconnected by user Nov 18 20:03:11 oleg228-client sshd[114789]: Disconnected from user root 192.168.202.28 port 36198 Nov 18 20:03:11 oleg228-client sshd[114776]: pam_unix(sshd:session): session closed for user root Nov 18 20:03:12 oleg228-client systemd-logind[1015]: Session 595 logged out. Waiting for processes to exit. Nov 18 20:03:12 oleg228-client systemd[1]: session-595.scope: Succeeded. Nov 18 20:03:12 oleg228-client systemd-logind[1015]: Removed session 595. Nov 18 20:03:13 oleg228-client sshd[114922]: Accepted publickey for root from 192.168.202.28 port 36204 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:03:13 oleg228-client systemd-logind[1015]: New session 596 of user root. Nov 18 20:03:13 oleg228-client systemd[1]: Started Session 596 of user root. Nov 18 20:03:13 oleg228-client sshd[114922]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:03:13 oleg228-client sshd[114935]: Received disconnect from 192.168.202.28 port 36204:11: disconnected by user Nov 18 20:03:14 oleg228-client sshd[114935]: Disconnected from user root 192.168.202.28 port 36204 Nov 18 20:03:14 oleg228-client sshd[114922]: pam_unix(sshd:session): session closed for user root Nov 18 20:03:14 oleg228-client systemd-logind[1015]: Session 596 logged out. Waiting for processes to exit. Nov 18 20:03:14 oleg228-client systemd[1]: session-596.scope: Succeeded. Nov 18 20:03:14 oleg228-client systemd-logind[1015]: Removed session 596. Nov 18 20:03:15 oleg228-client sshd[115079]: Accepted publickey for root from 192.168.202.28 port 36208 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:03:15 oleg228-client systemd-logind[1015]: New session 597 of user root. Nov 18 20:03:15 oleg228-client systemd[1]: Started Session 597 of user root. Nov 18 20:03:15 oleg228-client sshd[115079]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:03:16 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154a: corruption update llog can be skipped ========================================================== 20:03:14 (1763514194) Nov 18 20:03:16 oleg228-client sshd[115092]: Received disconnect from 192.168.202.28 port 36208:11: disconnected by user Nov 18 20:03:16 oleg228-client sshd[115092]: Disconnected from user root 192.168.202.28 port 36208 Nov 18 20:03:16 oleg228-client sshd[115079]: pam_unix(sshd:session): session closed for user root Nov 18 20:03:16 oleg228-client systemd-logind[1015]: Session 597 logged out. Waiting for processes to exit. Nov 18 20:03:16 oleg228-client systemd[1]: session-597.scope: Succeeded. Nov 18 20:03:16 oleg228-client systemd-logind[1015]: Removed session 597. Nov 18 20:04:00 oleg228-client sshd[115816]: Accepted publickey for root from 192.168.202.28 port 44598 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:00 oleg228-client systemd-logind[1015]: New session 598 of user root. Nov 18 20:04:00 oleg228-client systemd[1]: Started Session 598 of user root. Nov 18 20:04:00 oleg228-client sshd[115816]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:00 oleg228-client sshd[115829]: Received disconnect from 192.168.202.28 port 44598:11: disconnected by user Nov 18 20:04:00 oleg228-client sshd[115829]: Disconnected from user root 192.168.202.28 port 44598 Nov 18 20:04:00 oleg228-client sshd[115816]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:00 oleg228-client systemd[1]: session-598.scope: Succeeded. Nov 18 20:04:00 oleg228-client systemd-logind[1015]: Session 598 logged out. Waiting for processes to exit. Nov 18 20:04:00 oleg228-client systemd-logind[1015]: Removed session 598. Nov 18 20:04:01 oleg228-client sshd[115956]: Accepted publickey for root from 192.168.202.28 port 43736 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:01 oleg228-client systemd-logind[1015]: New session 599 of user root. Nov 18 20:04:01 oleg228-client systemd[1]: Started Session 599 of user root. Nov 18 20:04:01 oleg228-client sshd[115956]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:02 oleg228-client sshd[115969]: Received disconnect from 192.168.202.28 port 43736:11: disconnected by user Nov 18 20:04:02 oleg228-client sshd[115969]: Disconnected from user root 192.168.202.28 port 43736 Nov 18 20:04:02 oleg228-client sshd[115956]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:02 oleg228-client systemd[1]: session-599.scope: Succeeded. Nov 18 20:04:02 oleg228-client systemd-logind[1015]: Session 599 logged out. Waiting for processes to exit. Nov 18 20:04:02 oleg228-client systemd-logind[1015]: Removed session 599. Nov 18 20:04:02 oleg228-client anacron[51137]: Job `cron.monthly' started Nov 18 20:04:02 oleg228-client anacron[51137]: Job `cron.monthly' terminated Nov 18 20:04:02 oleg228-client anacron[51137]: Normal exit (3 jobs run) Nov 18 20:04:03 oleg228-client sshd[116104]: Accepted publickey for root from 192.168.202.28 port 43740 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:03 oleg228-client systemd[1]: Started Session 600 of user root. Nov 18 20:04:03 oleg228-client systemd-logind[1015]: New session 600 of user root. Nov 18 20:04:03 oleg228-client sshd[116104]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:03 oleg228-client sshd[116117]: Received disconnect from 192.168.202.28 port 43740:11: disconnected by user Nov 18 20:04:03 oleg228-client sshd[116117]: Disconnected from user root 192.168.202.28 port 43740 Nov 18 20:04:03 oleg228-client sshd[116104]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:03 oleg228-client systemd-logind[1015]: Session 600 logged out. Waiting for processes to exit. Nov 18 20:04:03 oleg228-client systemd[1]: session-600.scope: Succeeded. Nov 18 20:04:03 oleg228-client systemd-logind[1015]: Removed session 600. Nov 18 20:04:05 oleg228-client sshd[116259]: Accepted publickey for root from 192.168.202.28 port 43744 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:05 oleg228-client systemd[1]: Started Session 601 of user root. Nov 18 20:04:05 oleg228-client systemd-logind[1015]: New session 601 of user root. Nov 18 20:04:05 oleg228-client sshd[116259]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:05 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 154b: restore update llog after failed recovery ========================================================== 20:04:04 (1763514244) Nov 18 20:04:05 oleg228-client sshd[116272]: Received disconnect from 192.168.202.28 port 43744:11: disconnected by user Nov 18 20:04:05 oleg228-client sshd[116272]: Disconnected from user root 192.168.202.28 port 43744 Nov 18 20:04:05 oleg228-client sshd[116259]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:05 oleg228-client systemd[1]: session-601.scope: Succeeded. Nov 18 20:04:05 oleg228-client systemd-logind[1015]: Session 601 logged out. Waiting for processes to exit. Nov 18 20:04:05 oleg228-client systemd-logind[1015]: Removed session 601. Nov 18 20:04:27 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc7526000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 20:04:35 oleg228-client systemd-udevd[116604]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 20:04:35 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 20:04:37 oleg228-client systemd[1]: mnt-lustre2.mount: Succeeded. Nov 18 20:04:37 oleg228-client kernel: LustreError: 116638:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc7bd8800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 20:04:37 oleg228-client kernel: LustreError: 116638:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 20:04:37 oleg228-client kernel: LustreError: 116638:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup Nov 18 20:04:37 oleg228-client kernel: LustreError: 116638:0:(obd_class.h:479:obd_check_dev()) Skipped 9 previous similar messages Nov 18 20:04:37 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 20:04:38 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 20:04:44 oleg228-client systemd-udevd[116698]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 20:04:46 oleg228-client sshd[116800]: Accepted publickey for root from 192.168.202.28 port 42678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:46 oleg228-client systemd[1]: Started Session 602 of user root. Nov 18 20:04:46 oleg228-client systemd-logind[1015]: New session 602 of user root. Nov 18 20:04:46 oleg228-client sshd[116800]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:46 oleg228-client sshd[116814]: Received disconnect from 192.168.202.28 port 42678:11: disconnected by user Nov 18 20:04:46 oleg228-client sshd[116814]: Disconnected from user root 192.168.202.28 port 42678 Nov 18 20:04:46 oleg228-client sshd[116800]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:46 oleg228-client systemd[1]: session-602.scope: Succeeded. Nov 18 20:04:46 oleg228-client systemd-logind[1015]: Session 602 logged out. Waiting for processes to exit. Nov 18 20:04:46 oleg228-client systemd-logind[1015]: Removed session 602. Nov 18 20:04:48 oleg228-client sshd[116940]: Accepted publickey for root from 192.168.202.28 port 42680 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:48 oleg228-client systemd-logind[1015]: New session 603 of user root. Nov 18 20:04:48 oleg228-client systemd[1]: Started Session 603 of user root. Nov 18 20:04:48 oleg228-client sshd[116940]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:49 oleg228-client sshd[116953]: Received disconnect from 192.168.202.28 port 42680:11: disconnected by user Nov 18 20:04:49 oleg228-client sshd[116953]: Disconnected from user root 192.168.202.28 port 42680 Nov 18 20:04:49 oleg228-client sshd[116940]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:49 oleg228-client systemd-logind[1015]: Session 603 logged out. Waiting for processes to exit. Nov 18 20:04:49 oleg228-client systemd[1]: session-603.scope: Succeeded. Nov 18 20:04:49 oleg228-client systemd-logind[1015]: Removed session 603. Nov 18 20:04:50 oleg228-client sshd[117086]: Accepted publickey for root from 192.168.202.28 port 42696 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:50 oleg228-client systemd-logind[1015]: New session 604 of user root. Nov 18 20:04:50 oleg228-client systemd[1]: Started Session 604 of user root. Nov 18 20:04:50 oleg228-client sshd[117086]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:50 oleg228-client sshd[117099]: Received disconnect from 192.168.202.28 port 42696:11: disconnected by user Nov 18 20:04:50 oleg228-client sshd[117099]: Disconnected from user root 192.168.202.28 port 42696 Nov 18 20:04:50 oleg228-client sshd[117086]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:50 oleg228-client systemd[1]: session-604.scope: Succeeded. Nov 18 20:04:50 oleg228-client systemd-logind[1015]: Session 604 logged out. Waiting for processes to exit. Nov 18 20:04:51 oleg228-client systemd-logind[1015]: Removed session 604. Nov 18 20:04:53 oleg228-client sshd[117249]: Accepted publickey for root from 192.168.202.28 port 33520 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:04:53 oleg228-client systemd-logind[1015]: New session 605 of user root. Nov 18 20:04:53 oleg228-client systemd[1]: Started Session 605 of user root. Nov 18 20:04:53 oleg228-client sshd[117249]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:04:53 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 155: failover after client remount ========================================================== 20:04:52 (1763514292) Nov 18 20:04:53 oleg228-client sshd[117262]: Received disconnect from 192.168.202.28 port 33520:11: disconnected by user Nov 18 20:04:53 oleg228-client sshd[117262]: Disconnected from user root 192.168.202.28 port 33520 Nov 18 20:04:53 oleg228-client sshd[117249]: pam_unix(sshd:session): session closed for user root Nov 18 20:04:53 oleg228-client systemd[1]: session-605.scope: Succeeded. Nov 18 20:04:53 oleg228-client systemd-logind[1015]: Session 605 logged out. Waiting for processes to exit. Nov 18 20:04:53 oleg228-client systemd-logind[1015]: Removed session 605. Nov 18 20:04:56 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 20:04:56 oleg228-client kernel: LustreError: 117320:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc80e3000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 20:04:56 oleg228-client kernel: LustreError: 117320:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages Nov 18 20:04:57 oleg228-client systemd-udevd[117368]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 20:05:04 oleg228-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 Nov 18 20:05:47 oleg228-client sshd[117832]: Accepted publickey for root from 192.168.202.28 port 42158 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:05:47 oleg228-client systemd-logind[1015]: New session 606 of user root. Nov 18 20:05:47 oleg228-client systemd[1]: Started Session 606 of user root. Nov 18 20:05:47 oleg228-client sshd[117832]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:05:47 oleg228-client sshd[117845]: Received disconnect from 192.168.202.28 port 42158:11: disconnected by user Nov 18 20:05:47 oleg228-client sshd[117845]: Disconnected from user root 192.168.202.28 port 42158 Nov 18 20:05:47 oleg228-client sshd[117832]: pam_unix(sshd:session): session closed for user root Nov 18 20:05:47 oleg228-client systemd[1]: session-606.scope: Succeeded. Nov 18 20:05:47 oleg228-client systemd-logind[1015]: Session 606 logged out. Waiting for processes to exit. Nov 18 20:05:47 oleg228-client systemd-logind[1015]: Removed session 606. Nov 18 20:05:48 oleg228-client sshd[117971]: Accepted publickey for root from 192.168.202.28 port 42164 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:05:48 oleg228-client systemd[1]: Started Session 607 of user root. Nov 18 20:05:48 oleg228-client systemd-logind[1015]: New session 607 of user root. Nov 18 20:05:48 oleg228-client sshd[117971]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:05:49 oleg228-client sshd[117984]: Received disconnect from 192.168.202.28 port 42164:11: disconnected by user Nov 18 20:05:49 oleg228-client sshd[117984]: Disconnected from user root 192.168.202.28 port 42164 Nov 18 20:05:49 oleg228-client rsyslogd[1076]: imjournal: journal files changed, reloading... [v8.2102.0-15.el8_10.1 try https://www.rsyslog.com/e/0 ] Nov 18 20:05:49 oleg228-client sshd[117971]: pam_unix(sshd:session): session closed for user root Nov 18 20:05:49 oleg228-client systemd[1]: session-607.scope: Succeeded. Nov 18 20:05:49 oleg228-client systemd-logind[1015]: Session 607 logged out. Waiting for processes to exit. Nov 18 20:05:49 oleg228-client systemd-logind[1015]: Removed session 607. Nov 18 20:05:50 oleg228-client sshd[118118]: Accepted publickey for root from 192.168.202.28 port 42166 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:05:50 oleg228-client systemd[1]: Started Session 608 of user root. Nov 18 20:05:50 oleg228-client systemd-logind[1015]: New session 608 of user root. Nov 18 20:05:50 oleg228-client sshd[118118]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:05:50 oleg228-client sshd[118131]: Received disconnect from 192.168.202.28 port 42166:11: disconnected by user Nov 18 20:05:50 oleg228-client sshd[118131]: Disconnected from user root 192.168.202.28 port 42166 Nov 18 20:05:50 oleg228-client sshd[118118]: pam_unix(sshd:session): session closed for user root Nov 18 20:05:50 oleg228-client systemd[1]: session-608.scope: Succeeded. Nov 18 20:05:50 oleg228-client systemd-logind[1015]: Session 608 logged out. Waiting for processes to exit. Nov 18 20:05:50 oleg228-client systemd-logind[1015]: Removed session 608. Nov 18 20:05:52 oleg228-client sshd[118274]: Accepted publickey for root from 192.168.202.28 port 45720 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:05:52 oleg228-client systemd[1]: Started Session 609 of user root. Nov 18 20:05:52 oleg228-client systemd-logind[1015]: New session 609 of user root. Nov 18 20:05:52 oleg228-client sshd[118274]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:05:52 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 156: tot_granted miscount after client eviction ========================================================== 20:05:51 (1763514351) Nov 18 20:05:52 oleg228-client sshd[118287]: Received disconnect from 192.168.202.28 port 45720:11: disconnected by user Nov 18 20:05:52 oleg228-client sshd[118287]: Disconnected from user root 192.168.202.28 port 45720 Nov 18 20:05:52 oleg228-client sshd[118274]: pam_unix(sshd:session): session closed for user root Nov 18 20:05:52 oleg228-client systemd[1]: session-609.scope: Succeeded. Nov 18 20:05:52 oleg228-client systemd-logind[1015]: Session 609 logged out. Waiting for processes to exit. Nov 18 20:05:52 oleg228-client systemd-logind[1015]: Removed session 609. Nov 18 20:06:01 oleg228-client kernel: Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-OST0000 Nov 18 20:06:29 oleg228-client kernel: LustreError: 2405:0:(client.c:3503:ptlrpc_replay_req()) cfs_fail_timeout id 536 sleeping for 45000ms Nov 18 20:06:37 oleg228-client sshd[118752]: Accepted publickey for root from 192.168.202.28 port 55174 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:06:37 oleg228-client systemd-logind[1015]: New session 610 of user root. Nov 18 20:06:37 oleg228-client systemd[1]: Started Session 610 of user root. Nov 18 20:06:37 oleg228-client sshd[118752]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:14 oleg228-client kernel: LustreError: 2405:0:(client.c:3503:ptlrpc_replay_req()) cfs_fail_timeout id 536 awake Nov 18 20:07:14 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551d800: operation ost_write to node 192.168.202.128@tcp failed: rc = -107 Nov 18 20:07:14 oleg228-client kernel: LustreError: Skipped 2 previous similar messages Nov 18 20:07:14 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551d800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 20:07:14 oleg228-client sshd[118765]: Received disconnect from 192.168.202.28 port 55174:11: disconnected by user Nov 18 20:07:14 oleg228-client sshd[118765]: Disconnected from user root 192.168.202.28 port 55174 Nov 18 20:07:14 oleg228-client sshd[118752]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:14 oleg228-client systemd-logind[1015]: Session 610 logged out. Waiting for processes to exit. Nov 18 20:07:14 oleg228-client systemd[1]: session-610.scope: Succeeded. Nov 18 20:07:14 oleg228-client systemd-logind[1015]: Removed session 610. Nov 18 20:07:17 oleg228-client sshd[118996]: Accepted publickey for root from 192.168.202.28 port 53314 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:17 oleg228-client systemd-logind[1015]: New session 611 of user root. Nov 18 20:07:17 oleg228-client systemd[1]: Started Session 611 of user root. Nov 18 20:07:17 oleg228-client sshd[118996]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:17 oleg228-client kernel: Lustre: DEBUG MARKER: oleg228-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Nov 18 20:07:17 oleg228-client sshd[119009]: Received disconnect from 192.168.202.28 port 53314:11: disconnected by user Nov 18 20:07:18 oleg228-client sshd[119009]: Disconnected from user root 192.168.202.28 port 53314 Nov 18 20:07:18 oleg228-client sshd[118996]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:18 oleg228-client systemd[1]: session-611.scope: Succeeded. Nov 18 20:07:18 oleg228-client systemd-logind[1015]: Session 611 logged out. Waiting for processes to exit. Nov 18 20:07:18 oleg228-client systemd-logind[1015]: Removed session 611. Nov 18 20:07:19 oleg228-client sshd[119152]: Accepted publickey for root from 192.168.202.28 port 53330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:19 oleg228-client systemd-logind[1015]: New session 612 of user root. Nov 18 20:07:19 oleg228-client systemd[1]: Started Session 612 of user root. Nov 18 20:07:19 oleg228-client sshd[119152]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:19 oleg228-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Nov 18 20:07:19 oleg228-client sshd[119165]: Received disconnect from 192.168.202.28 port 53330:11: disconnected by user Nov 18 20:07:19 oleg228-client sshd[119165]: Disconnected from user root 192.168.202.28 port 53330 Nov 18 20:07:19 oleg228-client sshd[119152]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:19 oleg228-client systemd[1]: session-612.scope: Succeeded. Nov 18 20:07:19 oleg228-client systemd-logind[1015]: Session 612 logged out. Waiting for processes to exit. Nov 18 20:07:19 oleg228-client systemd-logind[1015]: Removed session 612. Nov 18 20:07:20 oleg228-client sshd[119208]: Accepted publickey for root from 192.168.202.28 port 38518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:21 oleg228-client systemd-logind[1015]: New session 613 of user root. Nov 18 20:07:21 oleg228-client systemd[1]: Started Session 613 of user root. Nov 18 20:07:21 oleg228-client sshd[119208]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:21 oleg228-client sshd[119221]: Received disconnect from 192.168.202.28 port 38518:11: disconnected by user Nov 18 20:07:21 oleg228-client sshd[119221]: Disconnected from user root 192.168.202.28 port 38518 Nov 18 20:07:21 oleg228-client sshd[119208]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:21 oleg228-client systemd[1]: session-613.scope: Succeeded. Nov 18 20:07:21 oleg228-client systemd-logind[1015]: Session 613 logged out. Waiting for processes to exit. Nov 18 20:07:21 oleg228-client systemd-logind[1015]: Removed session 613. Nov 18 20:07:24 oleg228-client sshd[119367]: Accepted publickey for root from 192.168.202.28 port 38530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:24 oleg228-client systemd[1]: Started Session 614 of user root. Nov 18 20:07:24 oleg228-client systemd-logind[1015]: New session 614 of user root. Nov 18 20:07:24 oleg228-client sshd[119367]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:24 oleg228-client sshd[119380]: Received disconnect from 192.168.202.28 port 38530:11: disconnected by user Nov 18 20:07:24 oleg228-client sshd[119380]: Disconnected from user root 192.168.202.28 port 38530 Nov 18 20:07:24 oleg228-client sshd[119367]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:24 oleg228-client systemd[1]: session-614.scope: Succeeded. Nov 18 20:07:25 oleg228-client systemd-logind[1015]: Session 614 logged out. Waiting for processes to exit. Nov 18 20:07:25 oleg228-client systemd-logind[1015]: Removed session 614. Nov 18 20:07:25 oleg228-client sshd[119506]: Accepted publickey for root from 192.168.202.28 port 38534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:25 oleg228-client systemd-logind[1015]: New session 615 of user root. Nov 18 20:07:25 oleg228-client systemd[1]: Started Session 615 of user root. Nov 18 20:07:25 oleg228-client sshd[119506]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:26 oleg228-client sshd[119519]: Received disconnect from 192.168.202.28 port 38534:11: disconnected by user Nov 18 20:07:26 oleg228-client sshd[119519]: Disconnected from user root 192.168.202.28 port 38534 Nov 18 20:07:26 oleg228-client sshd[119506]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:26 oleg228-client systemd[1]: session-615.scope: Succeeded. Nov 18 20:07:26 oleg228-client systemd-logind[1015]: Session 615 logged out. Waiting for processes to exit. Nov 18 20:07:26 oleg228-client systemd-logind[1015]: Removed session 615. Nov 18 20:07:27 oleg228-client sshd[119653]: Accepted publickey for root from 192.168.202.28 port 38542 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:27 oleg228-client systemd[1]: Started Session 616 of user root. Nov 18 20:07:27 oleg228-client systemd-logind[1015]: New session 616 of user root. Nov 18 20:07:27 oleg228-client sshd[119653]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:27 oleg228-client sshd[119666]: Received disconnect from 192.168.202.28 port 38542:11: disconnected by user Nov 18 20:07:27 oleg228-client sshd[119666]: Disconnected from user root 192.168.202.28 port 38542 Nov 18 20:07:27 oleg228-client sshd[119653]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:27 oleg228-client systemd-logind[1015]: Session 616 logged out. Waiting for processes to exit. Nov 18 20:07:27 oleg228-client systemd[1]: session-616.scope: Succeeded. Nov 18 20:07:27 oleg228-client systemd-logind[1015]: Removed session 616. Nov 18 20:07:29 oleg228-client sshd[119816]: Accepted publickey for root from 192.168.202.28 port 38556 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:29 oleg228-client systemd[1]: Started Session 617 of user root. Nov 18 20:07:29 oleg228-client systemd-logind[1015]: New session 617 of user root. Nov 18 20:07:29 oleg228-client sshd[119816]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:30 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 157: eviction during mmaped i/o === 20:07:28 (1763514448) Nov 18 20:07:30 oleg228-client sshd[119829]: Received disconnect from 192.168.202.28 port 38556:11: disconnected by user Nov 18 20:07:30 oleg228-client sshd[119829]: Disconnected from user root 192.168.202.28 port 38556 Nov 18 20:07:30 oleg228-client sshd[119816]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:30 oleg228-client systemd[1]: session-617.scope: Succeeded. Nov 18 20:07:30 oleg228-client systemd-logind[1015]: Session 617 logged out. Waiting for processes to exit. Nov 18 20:07:30 oleg228-client systemd-logind[1015]: Removed session 617. Nov 18 20:07:30 oleg228-client kernel: LustreError: 119877:0:(vvp_io.c:1501:vvp_io_fault_start()) cfs_fail_timeout id 1432 sleeping for 3000ms Nov 18 20:07:33 oleg228-client kernel: LustreError: 119877:0:(vvp_io.c:1501:vvp_io_fault_start()) cfs_fail_timeout id 1432 awake Nov 18 20:07:33 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc551d800: Connection to lustre-OST0000 (at 192.168.202.128@tcp) was lost; in progress operations using this service will wait for recovery to complete Nov 18 20:07:33 oleg228-client kernel: Lustre: Skipped 12 previous similar messages Nov 18 20:07:33 oleg228-client kernel: LustreError: lustre-OST0000-osc-ffff9ccbc551d800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. Nov 18 20:07:33 oleg228-client kernel: Lustre: lustre-OST0000-osc-ffff9ccbc551d800: Connection restored to 192.168.202.128@tcp (at 192.168.202.128@tcp) Nov 18 20:07:33 oleg228-client kernel: Lustre: Skipped 16 previous similar messages Nov 18 20:07:33 oleg228-client systemd[1]: Created slice system-systemd\x2dcoredump.slice. Nov 18 20:07:33 oleg228-client systemd[1]: Started Process Core Dump (PID 119891/UID 0). Nov 18 20:07:33 oleg228-client systemd[119892]: systemd-coredump@0-119891-0.service: Failed to set up special execution directory in /var/lib: Read-only file system Nov 18 20:07:33 oleg228-client systemd[119892]: systemd-coredump@0-119891-0.service: Failed at step STATE_DIRECTORY spawning /usr/lib/systemd/systemd-coredump: Read-only file system Nov 18 20:07:34 oleg228-client systemd[1]: systemd-coredump@0-119891-0.service: Succeeded. Nov 18 20:07:35 oleg228-client sshd[119985]: Accepted publickey for root from 192.168.202.28 port 51378 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:35 oleg228-client systemd[1]: Started Session 618 of user root. Nov 18 20:07:35 oleg228-client systemd-logind[1015]: New session 618 of user root. Nov 18 20:07:35 oleg228-client sshd[119985]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:35 oleg228-client sshd[119998]: Received disconnect from 192.168.202.28 port 51378:11: disconnected by user Nov 18 20:07:35 oleg228-client sshd[119998]: Disconnected from user root 192.168.202.28 port 51378 Nov 18 20:07:35 oleg228-client sshd[119985]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:35 oleg228-client systemd[1]: session-618.scope: Succeeded. Nov 18 20:07:35 oleg228-client systemd-logind[1015]: Session 618 logged out. Waiting for processes to exit. Nov 18 20:07:35 oleg228-client systemd-logind[1015]: Removed session 618. Nov 18 20:07:36 oleg228-client sshd[120124]: Accepted publickey for root from 192.168.202.28 port 51388 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:36 oleg228-client systemd[1]: Started Session 619 of user root. Nov 18 20:07:36 oleg228-client systemd-logind[1015]: New session 619 of user root. Nov 18 20:07:36 oleg228-client sshd[120124]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:36 oleg228-client sshd[120137]: Received disconnect from 192.168.202.28 port 51388:11: disconnected by user Nov 18 20:07:36 oleg228-client sshd[120137]: Disconnected from user root 192.168.202.28 port 51388 Nov 18 20:07:36 oleg228-client sshd[120124]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:37 oleg228-client systemd[1]: session-619.scope: Succeeded. Nov 18 20:07:37 oleg228-client systemd-logind[1015]: Session 619 logged out. Waiting for processes to exit. Nov 18 20:07:37 oleg228-client systemd-logind[1015]: Removed session 619. Nov 18 20:07:38 oleg228-client sshd[120270]: Accepted publickey for root from 192.168.202.28 port 51392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:38 oleg228-client systemd-logind[1015]: New session 620 of user root. Nov 18 20:07:38 oleg228-client systemd[1]: Started Session 620 of user root. Nov 18 20:07:38 oleg228-client sshd[120270]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:38 oleg228-client sshd[120283]: Received disconnect from 192.168.202.28 port 51392:11: disconnected by user Nov 18 20:07:38 oleg228-client sshd[120283]: Disconnected from user root 192.168.202.28 port 51392 Nov 18 20:07:38 oleg228-client sshd[120270]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:38 oleg228-client systemd-logind[1015]: Session 620 logged out. Waiting for processes to exit. Nov 18 20:07:38 oleg228-client systemd[1]: session-620.scope: Succeeded. Nov 18 20:07:38 oleg228-client systemd-logind[1015]: Removed session 620. Nov 18 20:07:40 oleg228-client sshd[120425]: Accepted publickey for root from 192.168.202.28 port 51396 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:07:40 oleg228-client systemd-logind[1015]: New session 621 of user root. Nov 18 20:07:40 oleg228-client systemd[1]: Started Session 621 of user root. Nov 18 20:07:40 oleg228-client sshd[120425]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:07:40 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 158a: connect without access right ========================================================== 20:07:39 (1763514459) Nov 18 20:07:40 oleg228-client sshd[120438]: Received disconnect from 192.168.202.28 port 51396:11: disconnected by user Nov 18 20:07:40 oleg228-client sshd[120438]: Disconnected from user root 192.168.202.28 port 51396 Nov 18 20:07:40 oleg228-client sshd[120425]: pam_unix(sshd:session): session closed for user root Nov 18 20:07:40 oleg228-client systemd[1]: session-621.scope: Succeeded. Nov 18 20:07:40 oleg228-client systemd-logind[1015]: Session 621 logged out. Waiting for processes to exit. Nov 18 20:07:40 oleg228-client systemd-logind[1015]: Removed session 621. Nov 18 20:07:42 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 20:07:42 oleg228-client kernel: LustreError: 120494:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc551d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 20:07:42 oleg228-client kernel: LustreError: 120494:0:(lov_obd.c:783:lov_cleanup()) Skipped 1 previous similar message Nov 18 20:07:42 oleg228-client kernel: LustreError: 120494:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 20:07:42 oleg228-client kernel: LustreError: 120494:0:(obd_class.h:479:obd_check_dev()) Skipped 27 previous similar messages Nov 18 20:07:42 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 20:07:42 oleg228-client kernel: Lustre: Skipped 2 previous similar messages Nov 18 20:07:42 oleg228-client systemd-udevd[120535]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 20:07:42 oleg228-client kernel: Lustre: Mounted lustre-client Nov 18 20:07:42 oleg228-client kernel: Lustre: Skipped 2 previous similar messages Nov 18 20:08:05 oleg228-client kernel: Lustre: lustre-MDT0001-mdc-ffff9ccbc80e3800: connection denied by lustre-MDT0001_UUID: rc = -13 Nov 18 20:08:05 oleg228-client kernel: LustreError: lustre-MDT0001-mdc-ffff9ccbc80e3800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Nov 18 20:08:25 oleg228-client kernel: LustreError: lustre-MDT0001-mdc-ffff9ccbc80e3800: This client was evicted by lustre-MDT0001; in progress operations using this service will fail. Nov 18 20:08:26 oleg228-client sshd[120981]: Accepted publickey for root from 192.168.202.28 port 43348 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:08:26 oleg228-client systemd-logind[1015]: New session 622 of user root. Nov 18 20:08:26 oleg228-client systemd[1]: Started Session 622 of user root. Nov 18 20:08:26 oleg228-client sshd[120981]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:08:26 oleg228-client sshd[120994]: Received disconnect from 192.168.202.28 port 43348:11: disconnected by user Nov 18 20:08:26 oleg228-client sshd[120994]: Disconnected from user root 192.168.202.28 port 43348 Nov 18 20:08:26 oleg228-client sshd[120981]: pam_unix(sshd:session): session closed for user root Nov 18 20:08:27 oleg228-client systemd[1]: session-622.scope: Succeeded. Nov 18 20:08:27 oleg228-client systemd-logind[1015]: Session 622 logged out. Waiting for processes to exit. Nov 18 20:08:27 oleg228-client systemd-logind[1015]: Removed session 622. Nov 18 20:08:27 oleg228-client sshd[121121]: Accepted publickey for root from 192.168.202.28 port 43358 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:08:27 oleg228-client systemd-logind[1015]: New session 623 of user root. Nov 18 20:08:27 oleg228-client systemd[1]: Started Session 623 of user root. Nov 18 20:08:27 oleg228-client sshd[121121]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:08:28 oleg228-client sshd[121134]: Received disconnect from 192.168.202.28 port 43358:11: disconnected by user Nov 18 20:08:28 oleg228-client sshd[121134]: Disconnected from user root 192.168.202.28 port 43358 Nov 18 20:08:28 oleg228-client sshd[121121]: pam_unix(sshd:session): session closed for user root Nov 18 20:08:28 oleg228-client systemd-logind[1015]: Session 623 logged out. Waiting for processes to exit. Nov 18 20:08:28 oleg228-client systemd[1]: session-623.scope: Succeeded. Nov 18 20:08:28 oleg228-client systemd-logind[1015]: Removed session 623. Nov 18 20:08:29 oleg228-client sshd[121268]: Accepted publickey for root from 192.168.202.28 port 43374 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:08:29 oleg228-client systemd-logind[1015]: New session 624 of user root. Nov 18 20:08:29 oleg228-client systemd[1]: Started Session 624 of user root. Nov 18 20:08:29 oleg228-client sshd[121268]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:08:30 oleg228-client sshd[121281]: Received disconnect from 192.168.202.28 port 43374:11: disconnected by user Nov 18 20:08:30 oleg228-client sshd[121281]: Disconnected from user root 192.168.202.28 port 43374 Nov 18 20:08:30 oleg228-client sshd[121268]: pam_unix(sshd:session): session closed for user root Nov 18 20:08:30 oleg228-client systemd[1]: session-624.scope: Succeeded. Nov 18 20:08:30 oleg228-client systemd-logind[1015]: Session 624 logged out. Waiting for processes to exit. Nov 18 20:08:30 oleg228-client systemd-logind[1015]: Removed session 624. Nov 18 20:08:32 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 20:08:32 oleg228-client systemd-udevd[121381]: Process '/home/green/git/lustre-release/lustre/utils/lctl set_param 'lod.*.mdt_hash=crush'' failed with exit code 2. Nov 18 20:08:34 oleg228-client sshd[121432]: Accepted publickey for root from 192.168.202.28 port 47286 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:08:34 oleg228-client systemd-logind[1015]: New session 625 of user root. Nov 18 20:08:34 oleg228-client systemd[1]: Started Session 625 of user root. Nov 18 20:08:34 oleg228-client sshd[121432]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:08:35 oleg228-client sshd[121445]: Received disconnect from 192.168.202.28 port 47286:11: disconnected by user Nov 18 20:08:35 oleg228-client sshd[121445]: Disconnected from user root 192.168.202.28 port 47286 Nov 18 20:08:35 oleg228-client sshd[121432]: pam_unix(sshd:session): session closed for user root Nov 18 20:08:35 oleg228-client systemd[1]: session-625.scope: Succeeded. Nov 18 20:08:35 oleg228-client systemd-logind[1015]: Session 625 logged out. Waiting for processes to exit. Nov 18 20:08:35 oleg228-client systemd-logind[1015]: Removed session 625. Nov 18 20:08:36 oleg228-client sshd[121583]: Accepted publickey for root from 192.168.202.28 port 47292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:08:36 oleg228-client systemd[1]: Started Session 626 of user root. Nov 18 20:08:36 oleg228-client systemd-logind[1015]: New session 626 of user root. Nov 18 20:08:36 oleg228-client sshd[121583]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:08:37 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 160: MDT destroys are blocked by grouplocks ========================================================== 20:08:35 (1763514515) Nov 18 20:08:37 oleg228-client sshd[121596]: Received disconnect from 192.168.202.28 port 47292:11: disconnected by user Nov 18 20:08:37 oleg228-client sshd[121596]: Disconnected from user root 192.168.202.28 port 47292 Nov 18 20:08:37 oleg228-client sshd[121583]: pam_unix(sshd:session): session closed for user root Nov 18 20:08:37 oleg228-client systemd[1]: session-626.scope: Succeeded. Nov 18 20:08:37 oleg228-client systemd-logind[1015]: Session 626 logged out. Waiting for processes to exit. Nov 18 20:08:37 oleg228-client systemd-logind[1015]: Removed session 626. Nov 18 20:08:40 oleg228-client kernel: LustreError: lustre-MDT0000-mdc-ffff9ccbc551d800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Nov 18 20:09:22 oleg228-client sshd[121842]: Accepted publickey for root from 192.168.202.28 port 52930 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:22 oleg228-client systemd-logind[1015]: New session 627 of user root. Nov 18 20:09:22 oleg228-client systemd[1]: Started Session 627 of user root. Nov 18 20:09:22 oleg228-client sshd[121842]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:23 oleg228-client sshd[121855]: Received disconnect from 192.168.202.28 port 52930:11: disconnected by user Nov 18 20:09:23 oleg228-client sshd[121855]: Disconnected from user root 192.168.202.28 port 52930 Nov 18 20:09:23 oleg228-client sshd[121842]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:23 oleg228-client systemd[1]: session-627.scope: Succeeded. Nov 18 20:09:23 oleg228-client systemd-logind[1015]: Session 627 logged out. Waiting for processes to exit. Nov 18 20:09:23 oleg228-client systemd-logind[1015]: Removed session 627. Nov 18 20:09:24 oleg228-client sshd[121981]: Accepted publickey for root from 192.168.202.28 port 52946 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:24 oleg228-client systemd[1]: Started Session 628 of user root. Nov 18 20:09:24 oleg228-client sshd[121981]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:24 oleg228-client systemd-logind[1015]: New session 628 of user root. Nov 18 20:09:24 oleg228-client sshd[121994]: Received disconnect from 192.168.202.28 port 52946:11: disconnected by user Nov 18 20:09:24 oleg228-client sshd[121994]: Disconnected from user root 192.168.202.28 port 52946 Nov 18 20:09:24 oleg228-client sshd[121981]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:24 oleg228-client systemd-logind[1015]: Session 628 logged out. Waiting for processes to exit. Nov 18 20:09:24 oleg228-client systemd[1]: session-628.scope: Succeeded. Nov 18 20:09:24 oleg228-client systemd-logind[1015]: Removed session 628. Nov 18 20:09:26 oleg228-client sshd[122127]: Accepted publickey for root from 192.168.202.28 port 52950 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:26 oleg228-client systemd-logind[1015]: New session 629 of user root. Nov 18 20:09:26 oleg228-client systemd[1]: Started Session 629 of user root. Nov 18 20:09:26 oleg228-client sshd[122127]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:26 oleg228-client sshd[122140]: Received disconnect from 192.168.202.28 port 52950:11: disconnected by user Nov 18 20:09:26 oleg228-client sshd[122140]: Disconnected from user root 192.168.202.28 port 52950 Nov 18 20:09:26 oleg228-client sshd[122127]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:26 oleg228-client systemd[1]: session-629.scope: Succeeded. Nov 18 20:09:26 oleg228-client systemd-logind[1015]: Session 629 logged out. Waiting for processes to exit. Nov 18 20:09:26 oleg228-client systemd-logind[1015]: Removed session 629. Nov 18 20:09:28 oleg228-client sshd[122282]: Accepted publickey for root from 192.168.202.28 port 52960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:28 oleg228-client systemd-logind[1015]: New session 630 of user root. Nov 18 20:09:28 oleg228-client systemd[1]: Started Session 630 of user root. Nov 18 20:09:28 oleg228-client sshd[122282]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:28 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 161: evict osp by ping evictor ==== 20:09:26 (1763514566) Nov 18 20:09:28 oleg228-client sshd[122296]: Received disconnect from 192.168.202.28 port 52960:11: disconnected by user Nov 18 20:09:28 oleg228-client sshd[122296]: Disconnected from user root 192.168.202.28 port 52960 Nov 18 20:09:28 oleg228-client sshd[122282]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:28 oleg228-client systemd-logind[1015]: Session 630 logged out. Waiting for processes to exit. Nov 18 20:09:28 oleg228-client systemd[1]: session-630.scope: Succeeded. Nov 18 20:09:28 oleg228-client systemd-logind[1015]: Removed session 630. Nov 18 20:09:41 oleg228-client sshd[122433]: Accepted publickey for root from 192.168.202.28 port 37892 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:41 oleg228-client systemd-logind[1015]: New session 631 of user root. Nov 18 20:09:41 oleg228-client systemd[1]: Started Session 631 of user root. Nov 18 20:09:41 oleg228-client sshd[122433]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:41 oleg228-client sshd[122446]: Received disconnect from 192.168.202.28 port 37892:11: disconnected by user Nov 18 20:09:41 oleg228-client sshd[122446]: Disconnected from user root 192.168.202.28 port 37892 Nov 18 20:09:41 oleg228-client sshd[122433]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:42 oleg228-client systemd[1]: session-631.scope: Succeeded. Nov 18 20:09:42 oleg228-client systemd-logind[1015]: Session 631 logged out. Waiting for processes to exit. Nov 18 20:09:42 oleg228-client systemd-logind[1015]: Removed session 631. Nov 18 20:09:43 oleg228-client sshd[122573]: Accepted publickey for root from 192.168.202.28 port 37904 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:44 oleg228-client systemd[1]: Started Session 632 of user root. Nov 18 20:09:44 oleg228-client systemd-logind[1015]: New session 632 of user root. Nov 18 20:09:44 oleg228-client sshd[122573]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:44 oleg228-client sshd[122586]: Received disconnect from 192.168.202.28 port 37904:11: disconnected by user Nov 18 20:09:44 oleg228-client sshd[122586]: Disconnected from user root 192.168.202.28 port 37904 Nov 18 20:09:44 oleg228-client sshd[122573]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:44 oleg228-client systemd[1]: session-632.scope: Succeeded. Nov 18 20:09:44 oleg228-client systemd-logind[1015]: Session 632 logged out. Waiting for processes to exit. Nov 18 20:09:44 oleg228-client systemd-logind[1015]: Removed session 632. Nov 18 20:09:45 oleg228-client sshd[122719]: Accepted publickey for root from 192.168.202.28 port 37920 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:45 oleg228-client systemd-logind[1015]: New session 633 of user root. Nov 18 20:09:45 oleg228-client systemd[1]: Started Session 633 of user root. Nov 18 20:09:45 oleg228-client sshd[122719]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:46 oleg228-client sshd[122732]: Received disconnect from 192.168.202.28 port 37920:11: disconnected by user Nov 18 20:09:46 oleg228-client sshd[122732]: Disconnected from user root 192.168.202.28 port 37920 Nov 18 20:09:46 oleg228-client sshd[122719]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:46 oleg228-client systemd[1]: session-633.scope: Succeeded. Nov 18 20:09:46 oleg228-client systemd-logind[1015]: Session 633 logged out. Waiting for processes to exit. Nov 18 20:09:46 oleg228-client systemd-logind[1015]: Removed session 633. Nov 18 20:09:47 oleg228-client sshd[122875]: Accepted publickey for root from 192.168.202.28 port 37928 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:09:47 oleg228-client systemd-logind[1015]: New session 634 of user root. Nov 18 20:09:47 oleg228-client systemd[1]: Started Session 634 of user root. Nov 18 20:09:47 oleg228-client sshd[122875]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:09:48 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 162: File attributes should be persisted after MDS failover ========================================================== 20:09:46 (1763514586) Nov 18 20:09:48 oleg228-client sshd[122888]: Received disconnect from 192.168.202.28 port 37928:11: disconnected by user Nov 18 20:09:48 oleg228-client sshd[122888]: Disconnected from user root 192.168.202.28 port 37928 Nov 18 20:09:48 oleg228-client sshd[122875]: pam_unix(sshd:session): session closed for user root Nov 18 20:09:48 oleg228-client systemd[1]: session-634.scope: Succeeded. Nov 18 20:09:48 oleg228-client systemd-logind[1015]: Session 634 logged out. Waiting for processes to exit. Nov 18 20:09:48 oleg228-client systemd-logind[1015]: Removed session 634. Nov 18 20:10:00 oleg228-client kernel: LustreError: MGC192.168.202.128@tcp: Connection to MGS (at 192.168.202.128@tcp) was lost; in progress operations using this service will fail Nov 18 20:10:00 oleg228-client kernel: LustreError: Skipped 6 previous similar messages Nov 18 20:10:00 oleg228-client kernel: Lustre: Evicted from MGS (at 192.168.202.128@tcp) after server handle changed from 0x2622672b2603e7ac to 0x2622672b2603f161 Nov 18 20:10:00 oleg228-client kernel: Lustre: Skipped 7 previous similar messages Nov 18 20:10:00 oleg228-client kernel: LustreError: 2405:0:(client.c:3418:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff9ccbc823c000 x1849171087231872/t163208757316(163208757316) o101->lustre-MDT0000-mdc-ffff9ccbc551d800@192.168.202.128@tcp:12/10 lens 576/608 e 0 to 0 dl 1763514656 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'chattr.0' uid:0 gid:0 projid:0 Nov 18 20:10:10 oleg228-client sshd[123292]: Accepted publickey for root from 192.168.202.28 port 35466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:10 oleg228-client systemd-logind[1015]: New session 635 of user root. Nov 18 20:10:10 oleg228-client systemd[1]: Started Session 635 of user root. Nov 18 20:10:10 oleg228-client sshd[123292]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:10 oleg228-client sshd[123305]: Received disconnect from 192.168.202.28 port 35466:11: disconnected by user Nov 18 20:10:10 oleg228-client sshd[123305]: Disconnected from user root 192.168.202.28 port 35466 Nov 18 20:10:10 oleg228-client sshd[123292]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:10 oleg228-client systemd-logind[1015]: Session 635 logged out. Waiting for processes to exit. Nov 18 20:10:10 oleg228-client systemd[1]: session-635.scope: Succeeded. Nov 18 20:10:10 oleg228-client systemd-logind[1015]: Removed session 635. Nov 18 20:10:11 oleg228-client sshd[123431]: Accepted publickey for root from 192.168.202.28 port 39232 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:11 oleg228-client systemd-logind[1015]: New session 636 of user root. Nov 18 20:10:11 oleg228-client systemd[1]: Started Session 636 of user root. Nov 18 20:10:11 oleg228-client sshd[123431]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:12 oleg228-client sshd[123444]: Received disconnect from 192.168.202.28 port 39232:11: disconnected by user Nov 18 20:10:12 oleg228-client sshd[123444]: Disconnected from user root 192.168.202.28 port 39232 Nov 18 20:10:12 oleg228-client sshd[123431]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:12 oleg228-client systemd[1]: session-636.scope: Succeeded. Nov 18 20:10:12 oleg228-client systemd-logind[1015]: Session 636 logged out. Waiting for processes to exit. Nov 18 20:10:12 oleg228-client systemd-logind[1015]: Removed session 636. Nov 18 20:10:13 oleg228-client sshd[123578]: Accepted publickey for root from 192.168.202.28 port 39248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:13 oleg228-client systemd-logind[1015]: New session 637 of user root. Nov 18 20:10:13 oleg228-client systemd[1]: Started Session 637 of user root. Nov 18 20:10:13 oleg228-client sshd[123578]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:13 oleg228-client sshd[123591]: Received disconnect from 192.168.202.28 port 39248:11: disconnected by user Nov 18 20:10:13 oleg228-client sshd[123591]: Disconnected from user root 192.168.202.28 port 39248 Nov 18 20:10:13 oleg228-client sshd[123578]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:13 oleg228-client systemd[1]: session-637.scope: Succeeded. Nov 18 20:10:13 oleg228-client systemd-logind[1015]: Session 637 logged out. Waiting for processes to exit. Nov 18 20:10:13 oleg228-client systemd-logind[1015]: Removed session 637. Nov 18 20:10:15 oleg228-client sshd[123735]: Accepted publickey for root from 192.168.202.28 port 39250 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:15 oleg228-client systemd-logind[1015]: New session 638 of user root. Nov 18 20:10:15 oleg228-client systemd[1]: Started Session 638 of user root. Nov 18 20:10:15 oleg228-client sshd[123735]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:15 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test 163: changelog check for fail write and processing records ========================================================== 20:10:14 (1763514614) Nov 18 20:10:15 oleg228-client sshd[123748]: Received disconnect from 192.168.202.28 port 39250:11: disconnected by user Nov 18 20:10:15 oleg228-client sshd[123748]: Disconnected from user root 192.168.202.28 port 39250 Nov 18 20:10:15 oleg228-client sshd[123735]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:15 oleg228-client systemd[1]: session-638.scope: Succeeded. Nov 18 20:10:15 oleg228-client systemd-logind[1015]: Session 638 logged out. Waiting for processes to exit. Nov 18 20:10:15 oleg228-client systemd-logind[1015]: Removed session 638. Nov 18 20:10:26 oleg228-client sshd[124100]: Accepted publickey for root from 192.168.202.28 port 56572 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:27 oleg228-client systemd[1]: Started Session 639 of user root. Nov 18 20:10:27 oleg228-client systemd-logind[1015]: New session 639 of user root. Nov 18 20:10:27 oleg228-client sshd[124100]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:27 oleg228-client sshd[124113]: Received disconnect from 192.168.202.28 port 56572:11: disconnected by user Nov 18 20:10:27 oleg228-client sshd[124113]: Disconnected from user root 192.168.202.28 port 56572 Nov 18 20:10:27 oleg228-client sshd[124100]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:27 oleg228-client systemd[1]: session-639.scope: Succeeded. Nov 18 20:10:27 oleg228-client systemd-logind[1015]: Session 639 logged out. Waiting for processes to exit. Nov 18 20:10:27 oleg228-client systemd-logind[1015]: Removed session 639. Nov 18 20:10:28 oleg228-client sshd[124239]: Accepted publickey for root from 192.168.202.28 port 56576 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:28 oleg228-client systemd-logind[1015]: New session 640 of user root. Nov 18 20:10:28 oleg228-client systemd[1]: Started Session 640 of user root. Nov 18 20:10:28 oleg228-client sshd[124239]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:29 oleg228-client sshd[124252]: Received disconnect from 192.168.202.28 port 56576:11: disconnected by user Nov 18 20:10:29 oleg228-client sshd[124252]: Disconnected from user root 192.168.202.28 port 56576 Nov 18 20:10:29 oleg228-client sshd[124239]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:29 oleg228-client systemd[1]: session-640.scope: Succeeded. Nov 18 20:10:29 oleg228-client systemd-logind[1015]: Session 640 logged out. Waiting for processes to exit. Nov 18 20:10:29 oleg228-client systemd-logind[1015]: Removed session 640. Nov 18 20:10:29 oleg228-client sshd[124385]: Accepted publickey for root from 192.168.202.28 port 56578 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:30 oleg228-client systemd[1]: Started Session 641 of user root. Nov 18 20:10:30 oleg228-client systemd-logind[1015]: New session 641 of user root. Nov 18 20:10:30 oleg228-client sshd[124385]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:30 oleg228-client sshd[124398]: Received disconnect from 192.168.202.28 port 56578:11: disconnected by user Nov 18 20:10:30 oleg228-client sshd[124398]: Disconnected from user root 192.168.202.28 port 56578 Nov 18 20:10:30 oleg228-client sshd[124385]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:30 oleg228-client systemd[1]: session-641.scope: Succeeded. Nov 18 20:10:30 oleg228-client systemd-logind[1015]: Session 641 logged out. Waiting for processes to exit. Nov 18 20:10:30 oleg228-client systemd-logind[1015]: Removed session 641. Nov 18 20:10:40 oleg228-client sshd[124642]: Accepted publickey for root from 192.168.202.28 port 43924 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:40 oleg228-client systemd-logind[1015]: New session 642 of user root. Nov 18 20:10:40 oleg228-client systemd[1]: Started Session 642 of user root. Nov 18 20:10:40 oleg228-client sshd[124642]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:41 oleg228-client kernel: Lustre: DEBUG MARKER: == recovery-small test complete, duration 7507 sec ======= 20:10:39 (1763514639) Nov 18 20:10:41 oleg228-client sshd[124655]: Received disconnect from 192.168.202.28 port 43924:11: disconnected by user Nov 18 20:10:41 oleg228-client sshd[124655]: Disconnected from user root 192.168.202.28 port 43924 Nov 18 20:10:41 oleg228-client sshd[124642]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:41 oleg228-client systemd[1]: session-642.scope: Succeeded. Nov 18 20:10:41 oleg228-client systemd-logind[1015]: Session 642 logged out. Waiting for processes to exit. Nov 18 20:10:41 oleg228-client systemd-logind[1015]: Removed session 642. Nov 18 20:10:42 oleg228-client sshd[124789]: Accepted publickey for root from 192.168.202.28 port 52230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:10:42 oleg228-client systemd-logind[1015]: New session 643 of user root. Nov 18 20:10:42 oleg228-client systemd[1]: Started Session 643 of user root. Nov 18 20:10:42 oleg228-client sshd[124789]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:10:42 oleg228-client kernel: Lustre: DEBUG MARKER: === recovery-small: start cleanup 20:10:41 (1763514641) === Nov 18 20:10:42 oleg228-client sshd[124802]: Received disconnect from 192.168.202.28 port 52230:11: disconnected by user Nov 18 20:10:42 oleg228-client sshd[124802]: Disconnected from user root 192.168.202.28 port 52230 Nov 18 20:10:42 oleg228-client sshd[124789]: pam_unix(sshd:session): session closed for user root Nov 18 20:10:42 oleg228-client systemd[1]: session-643.scope: Succeeded. Nov 18 20:10:42 oleg228-client systemd-logind[1015]: Session 643 logged out. Waiting for processes to exit. Nov 18 20:10:42 oleg228-client systemd-logind[1015]: Removed session 643. Nov 18 20:14:38 oleg228-client sshd[124980]: Accepted publickey for root from 192.168.202.28 port 34226 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:14:38 oleg228-client systemd[1]: Started Session 644 of user root. Nov 18 20:14:38 oleg228-client systemd-logind[1015]: New session 644 of user root. Nov 18 20:14:38 oleg228-client sshd[124980]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:14:38 oleg228-client sshd[124993]: Received disconnect from 192.168.202.28 port 34226:11: disconnected by user Nov 18 20:14:38 oleg228-client sshd[124993]: Disconnected from user root 192.168.202.28 port 34226 Nov 18 20:14:38 oleg228-client sshd[124980]: pam_unix(sshd:session): session closed for user root Nov 18 20:14:38 oleg228-client systemd[1]: session-644.scope: Succeeded. Nov 18 20:14:38 oleg228-client systemd-logind[1015]: Session 644 logged out. Waiting for processes to exit. Nov 18 20:14:38 oleg228-client systemd-logind[1015]: Removed session 644. Nov 18 20:14:40 oleg228-client sshd[125119]: Accepted publickey for root from 192.168.202.28 port 34230 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Nov 18 20:14:40 oleg228-client systemd-logind[1015]: New session 645 of user root. Nov 18 20:14:40 oleg228-client systemd[1]: Started Session 645 of user root. Nov 18 20:14:40 oleg228-client sshd[125119]: pam_unix(sshd:session): session opened for user root by (uid=0) Nov 18 20:14:40 oleg228-client kernel: Lustre: DEBUG MARKER: === recovery-small: finish cleanup 20:14:39 (1763514879) === Nov 18 20:14:40 oleg228-client sshd[125132]: Received disconnect from 192.168.202.28 port 34230:11: disconnected by user Nov 18 20:14:40 oleg228-client sshd[125132]: Disconnected from user root 192.168.202.28 port 34230 Nov 18 20:14:40 oleg228-client sshd[125119]: pam_unix(sshd:session): session closed for user root Nov 18 20:14:40 oleg228-client systemd-logind[1015]: Session 645 logged out. Waiting for processes to exit. Nov 18 20:14:40 oleg228-client systemd[1]: session-645.scope: Succeeded. Nov 18 20:14:40 oleg228-client systemd-logind[1015]: Removed session 645. Nov 18 20:14:41 oleg228-client systemd[1]: mnt-lustre.mount: Succeeded. Nov 18 20:14:41 oleg228-client kernel: LustreError: 125188:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9ccbc551d800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 Nov 18 20:14:41 oleg228-client kernel: LustreError: 125188:0:(lov_obd.c:783:lov_cleanup()) Skipped 3 previous similar messages Nov 18 20:14:41 oleg228-client kernel: LustreError: 125188:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup Nov 18 20:14:41 oleg228-client kernel: LustreError: 125188:0:(obd_class.h:479:obd_check_dev()) Skipped 19 previous similar messages Nov 18 20:14:41 oleg228-client kernel: Lustre: Unmounted lustre-client Nov 18 20:14:41 oleg228-client kernel: Lustre: Skipped 1 previous similar message Nov 18 20:15:34 oleg228-client kernel: Key type lgssc unregistered Nov 18 20:15:34 oleg228-client kernel: LNet: 125876:0:(lib-ptl.c:967:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Nov 18 20:15:34 oleg228-client kernel: LNetError: 125876:0:(acceptor.c:264:lnet_acceptor_remove_socket()) Interface ens2 not found Nov 18 20:15:34 oleg228-client kernel: LNet: Removed LNI 192.168.202.28@tcp Nov 18 20:15:35 oleg228-client kernel: Key type .llcrypt unregistered Nov 18 20:15:35 oleg228-client kernel: Key type ._llcrypt unregistered Nov 18 20:15:35 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event0 (Power Button) Nov 18 20:15:35 oleg228-client systemd-udevd[125945]: Using default interface naming scheme 'rhel-8.0'. Nov 18 20:15:35 oleg228-client systemd-logind[1015]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Nov 18 20:15:41 oleg228-client systemd[1]: usr-sbin-mount.lustre.mount: Succeeded. Nov 18 20:15:41 oleg228-client sshd[1537]: Received disconnect from 192.168.200.253 port 38498:11: disconnected by user Nov 18 20:15:41 oleg228-client sshd[1537]: Disconnected from user root 192.168.200.253 port 38498 Nov 18 20:15:41 oleg228-client sshd[1514]: pam_unix(sshd:session): session closed for user root Nov 18 20:15:42 oleg228-client systemd[1]: session-3.scope: Succeeded. Nov 18 20:15:42 oleg228-client systemd-logind[1015]: Session 3 logged out. Waiting for processes to exit. Nov 18 20:15:42 oleg228-client systemd-logind[1015]: Removed session 3.