[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 460942874 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54d0-0x000f54df] [ 0.000000] RAMDISK: [mem 0xbcc64000-0xbffcffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52F0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE2464 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2300 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022C0 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE2374 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE2404 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE243C 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2300-0xbffe2373] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe22ff] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe2374-0xbffe2403] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe2404-0xbffe243b] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe243c-0xbffe2463] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffd9fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4744 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059618 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2895288K/4306400K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001015] APIC: Switch to symmetric I/O mode setup [ 0.002418] x2apic enabled [ 0.003012] Switched APIC routing to physical x2apic. [ 0.004023] kvm-guest: setup PV IPIs [ 0.008607] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.009000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.009023] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.010015] pid_max: default: 32768 minimum: 301 [ 0.012025] LSM: Security Framework initializing [ 0.013063] Yama: becoming mindful. [ 0.014033] SELinux: Initializing. [ 0.015088] *** VALIDATE selinux *** [ 0.024318] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.028773] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.029171] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030141] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.031109] *** VALIDATE tmpfs *** [ 0.033062] *** VALIDATE proc *** [ 0.034112] *** VALIDATE cgroup *** [ 0.034938] *** VALIDATE cgroup2 *** [ 0.035000] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.035151] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.036009] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.037036] Spectre V2 : User space: Vulnerable [ 0.038011] Speculative Store Bypass: Vulnerable [ 0.041580] debug: unmapping init [mem 0xffffffffb5659000-0xffffffffb5660fff] [ 0.043330] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.044793] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.045024] ... version: 2 [ 0.046012] ... bit width: 48 [ 0.047008] ... generic registers: 4 [ 0.048020] ... value mask: 0000ffffffffffff [ 0.049016] ... max period: 00007fffffffffff [ 0.050121] ... fixed-purpose events: 3 [ 0.051013] ... event mask: 000000070000000f [ 0.052311] rcu: Hierarchical SRCU implementation. [ 0.054498] smp: Bringing up secondary CPUs ... [ 0.055529] x86: Booting SMP configuration: [ 0.056023] .... node #0, CPUs: #1 #2 #3 [ 0.059307] smp: Brought up 1 node, 4 CPUs [ 0.061011] smpboot: Max logical packages: 1 [ 0.062016] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.169689] node 0 deferred pages initialised in 106ms [ 0.174106] devtmpfs: initialized [ 0.177660] x86/mm: Memory block size: 128MB [ 0.182104] gcov: version magic: 0x41383552 [ 0.186319] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.187099] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.188468] pinctrl core: initialized pinctrl subsystem [ 0.189407] [ 0.190000] ************************************************************* [ 0.192032] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.196023] ** ** [ 0.198020] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.201023] ** ** [ 0.207033] ** This means that this kernel is built to expose internal ** [ 0.209024] ** IOMMU data structures, which may compromise security on ** [ 0.212022] ** your system. ** [ 0.214022] ** ** [ 0.217028] ** If you see this message and you are not debugging the ** [ 0.220035] ** kernel, report this immediately to your vendor! ** [ 0.222024] ** ** [ 0.225031] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.228022] ************************************************************* [ 0.231781] NET: Registered protocol family 16 [ 0.233592] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.237058] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.240056] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.245137] cpuidle: using governor menu [ 0.247301] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.248759] PCI: Using configuration type 1 for base access [ 0.250170] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.261162] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.266026] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.271113] cryptd: max_cpu_qlen set to 1000 [ 0.274295] ACPI: Added _OSI(Module Device) [ 0.275000] ACPI: Added _OSI(Processor Device) [ 0.276020] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.278021] ACPI: Added _OSI(Processor Aggregator Device) [ 0.283966] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.291282] ACPI: Interpreter enabled [ 0.293062] ACPI: PM: (supports S0 S3 S4 S5) [ 0.295021] ACPI: Using IOAPIC for interrupt routing [ 0.297155] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.301435] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.313294] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.316054] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.320025] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.324103] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.330414] acpiphp: Slot [2] registered [ 0.333164] acpiphp: Slot [5] registered [ 0.335165] acpiphp: Slot [6] registered [ 0.337153] acpiphp: Slot [3] registered [ 0.339127] acpiphp: Slot [4] registered [ 0.342172] acpiphp: Slot [7] registered [ 0.343111] acpiphp: Slot [8] registered [ 0.345141] acpiphp: Slot [9] registered [ 0.347107] acpiphp: Slot [10] registered [ 0.348368] acpiphp: Slot [11] registered [ 0.350172] acpiphp: Slot [12] registered [ 0.352086] acpiphp: Slot [13] registered [ 0.354161] acpiphp: Slot [14] registered [ 0.357141] acpiphp: Slot [15] registered [ 0.359095] acpiphp: Slot [16] registered [ 0.360110] acpiphp: Slot [17] registered [ 0.362115] acpiphp: Slot [18] registered [ 0.364126] acpiphp: Slot [19] registered [ 0.365102] acpiphp: Slot [20] registered [ 0.367192] acpiphp: Slot [21] registered [ 0.369100] acpiphp: Slot [22] registered [ 0.371101] acpiphp: Slot [23] registered [ 0.372117] acpiphp: Slot [24] registered [ 0.374132] acpiphp: Slot [25] registered [ 0.376128] acpiphp: Slot [26] registered [ 0.379165] acpiphp: Slot [27] registered [ 0.380106] acpiphp: Slot [28] registered [ 0.382118] acpiphp: Slot [29] registered [ 0.384087] acpiphp: Slot [30] registered [ 0.386180] acpiphp: Slot [31] registered [ 0.387047] PCI host bridge to bus 0000:00 [ 0.388025] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.390017] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.391020] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.393017] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.395017] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.396019] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.398163] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.399930] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.402126] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.409023] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 0.411943] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.414022] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.416016] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.417012] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.419495] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.421695] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.423034] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.425778] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.429016] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 0.436015] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.441013] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.445968] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.455018] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.469019] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.495019] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.511543] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.519966] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.539030] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.562017] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.574611] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.577531] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.579426] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.581514] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.586284] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.590265] iommu: Default domain type: Passthrough [ 0.592391] SCSI subsystem initialized [ 0.594535] ACPI: bus type USB registered [ 0.597216] usbcore: registered new interface driver usbfs [ 0.601156] usbcore: registered new interface driver hub [ 0.603179] usbcore: registered new device driver usb [ 0.606200] pps_core: LinuxPPS API ver. 1 registered [ 0.608019] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.611081] PTP clock support registered [ 0.614092] EDAC MC: Ver: 3.0.0 [ 0.615448] PCI: Using ACPI for IRQ routing [ 0.616000] NetLabel: Initializing [ 0.618020] NetLabel: domain hash size = 128 [ 0.620017] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.623124] NetLabel: unlabeled traffic allowed by default [ 0.626026] vgaarb: loaded [ 0.628371] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.629021] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.634000] clocksource: Switched to clocksource kvm-clock [ 0.762962] VFS: Disk quotas dquot_6.6.0 [ 0.764850] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.768089] *** VALIDATE ramfs *** [ 0.769639] *** VALIDATE hugetlbfs *** [ 0.774928] pnp: PnP ACPI init [ 0.778039] pnp: PnP ACPI: found 6 devices [ 0.797265] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.801635] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.803778] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.806239] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.809444] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.812390] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.816078] NET: Registered protocol family 2 [ 0.819258] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.825500] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.829188] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.837939] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.841882] TCP: Hash tables configured (established 65536 bind 65536) [ 0.845388] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.848621] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.852316] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.856251] NET: Registered protocol family 1 [ 0.859571] RPC: Registered named UNIX socket transport module. [ 0.862104] RPC: Registered udp transport module. [ 0.864719] RPC: Registered tcp transport module. [ 0.867466] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.871183] NET: Registered protocol family 44 [ 0.873357] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.876262] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.879247] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.882426] PCI: CLS 0 bytes, default 64 [ 0.884476] Unpacking initramfs... [ 2.428395] debug: unmapping init [mem 0xffffa0bafcc64000-0xffffa0bafffcffff] [ 2.433075] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.435447] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.438944] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.948150] Initialise system trusted keyrings [ 2.950206] Key type blacklist registered [ 2.952492] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.963613] zbud: loaded [ 2.968098] *** VALIDATE nfs *** [ 2.969557] *** VALIDATE nfs4 *** [ 2.971752] pstore: using deflate compression [ 2.977113] Platform Keyring initialized [ 3.127628] NET: Registered protocol family 38 [ 3.129640] Key type asymmetric registered [ 3.131332] Asymmetric key parser 'x509' registered [ 3.133367] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.136784] io scheduler mq-deadline registered [ 3.140833] io scheduler kyber registered [ 3.142777] io scheduler bfq registered [ 3.145368] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.149488] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.153653] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.157628] ACPI: Power Button [PWRF] [ 3.165930] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.173223] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.190099] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.222072] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.252650] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.258453] Non-volatile memory driver v1.3 [ 3.260580] Linux agpgart interface v0.103 [ 3.304185] virtio_blk virtio1: [vda] 146728 512-byte logical blocks (75.1 MB/71.6 MiB) [ 3.308211] vda: detected capacity change from 0 to 75124736 [ 3.321896] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.325118] vdb: detected capacity change from 0 to 1073741824 [ 3.330955] libphy: Fixed MDIO Bus: probed [ 3.342563] usbcore: registered new interface driver usbserial_generic [ 3.345323] usbserial: USB Serial support registered for generic [ 3.347769] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.351185] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.352636] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.355269] mousedev: PS/2 mouse device common for all mice [ 3.358619] rtc_cmos 00:05: RTC can wake from S4 [ 3.362612] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.364329] rtc_cmos 00:05: registered as rtc0 [ 3.371510] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.373932] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.375671] intel_pstate: CPU model not supported [ 3.382161] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.387774] hid: raw HID events driver (C) Jiri Kosina [ 3.390829] usbcore: registered new interface driver usbhid [ 3.393664] usbhid: USB HID core driver [ 3.396514] drop_monitor: Initializing network drop monitor service [ 3.398962] Initializing XFRM netlink socket [ 3.401367] NET: Registered protocol family 10 [ 3.404879] Segment Routing with IPv6 [ 3.406479] NET: Registered protocol family 17 [ 3.408864] mpls_gso: MPLS GSO support [ 3.417933] RAS: Correctable Errors collector initialized. [ 3.420431] AVX version of gcm_enc/dec engaged. [ 3.422244] AES CTR mode by8 optimization enabled [ 3.504990] sched_clock: Marking stable (3504898741, 0)->(4520783312, -1015884571) [ 3.510729] registered taskstats version 1 [ 3.513347] Loading compiled-in X.509 certificates [ 3.515069] zswap: loaded using pool lzo/zbud [ 3.543482] Key type big_key registered [ 3.558036] Key type encrypted registered [ 3.559924] ima: No TPM chip found, activating TPM-bypass! [ 3.562467] ima: Allocated hash algorithm: sha1 [ 3.564351] ima: No architecture policies found [ 3.566643] evm: Initialising EVM extended attributes: [ 3.569138] evm: security.selinux [ 3.570973] evm: security.ima [ 3.572951] evm: security.capability [ 3.575355] evm: HMAC attrs: 0x1 [ 3.578939] rtc_cmos 00:05: setting system clock to 2026-09-07 22:49:58 UTC (1788821398) [ 3.587386] debug: unmapping init [mem 0xffffffffb6603000-0xffffffffb67fffff] [ 3.591621] debug: unmapping init [mem 0xffffffffb5382000-0xffffffffb5658fff] [ 3.600088] Write protecting the kernel read-only data: 28672k [ 3.604429] debug: unmapping init [mem 0xffffffffb3a03000-0xffffffffb3bfffff] [ 3.608175] debug: unmapping init [mem 0xffffffffb4314000-0xffffffffb43fffff] [ 3.646484] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.656684] systemd[1]: Detected virtualization kvm. [ 3.660289] systemd[1]: Detected architecture x86-64. [ 3.663883] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.700163] systemd[1]: No hostname configured. [ 3.703324] systemd[1]: Set hostname to . [ 3.706215] random: systemd: uninitialized urandom read (16 bytes read) [ 3.710413] systemd[1]: Initializing machine ID from random generator. [ 3.773882] random: ln: uninitialized urandom read (6 bytes read) [ 3.907680] random: systemd: uninitialized urandom read (16 bytes read) [ 3.911197] systemd[1]: Reached target Initrd Root Device. [ OK ] Reached target Initrd Root Device. [ 3.920096] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 3.933492] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Started Dispatch Password Requests to Console Directory Watch. Starting Setup Virtual Console... [ OK ] Reached target Swap. [ OK ] Reached target Slices. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Apply Kernel Variables... [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Reached target Timers. [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. [ 4.622074] random: fast init done Starting dracut pre-udev hook... [ 4.696549] device-mapper: uevent: version 1.0.3 [ 4.699138] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ 5.635308] virtio_net virtio0 ens2: renamed from eth0 [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 5.747048] scsi host0: ata_piix [ 5.817764] scsi host1: ata_piix [ 5.819791] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 5.822765] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 9.572340] dracut-initqueue[587]: RTNETLINK answers: File exists [ 10.084255] random: crng init done [ 10.085694] random: 7 urandom warning(s) missed due to ratelimiting Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Mounting /sysroot... [ 10.972380] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Timers. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped target Basic System. [ OK ] Stopped target Paths. [ OK ] Stopped target Slices. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Sockets. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 12.409482] printk: systemd: 26 output lines suppressed due to ratelimiting [ 12.712967] SELinux: Disabled at runtime. [ 12.772623] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 12.782862] systemd[1]: Detected virtualization kvm. [ 12.784908] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 13.422551] systemd[1]: initrd-switch-root.service: Succeeded. [ 13.426986] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 13.434319] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 13.441458] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 13.447315] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 13.458685] systemd[1]: Starting Journal Service... Starting Journal Service... [ 13.464287] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Created slice User and Session Slice. Activating swap /dev/disk/by-label/SWAP... [ 13.519525] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ OK ] Listening on Process Core Dump Socket. Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Created slice system-getty.slice. [ OK ] Listening on initctl Compatibility Named Pipe. Mounting POSIX Message Queue File System... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target rpc_pipefs.target. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Reached target Slices. [ OK ] Reached target Local Encrypted Volumes. Starting Apply Kernel Variables... Mounting Huge Pages File System... [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Activated swap /dev/disk/by-label/SWAP. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... [ OK ] Reached target Swap. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Mounted /mnt. [ OK ] Started udev Coldplug all Devices. [ 14.021077] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 14.467744] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 14.480495] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 14.603105] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 14.673350] EDAC sbridge: Ver: 1.1.2 [ 14.750081] hrtimer: interrupt took 3071644 ns [ 18.084694] Key type dns_resolver registered [ 18.803365] NFS: Registering the id_resolver key type [ 18.807132] Key type id_resolver registered [ 18.808256] Key type id_legacy registered [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Mark the need to relabel after reboot... Starting Create Volatile Files and Directories... Starting Rebuild Dynamic Linker Cache... Starting Load/Save Random Seed... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started dnf makecache --timer. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Started irqbalance daemon. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. Starting Restore /run/initramfs on shutdown... Starting Login Service... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Login Service. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Started Serial Getty on ttyS1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Starting Authorization Manager... Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg416-client login: [ 76.667236] libcfs: loading out-of-tree module taints kernel. [ 76.970672] Key type ._llcrypt registered [ 76.975380] Key type .llcrypt registered [ 77.470372] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 77.479630] alg: No test for adler32 (adler32-zlib) [ 79.054662] Lustre: Lustre: Build Version: 2.17.57_113_gf5ca795 [ 80.047056] LNet: Added LNI 192.168.204.16@tcp [8/256/0/180] [ 81.751258] Key type lgssc registered [ 83.746697] Lustre: Echo OBD driver; http://www.lustre.org/ [ 255.842292] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 259.885861] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 272.264196] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing check_logdir /tmp/testlogs/ [ 277.000505] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing yml_node [ 281.567810] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 24s idle [ 282.598606] Lustre: DEBUG MARKER: Client: 2.17.57.113 [ 284.719644] Lustre: DEBUG MARKER: MDS: 2.17.57.113 [ 286.878261] Lustre: DEBUG MARKER: OSS: 2.17.57.113 [ 288.240520] Lustre: DEBUG MARKER: -----============= acceptance-small: sanityn ============----- Mon Sep 7 18:54:42 EDT 2026 [ 302.640197] Lustre: DEBUG MARKER: excepting tests: 27 40a [ 304.095355] Lustre: DEBUG MARKER: skipping tests SLOW=no: 33a [ 305.692837] Lustre: DEBUG MARKER: === sanityn: start setup 18:54:59 (1788821699) === [ 306.450241] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 312.870114] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing check_config_client /mnt/lustre [ 335.954909] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 349.765952] Lustre: DEBUG MARKER: === sanityn: finish setup 18:55:43 (1788821743) === [ 351.579861] Lustre: DEBUG MARKER: == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 18:55:45 (1788821745) [ 359.493875] Lustre: DEBUG MARKER: == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 18:55:53 (1788821753) [ 366.158184] Lustre: DEBUG MARKER: == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 18:55:59 (1788821759) [ 372.198351] Lustre: DEBUG MARKER: == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 18:56:05 (1788821765) [ 378.282414] Lustre: DEBUG MARKER: == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 18:56:12 (1788821772) [ 384.485601] Lustre: DEBUG MARKER: == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 18:56:18 (1788821778) [ 390.781926] Lustre: DEBUG MARKER: == sanityn test 2e: check chmod on root is propagated to others ========================================================== 18:56:24 (1788821784) [ 395.829470] Lustre: DEBUG MARKER: == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 18:56:29 (1788821789) [ 401.602120] Lustre: DEBUG MARKER: == sanityn test 2g: check blocks update on sync write ==== 18:56:35 (1788821795) [ 407.500478] Lustre: DEBUG MARKER: == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 18:56:41 (1788821801) [ 413.236819] Lustre: DEBUG MARKER: == sanityn test 4: fstat validation on multiple mount points ==================================================================== 18:56:46 (1788821806) [ 420.765659] Lustre: DEBUG MARKER: == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 18:56:54 (1788821814) [ 424.416167] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 22s idle [ 424.423081] Lustre: Skipped 1 previous similar message [ 428.258262] Lustre: DEBUG MARKER: == sanityn test 6: remove of open file on other node ============================================================================ 18:57:01 (1788821821) [ 434.657939] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: disconnect after 20s idle [ 435.977297] Lustre: DEBUG MARKER: == sanityn test 7: remove of open directory on other node ======================================================================= 18:57:09 (1788821829) [ 442.218353] Lustre: DEBUG MARKER: == sanityn test 8: remove of open special file on other node ==================================================================== 18:57:15 (1788821835) [ 449.089378] Lustre: DEBUG MARKER: == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 18:57:22 (1788821842) [ 455.138977] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 21s idle [ 456.377714] Lustre: DEBUG MARKER: == sanityn test 9b: append to striped sparse file ======== 18:57:29 (1788821849) [ 462.085807] Lustre: DEBUG MARKER: == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 18:57:35 (1788821855) [ 469.094336] Lustre: DEBUG MARKER: == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 18:57:42 (1788821862) [ 476.092480] Lustre: DEBUG MARKER: == sanityn test 11: execution of file opened for write should return error ============================================================== 18:57:49 (1788821869) [ 482.995511] Lustre: DEBUG MARKER: == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 18:57:56 (1788821876) [ 483.820874] Lustre: DEBUG MARKER: start dir: /mnt/lustre/lockdir=144115205289279518 file: /mnt/lustre/lockdir/lockfile=144115205289279517 [ 622.636687] Lustre: DEBUG MARKER: == sanityn test 13: test directory page revocation ======= 19:00:16 (1788822016) [ 631.579847] Lustre: DEBUG MARKER: == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 19:00:25 (1788822025) [ 638.251431] Lustre: DEBUG MARKER: == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 19:00:31 (1788822031) [ 646.484566] Lustre: DEBUG MARKER: == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 19:00:39 (1788822039) [ 656.561503] Lustre: DEBUG MARKER: == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 19:00:49 (1788822049) [ 664.688492] Lustre: DEBUG MARKER: == sanityn test 14d: chmod of executing file is still possible ================================================================== 19:00:58 (1788822058) [ 667.395116] Lustre: DEBUG MARKER: chmod [ 675.456251] Lustre: DEBUG MARKER: == sanityn test 15: test out-of-space with multiple writers ===================================================================== 19:01:08 (1788822068) [ 1589.584861] Lustre: DEBUG MARKER: == sanityn test 16a: 2500 iterations of dual-mount fsx === 19:16:23 (1788822983) [ 1750.495330] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: disconnect after 22s idle [ 1834.313653] Lustre: DEBUG MARKER: == sanityn test 16b: 2500 iterations of dual-mount fsx at small size ========================================================== 19:20:27 (1788823227) [ 1979.815917] Lustre: DEBUG MARKER: == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 19:22:52 (1788823372) [ 2157.023736] Lustre: DEBUG MARKER: == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 19:25:50 (1788823550) [ 2197.961447] Lustre: DEBUG MARKER: == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 19:26:31 (1788823591) [ 2201.058893] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: disconnect after 22s idle [ 2207.093948] Lustre: DEBUG MARKER: == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 19:26:40 (1788823600) [ 2208.676154] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2208.810678] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2208.902502] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2208.973900] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.051434] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.126766] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.194629] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.275579] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.417367] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.565966] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.705349] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.810813] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2209.895306] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.029736] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.142806] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.270235] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.348208] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.444843] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.549516] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.654311] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.765951] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.820269] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.883359] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2210.980671] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.107221] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.208326] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.298843] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.411798] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.537678] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.629147] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.699609] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.776837] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.847511] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2211.939044] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.017356] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.110893] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.190369] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.336367] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.492706] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.643296] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.726199] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.812758] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.878755] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2212.961874] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.047575] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.146663] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.253748] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.370460] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.459466] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.545658] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.624660] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.678820] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.773752] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.864583] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2213.941057] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.003920] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.107134] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.209637] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.293933] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.446379] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.576379] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.719199] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2214.880582] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.011960] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.241607] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.435895] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.575386] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.710303] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.754118] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.848672] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2215.980705] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.056117] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.166596] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.272194] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.374887] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.498866] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.615841] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.687246] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.764546] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.843708] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2216.940719] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.022694] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.094446] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.163642] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.234517] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.321522] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.397736] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.501554] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.611980] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.741291] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2217.904437] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.049848] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.172915] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.312508] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.392911] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.468525] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.560771] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.658385] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.746394] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.836846] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.914994] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2218.967348] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.044441] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.135890] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.214456] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.286469] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.376410] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.441667] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.534683] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.610555] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.683868] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.757266] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.819479] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.897045] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2219.984135] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.072518] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.134710] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.195878] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.276507] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.345825] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.425627] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.492766] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.549820] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.612775] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.711137] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.782816] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.865856] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2220.954336] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.023665] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.101269] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.187774] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.261538] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.338594] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.408717] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.499783] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.535310] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 20s idle [ 2221.597565] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.675372] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.738981] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.803083] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.874763] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2221.969967] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.040763] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.117325] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.199136] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.286768] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.376074] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.474639] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.563498] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.642178] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.716364] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.798722] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.885617] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2222.958670] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.039370] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.096672] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.163250] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.237290] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.324706] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.394909] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.471811] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.537211] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.591656] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.649050] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.729300] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.806306] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.867381] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2223.940478] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.015276] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.098567] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.174417] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.248916] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.322658] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.402739] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.493957] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.570605] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.653640] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.756235] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.839328] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2224.912057] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.008289] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.099096] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.189401] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.291507] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.378781] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.452463] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.529615] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.614103] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.715636] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.775486] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.842484] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.920664] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2225.993366] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.067458] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.148305] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.213504] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.301417] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.390577] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.462527] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.535655] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.626672] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.713613] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.782431] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2226.859332] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2227.016665] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2227.125785] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2227.255883] rw_seq_cst_vs_d (32439): drop_caches: 3 [ 2236.521423] Lustre: DEBUG MARKER: == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 19:27:09 (1788823629) [ 2237.031940] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.065431] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.222155] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.352665] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.410896] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.499398] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.629871] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2237.875629] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2238.162620] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2238.279708] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2238.494388] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2238.733099] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2238.827758] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.001378] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.194191] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.287587] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.469389] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.625389] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2239.900293] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.049471] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.135653] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.240178] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.348089] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.512456] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.621673] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.773456] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.843195] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.886426] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2240.989799] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.037824] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.112417] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.282872] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.328260] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.397987] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.465546] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.539277] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.639868] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.782435] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.860498] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2241.986757] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.144262] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.196918] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.331223] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.388444] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.649487] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.769088] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2242.929565] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.214835] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.271274] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.399413] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.518609] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.568252] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.734028] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.783946] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.850207] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2243.915196] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.230527] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.292339] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.434817] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.508264] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.653625] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.824995] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.895389] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2244.964550] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.103171] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.223718] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.343253] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.478294] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.595609] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.715274] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.880322] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2245.959288] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.100563] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.347808] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.484596] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.555753] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.602447] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.751910] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.885738] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2246.991488] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.137278] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: disconnect after 20s idle [ 2247.153174] Lustre: Skipped 1 previous similar message [ 2247.181982] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.294930] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.449713] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.519480] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.627812] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.850941] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2247.906083] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.091079] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.199252] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.269607] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.346190] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.503353] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.859939] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2248.940205] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.132742] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.210462] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.372735] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.479476] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.620037] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.665449] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.847779] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2249.928326] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.061933] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.238892] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.336596] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.485214] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.674712] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.820931] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2250.932909] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.136421] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.265821] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.405352] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.448755] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.509735] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.575584] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.688438] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.788962] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2251.854778] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.072527] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.179571] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.256332] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 20s idle [ 2252.325388] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.453632] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.594846] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.772256] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2252.960700] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.018444] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.162115] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.222969] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.377797] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.529613] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.593897] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.727961] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.773901] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.822898] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.932997] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2253.973160] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.178741] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.291986] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.420668] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.538884] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.603601] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.695876] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.805560] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.859842] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2254.984068] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.142405] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.283671] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.432581] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.545176] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.647991] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.803821] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.876122] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2255.977892] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2256.128797] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2256.260983] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2256.304436] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2256.426832] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2256.497743] rw_seq_cst_vs_d (33032): drop_caches: 3 [ 2265.359233] Lustre: DEBUG MARKER: == sanityn test 16h: mmap read after truncate file ======= 19:27:38 (1788823658) [ 2273.796579] Lustre: DEBUG MARKER: == sanityn test 16i: read after truncate file ============ 19:27:47 (1788823667) [ 2282.660466] Lustre: DEBUG MARKER: == sanityn test 16j: race dio with buffered i/o ========== 19:27:55 (1788823675) [ 2282.980487] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 20s idle [ 2320.161402] Lustre: DEBUG MARKER: == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 19:28:33 (1788823713) [ 2320.921647] bash (35535): drop_caches: 3 [ 2324.128217] bash (35535): drop_caches: 3 [ 2327.338207] bash (35535): drop_caches: 3 [ 2330.481580] bash (35535): drop_caches: 3 [ 2333.633604] bash (35535): drop_caches: 3 [ 2336.768829] bash (35535): drop_caches: 3 [ 2339.933657] bash (35535): drop_caches: 3 [ 2342.373098] Lustre: lustre-OST0000-osc-ffffa0bb44d21800: disconnect after 20s idle [ 2342.377540] Lustre: Skipped 1 previous similar message [ 2343.066896] bash (35535): drop_caches: 3 [ 2346.217339] bash (35535): drop_caches: 3 [ 2349.377833] bash (35535): drop_caches: 3 [ 2352.592073] bash (35535): drop_caches: 3 [ 2356.127381] bash (35535): drop_caches: 3 [ 2359.283881] bash (35535): drop_caches: 3 [ 2362.405288] bash (35535): drop_caches: 3 [ 2365.536067] bash (35535): drop_caches: 3 [ 2368.838873] bash (35535): drop_caches: 3 [ 2374.522325] Lustre: DEBUG MARKER: == sanityn test 17: resource creation/LVB creation race ========================================================================= 19:29:27 (1788823767) [ 2384.418852] Lustre: DEBUG MARKER: == sanityn test 18: mmap sanity check =========================================================================================== 19:29:37 (1788823777) [ 2418.611179] Lustre: DEBUG MARKER: == sanityn test 19: test concurrent uncached read races ========================================================================= 19:30:11 (1788823811) [ 2428.423690] Lustre: DEBUG MARKER: loop 5 [ 2429.419873] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 21s idle [ 2434.125885] Lustre: DEBUG MARKER: loop 10 [ 2439.945989] Lustre: DEBUG MARKER: loop 15 [ 2445.310876] Lustre: DEBUG MARKER: loop 20 [ 2454.114576] Lustre: DEBUG MARKER: == sanityn test 20: test extra readahead page left in cache ============================================================== 19:30:47 (1788823847) [ 2461.696619] Lustre: DEBUG MARKER: == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 19:30:55 (1788823855) [ 2468.988161] Lustre: DEBUG MARKER: == sanityn test 23: others should see updated atime while another read============================================================== 19:31:02 (1788823862) [ 2539.448273] Lustre: DEBUG MARKER: == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 19:32:12 (1788823932) [ 2547.938309] Lustre: DEBUG MARKER: == sanityn test 24b: lfs df should show both filesystems ========================================================================= 19:32:21 (1788823941) [ 2556.929168] Lustre: DEBUG MARKER: == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 19:32:30 (1788823950) [ 2565.684051] Lustre: DEBUG MARKER: == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 19:32:38 (1788823958) [ 2573.318160] Lustre: DEBUG MARKER: == sanityn test 26a: allow mtime to get older ============ 19:32:46 (1788823966) [ 2581.626370] Lustre: DEBUG MARKER: == sanityn test 26b: sync mtime between ost and mds ====== 19:32:54 (1788823974) [ 2588.129828] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 24s idle [ 2588.140490] Lustre: Skipped 5 previous similar messages [ 2590.789679] Lustre: DEBUG MARKER: == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 19:33:04 (1788823984) [ 2598.336845] Lustre: DEBUG MARKER: SKIP: sanityn test_27 skipping excluded test 27 [ 2600.284420] Lustre: DEBUG MARKER: == sanityn test 30: recreate file race =================== 19:33:13 (1788823993) [ 2609.182636] Lustre: DEBUG MARKER: == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 19:33:22 (1788824002) [ 2609.748823] Lustre: *** cfs_fail_loc=314, val=0*** [ 2610.783257] Lustre: *** cfs_fail_loc=314, val=0*** [ 2610.788518] Lustre: Skipped 2 previous similar messages [ 2617.479967] Lustre: DEBUG MARKER: == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 19:33:30 (1788824010) [ 2627.012911] Lustre: *** cfs_fail_loc=314, val=0*** [ 2627.090371] LustreError: lustre-OST0000-osc-ffffa0bb44d21800: operation ldlm_enqueue to node 192.168.204.116@tcp failed: rc = -107 [ 2627.100507] Lustre: lustre-OST0000-osc-ffffa0bb44d21800: Connection to lustre-OST0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2627.115487] LustreError: lustre-OST0000-osc-ffffa0bb44d21800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2627.125781] Lustre: 2402:0:(llite_lib.c:4342:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.204.116@tcp:/lustre/fid: [0x200000403:0x29:0x0]// may get corrupted (rc -108) [ 2627.146541] LustreError: 46465:0:(ldlm_resource.c:1207:ldlm_resource_complain()) lustre-OST0000-osc-ffffa0bb44d21800: namespace resource [0x280000401:0x38:0x0].0x0 (ffffa0bb529bf100) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 2627.182142] Lustre: lustre-OST0000-osc-ffffa0bb44d21800: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [ 2635.247899] Lustre: DEBUG MARKER: == sanityn test 31r: open-rename(replace) race =========== 19:33:48 (1788824028) [ 2635.614851] LustreError: 47055:0:(file.c:850:ll_intent_file_open()) cfs_fail_timeout id 1419 sleeping for 3000ms [ 2638.647118] LustreError: 47055:0:(file.c:850:ll_intent_file_open()) cfs_fail_timeout id 1419 awake [ 2644.868134] Lustre: DEBUG MARKER: == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 19:33:58 (1788824038) [ 2652.221048] Lustre: DEBUG MARKER: == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 19:34:05 (1788824045) [ 2660.132268] Lustre: DEBUG MARKER: == sanityn test 32b: lockless i/o ======================== 19:34:13 (1788824053) [ 2661.817522] Lustre: DEBUG MARKER: SKIP: sanityn test_32b max_nolock_bytes is removed >= 2.17.53 [ 2663.633790] Lustre: DEBUG MARKER: == sanityn test 32c: contention detection ================ 19:34:17 (1788824057) [ 2695.852616] Lustre: DEBUG MARKER: SKIP: sanityn test_33a skipping SLOW test 33a [ 2697.952080] Lustre: DEBUG MARKER: == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 19:34:51 (1788824091) [ 2700.027321] Lustre: DEBUG MARKER: SKIP: sanityn test_33b Need two or more clients, have 1 [ 2701.519995] Lustre: DEBUG MARKER: == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 19:34:55 (1788824095) [ 2705.911505] Lustre: lustre-MDT0000-mdc-ffffa0bb455ee000: Connection to lustre-MDT0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2716.144930] LustreError: MGC192.168.204.116@tcp: Connection to MGS (at 192.168.204.116@tcp) was lost; in progress operations using this service will fail [ 2716.179943] Lustre: Evicted from MGS (at 192.168.204.116@tcp) after server handle changed from 0x3c7b1c832534d710 to 0x3c7b1c83253f827c [ 2716.189359] Lustre: MGC192.168.204.116@tcp: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [ 2719.388214] Lustre: lustre-MDT0000-mdc-ffffa0bb455ee000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [ 2721.247444] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: disconnect after 23s idle [ 2721.255045] Lustre: Skipped 4 previous similar messages [ 2758.775366] Lustre: DEBUG MARKER: == sanityn test 33d: dependent transactions should trigger COS ========================================================== 19:35:52 (1788824152) [ 2814.543796] Lustre: DEBUG MARKER: == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 19:36:47 (1788824207) [ 2837.084098] Lustre: DEBUG MARKER: == sanityn test 34: no lock timeout under IO ============= 19:37:09 (1788824229) [ 2894.280885] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: Connection to lustre-OST0001 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2894.292725] Lustre: Skipped 1 previous similar message [ 2894.318148] LustreError: lustre-OST0001-osc-ffffa0bb44d21800: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 2894.335764] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [ 2894.339201] LustreError: lustre-OST0001-osc-ffffa0bb455ee000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 2894.344824] Lustre: Skipped 1 previous similar message [ 2909.664751] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: Connection to lustre-OST0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2909.685472] Lustre: Skipped 1 previous similar message [ 2909.705392] LustreError: lustre-OST0000-osc-ffffa0bb455ee000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 2909.724126] Lustre: lustre-OST0000-osc-ffffa0bb455ee000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [ 2909.735023] Lustre: Skipped 1 previous similar message [ 2928.032395] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2929.839418] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid in FULL state after 0 sec [ 2936.761617] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2938.668632] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid in IDLE state after 0 sec [ 2947.393722] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2948.996591] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid in FULL state after 0 sec [ 2954.749221] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2956.296859] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid in IDLE state after 0 sec [ 2968.862140] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2970.642605] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffffa0bb44d21800.ost_server_uuid in FULL state after 0 sec [ 2976.451911] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid 50 [ 2978.195877] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffffa0bb44d21800.ost_server_uuid in IDLE state after 0 sec [ 2980.112949] Lustre: DEBUG MARKER: == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 19:39:33 (1788824373) [ 2983.267903] Lustre: DEBUG MARKER: Race attempt 0 [ 2986.206753] Lustre: DEBUG MARKER: Wait for 59667 59693 for 60 sec... [ 3052.863469] Lustre: DEBUG MARKER: == sanityn test 36: handle ESTALE/open-unlink correctly == 19:40:46 (1788824446) [ 3061.046496] Lustre: DEBUG MARKER: start test - cycle (0) [ 3082.952139] Lustre: DEBUG MARKER: start test - cycle (1) [ 3106.036377] Lustre: DEBUG MARKER: start test - cycle (2) [ 3131.901802] Lustre: DEBUG MARKER: start test - cycle (3) [ 3135.967350] Lustre: lustre-OST0001-osc-ffffa0bb44d21800: disconnect after 22s idle [ 3135.977349] Lustre: Skipped 10 previous similar messages [ 3151.423478] Lustre: DEBUG MARKER: start test - cycle (4) [ 3172.463254] Lustre: DEBUG MARKER: start test - cycle (5) [ 3192.998260] Lustre: DEBUG MARKER: start test - cycle (6) [ 3213.309927] Lustre: DEBUG MARKER: start test - cycle (7) [ 3233.818649] Lustre: DEBUG MARKER: start test - cycle (8) [ 3254.340091] Lustre: DEBUG MARKER: start test - cycle (9) [ 3280.848674] Lustre: DEBUG MARKER: start test - cycle (10) [ 3305.965591] Lustre: DEBUG MARKER: == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 19:44:59 (1788824699) [ 3372.274717] Lustre: DEBUG MARKER: == sanityn test 39a: file mtime does not change after rename ========================================================== 19:46:06 (1788824766) [ 3377.606345] Lustre: DEBUG MARKER: == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 19:46:11 (1788824771) [ 3383.415729] Lustre: DEBUG MARKER: == sanityn test 39c: check truncate mtime update ================================================================================ 19:46:17 (1788824777) [ 3389.701716] Lustre: DEBUG MARKER: == sanityn test 39d: sync write should update mtime ====== 19:46:23 (1788824783) [ 3389.895437] Lustre: *** cfs_fail_loc=411, val=0*** [ 3394.513257] Lustre: DEBUG MARKER: SKIP: sanityn test_40a skipping ALWAYS excluded test 40a [ 3395.808876] Lustre: DEBUG MARKER: == sanityn test 40b: pdirops: open|create and others ======================================================================== 19:46:29 (1788824789) [ 3409.543564] Lustre: DEBUG MARKER: == sanityn test 40c: pdirops: link and others ======================================================================== 19:46:43 (1788824803) [ 3423.141322] Lustre: DEBUG MARKER: == sanityn test 40d: pdirops: unlink and others ======================================================================== 19:46:56 (1788824816) [ 3438.099342] Lustre: DEBUG MARKER: == sanityn test 40e: pdirops: rename and others ======================================================================== 19:47:11 (1788824831) [ 3451.677693] Lustre: DEBUG MARKER: == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 19:47:25 (1788824845) [ 3461.342392] Lustre: DEBUG MARKER: == sanityn test 41b: pdirops: create vs create ======================================================================== 19:47:35 (1788824855) [ 3471.870909] Lustre: DEBUG MARKER: == sanityn test 41c: pdirops: create vs link ======================================================================== 19:47:45 (1788824865) [ 3482.133339] Lustre: DEBUG MARKER: == sanityn test 41d: pdirops: create vs unlink ======================================================================== 19:47:56 (1788824876) [ 3492.246662] Lustre: DEBUG MARKER: == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 19:48:06 (1788824886) [ 3502.130753] Lustre: DEBUG MARKER: == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 19:48:16 (1788824896) [ 3511.614321] Lustre: DEBUG MARKER: == sanityn test 41g: pdirops: create vs getattr ======================================================================== 19:48:25 (1788824905) [ 3521.194304] Lustre: DEBUG MARKER: == sanityn test 41h: pdirops: create vs readdir ======================================================================== 19:48:35 (1788824915) [ 3531.154385] Lustre: DEBUG MARKER: == sanityn test 41i: reint_open: create vs create ======== 19:48:45 (1788824925) [ 4149.727660] Lustre: lustre-OST0000-osc-ffffa0bb44d21800: disconnect after 23s idle [ 4149.736311] Lustre: Skipped 9 previous similar messages [ 4444.047389] Lustre: DEBUG MARKER: == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 20:03:58 (1788825838) [ 4453.850617] Lustre: DEBUG MARKER: == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 20:04:07 (1788825847) [ 4463.019260] Lustre: DEBUG MARKER: == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 20:04:16 (1788825856) [ 4471.119592] Lustre: DEBUG MARKER: == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 20:04:25 (1788825865) [ 4480.028330] Lustre: DEBUG MARKER: == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 20:04:34 (1788825874) [ 4489.595698] Lustre: DEBUG MARKER: == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 20:04:43 (1788825883) [ 4499.110249] Lustre: DEBUG MARKER: == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 20:04:52 (1788825892) [ 4508.229927] Lustre: DEBUG MARKER: == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 20:05:02 (1788825902) [ 4518.021268] Lustre: DEBUG MARKER: == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 20:05:11 (1788825911) [ 4591.176539] Lustre: DEBUG MARKER: == sanityn test 43b: pdirops: unlink vs create ======================================================================== 20:06:25 (1788825985) [ 4600.556827] Lustre: DEBUG MARKER: == sanityn test 43c: pdirops: unlink vs link ======================================================================== 20:06:34 (1788825994) [ 4610.697577] Lustre: DEBUG MARKER: == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 20:06:44 (1788826004) [ 4620.226570] Lustre: DEBUG MARKER: == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 20:06:54 (1788826014) [ 4629.747729] Lustre: DEBUG MARKER: == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 20:07:03 (1788826023) [ 4639.128759] Lustre: DEBUG MARKER: == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 20:07:13 (1788826033) [ 4648.429372] Lustre: DEBUG MARKER: == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 20:07:22 (1788826042) [ 4656.604147] Lustre: DEBUG MARKER: == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 20:07:30 (1788826050) [ 4665.537821] Lustre: DEBUG MARKER: == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 20:07:39 (1788826059) [ 4744.535566] Lustre: DEBUG MARKER: == sanityn test 43k: unlink vs create ==================== 20:08:58 (1788826138) [ 4794.848700] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 22s idle [ 4794.858877] Lustre: Skipped 6 previous similar messages [ 5635.995826] Lustre: DEBUG MARKER: == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 20:23:50 (1788827030) [ 5643.039755] Lustre: DEBUG MARKER: == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 20:23:57 (1788827037) [ 5649.887534] Lustre: lustre-OST0000-osc-ffffa0bb44d21800: disconnect after 24s idle [ 5649.893084] Lustre: Skipped 2 previous similar messages [ 5650.533472] Lustre: DEBUG MARKER: == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 20:24:04 (1788827044) [ 5658.441605] Lustre: DEBUG MARKER: == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 20:24:12 (1788827052) [ 5665.821812] Lustre: DEBUG MARKER: == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 20:24:20 (1788827060) [ 5673.159322] Lustre: DEBUG MARKER: == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 20:24:27 (1788827067) [ 5682.011893] Lustre: DEBUG MARKER: == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 20:24:36 (1788827076) [ 5690.969868] Lustre: DEBUG MARKER: == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 20:24:44 (1788827084) [ 5700.066563] Lustre: DEBUG MARKER: == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 20:24:54 (1788827094) [ 5709.536692] Lustre: DEBUG MARKER: == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 20:25:03 (1788827103) [ 5817.686923] Lustre: DEBUG MARKER: == sanityn test 45b: pdirops: rename src vs create ======================================================================== 20:26:51 (1788827211) [ 5825.218284] Lustre: DEBUG MARKER: == sanityn test 45c: pdirops: rename src vs link ======================================================================== 20:26:59 (1788827219) [ 5833.123437] Lustre: DEBUG MARKER: == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 20:27:07 (1788827227) [ 5840.294660] Lustre: DEBUG MARKER: == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 20:27:14 (1788827234) [ 5847.987791] Lustre: DEBUG MARKER: == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 20:27:22 (1788827242) [ 5855.460400] Lustre: DEBUG MARKER: == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 20:27:29 (1788827249) [ 5862.449621] Lustre: DEBUG MARKER: == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 20:27:36 (1788827256) [ 5869.568439] Lustre: DEBUG MARKER: == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 20:27:43 (1788827263) [ 5877.201152] Lustre: DEBUG MARKER: == sanityn test 45j: read vs rename ====================== 20:27:51 (1788827271) [ 6315.488404] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 22s idle [ 6315.500705] Lustre: Skipped 3 previous similar messages [ 6692.050915] Lustre: DEBUG MARKER: == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 20:41:25 (1788828085) [ 6703.100323] Lustre: DEBUG MARKER: == sanityn test 46b: pdirops: link vs create ======================================================================== 20:41:36 (1788828096) [ 6714.029774] Lustre: DEBUG MARKER: == sanityn test 46c: pdirops: link vs link ======================================================================== 20:41:47 (1788828107) [ 6725.030441] Lustre: DEBUG MARKER: == sanityn test 46d: pdirops: link vs unlink ======================================================================== 20:41:58 (1788828118) [ 6735.169771] Lustre: DEBUG MARKER: == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 20:42:09 (1788828129) [ 6745.443839] Lustre: DEBUG MARKER: == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 20:42:19 (1788828139) [ 6755.419054] Lustre: DEBUG MARKER: == sanityn test 46g: pdirops: link vs getattr ======================================================================== 20:42:29 (1788828149) [ 6766.558773] Lustre: DEBUG MARKER: == sanityn test 46h: pdirops: link vs readdir ======================================================================== 20:42:40 (1788828160) [ 6777.354666] Lustre: DEBUG MARKER: == sanityn test 46i: pdirops: link vs remote mkdir ======= 20:42:51 (1788828171) [ 6787.314644] Lustre: DEBUG MARKER: == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 20:43:01 (1788828181) [ 6798.217715] Lustre: DEBUG MARKER: == sanityn test 47b: pdirops: remote mkdir vs create ===== 20:43:11 (1788828191) [ 6809.591465] Lustre: DEBUG MARKER: == sanityn test 47c: pdirops: remote mkdir vs link ======= 20:43:23 (1788828203) [ 6820.672691] Lustre: DEBUG MARKER: == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 20:43:34 (1788828214) [ 6831.298928] Lustre: DEBUG MARKER: == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 20:43:45 (1788828225) [ 6841.815509] Lustre: DEBUG MARKER: == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 20:43:55 (1788828235) [ 6852.173867] Lustre: DEBUG MARKER: == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 20:44:06 (1788828246) [ 6865.835614] Lustre: DEBUG MARKER: == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 20:44:19 (1788828259) [ 6866.194800] LustreError: 6161:0:(ldlm_lockd.c:2079:ldlm_handle_cp_callback()) cfs_fail_timeout id 410 sleeping for 2000ms [ 6868.287116] LustreError: 6161:0:(ldlm_lockd.c:2079:ldlm_handle_cp_callback()) cfs_fail_timeout id 410 awake [ 6876.306624] Lustre: DEBUG MARKER: == sanityn test 51a: layout lock: refresh layout should work ========================================================== 20:44:30 (1788828270) [ 6883.755625] Lustre: DEBUG MARKER: == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 20:44:37 (1788828277) [ 6884.182698] LustreError: 240969:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 sleeping for 4000ms [ 6888.247149] LustreError: 240969:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 awake [ 6888.279436] LustreError: 240969:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 sleeping for 4000ms [ 6892.351121] LustreError: 240969:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 awake [ 6892.412881] LustreError: 240976:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 sleeping for 4000ms [ 6896.487146] LustreError: 240976:0:(glimpse.c:206:__cl_glimpse_size()) cfs_fail_timeout id 1404 awake [ 6901.967319] Lustre: DEBUG MARKER: == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 20:44:55 (1788828295) [ 6912.624644] Lustre: DEBUG MARKER: == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 20:45:06 (1788828306) [ 6919.136660] Lustre: DEBUG MARKER: == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 20:45:12 (1788828312) [ 6924.768670] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 23s idle [ 6924.774562] Lustre: Skipped 8 previous similar messages [ 6926.486088] Lustre: DEBUG MARKER: == sanityn test 54: rename locking ======================= 20:45:20 (1788828320) [ 6957.083232] Lustre: DEBUG MARKER: == sanityn test 55a: rename vs unlink target dir ========= 20:45:50 (1788828350) [ 6968.324101] Lustre: DEBUG MARKER: == sanityn test 55b: rename vs unlink source dir ========= 20:46:02 (1788828362) [ 6979.263696] Lustre: DEBUG MARKER: == sanityn test 55c: rename vs unlink orphan target dir == 20:46:13 (1788828373) [ 6995.871273] Lustre: DEBUG MARKER: == sanityn test 55d: rename file vs link ================= 20:46:29 (1788828389) [ 7009.093518] Lustre: DEBUG MARKER: == sanityn test 55e: rename race AB/BA under the same parent dir ========================================================== 20:46:42 (1788828402) [ 7026.649174] Lustre: DEBUG MARKER: == sanityn test 55f: rename: (P1/A -> P2/B) race with (P2/B -> P1/A) ========================================================== 20:47:00 (1788828420) [ 7043.033596] Lustre: DEBUG MARKER: == sanityn test 55g: rename: race with trylock =========== 20:47:16 (1788828436) [ 7061.749039] Lustre: DEBUG MARKER: == sanityn test 56a: test llverdev with single large stripe ========================================================== 20:47:35 (1788828455) [ 7077.762325] Lustre: DEBUG MARKER: == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 20:47:51 (1788828471) [ 7144.536210] Lustre: DEBUG MARKER: == sanityn test 60: Verify data_version behaviour ======== 20:48:58 (1788828538) [ 7150.719308] Lustre: DEBUG MARKER: == sanityn test 70a: cd directory [ 7155.603255] Lustre: DEBUG MARKER: == sanityn test 70b: remove files after calling rm_entry ========================================================== 20:49:09 (1788828549) [ 7160.572759] Lustre: DEBUG MARKER: == sanityn test 71a: correct file map just after write operation is finished ========================================================== 20:49:14 (1788828554) [ 7165.417097] Lustre: DEBUG MARKER: == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 20:49:19 (1788828559) [ 7169.849248] Lustre: DEBUG MARKER: == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 20:49:23 (1788828563) [ 7203.501775] Lustre: DEBUG MARKER: == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 20:49:57 (1788828597) [ 7244.935565] Lustre: DEBUG MARKER: == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 20:50:38 (1788828638) [ 7250.280325] Lustre: DEBUG MARKER: == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 20:50:44 (1788828644) [ 7255.345961] Lustre: DEBUG MARKER: == sanityn test 74: flock deadlock: different mounts ======================================================================== 20:50:49 (1788828649) [ 7258.599331] LustreError: lustre-MDT0000-mdc-ffffa0bb44d21800: operation ldlm_enqueue to node 192.168.204.116@tcp failed: rc = -35 [ 7264.280455] Lustre: DEBUG MARKER: == sanityn test 75: osc: upcall after unuse lock============================================================================= 20:50:58 (1788828658) [ 7264.771675] LustreError: 2402:0:(osc_request.c:3139:osc_enqueue_interpret()) cfs_fail_timeout id 31d sleeping for 2000ms [ 7266.855195] LustreError: 2402:0:(osc_request.c:3139:osc_enqueue_interpret()) cfs_fail_timeout id 31d awake [ 7274.181400] Lustre: DEBUG MARKER: == sanityn test 76: Verify MDT open_files listing ======== 20:51:08 (1788828668) [ 7384.501265] Lustre: DEBUG MARKER: == sanityn test 77a: check FIFO NRS policy =============== 20:52:58 (1788828778) [ 7389.522199] Lustre: DEBUG MARKER: == sanityn test 77b: check CRR-N NRS policy ============== 20:53:03 (1788828783) [ 7396.370741] Lustre: DEBUG MARKER: == sanityn test 77c: check ORR NRS policy ================ 20:53:10 (1788828790) [ 7404.816486] Lustre: DEBUG MARKER: == sanityn test 77d: check TRR nrs policy ================ 20:53:19 (1788828799) [ 7413.434362] Lustre: DEBUG MARKER: == sanityn test 77e: check TBF NID nrs policy ============ 20:53:27 (1788828807) [ 7428.278595] Lustre: DEBUG MARKER: == sanityn test 77f: check TBF JobID nrs policy ========== 20:53:42 (1788828822) [ 7443.454553] Lustre: DEBUG MARKER: == sanityn test 77g: Change TBF type directly ============ 20:53:57 (1788828837) [ 7450.123685] Lustre: DEBUG MARKER: == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 20:54:04 (1788828844) [ 7457.863761] Lustre: DEBUG MARKER: == sanityn test 77i: Change rank of TBF rule ============= 20:54:11 (1788828851) [ 7472.915968] Lustre: DEBUG MARKER: == sanityn test 77j: check TBF-OPCode NRS policy ========= 20:54:26 (1788828866) [ 7522.582789] Lustre: DEBUG MARKER: == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 20:55:16 (1788828916) [ 7544.289957] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 20s idle [ 7544.299864] Lustre: Skipped 8 previous similar messages [ 7651.339651] Lustre: DEBUG MARKER: == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 20:57:24 (1788829044) [ 7778.189309] Lustre: DEBUG MARKER: == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 20:59:32 (1788829172) [ 8091.529414] Lustre: DEBUG MARKER: == sanityn test 77kb: Check different granular TBF type combination: jobid+opcode ========================================================== 21:04:45 (1788829485) [ 8126.263887] Lustre: DEBUG MARKER: == sanityn test 77kc: Check different granular TBF type combination: nid+opcode ========================================================== 21:05:20 (1788829520) [ 8148.447635] Lustre: lustre-OST0001-osc-ffffa0bb455ee000: disconnect after 21s idle [ 8148.455407] Lustre: Skipped 12 previous similar messages [ 8161.944306] Lustre: DEBUG MARKER: == sanityn test 77kd: Check different granular TBF type combination: nid+jobid ========================================================== 21:05:56 (1788829556) [ 8192.493728] Lustre: DEBUG MARKER: == sanityn test 77ke: Check different granular TBF type combination: jobid+opcode ========================================================== 21:06:26 (1788829586) [ 8259.039268] Lustre: DEBUG MARKER: == sanityn test 77kf: Check different granular TBF type combination: uid+gid ========================================================== 21:07:33 (1788829653) [ 8319.949843] Lustre: DEBUG MARKER: == sanityn test 77kg: check different granular TBF type combination: uid+opcode ========================================================== 21:08:34 (1788829714) [ 8422.540487] Lustre: DEBUG MARKER: == sanityn test 77kh: Verify that Project ID support for NRS TBF rule ========================================================== 21:10:16 (1788829816) [ 8424.106452] Lustre: Unmounted lustre-client [ 8425.236167] Lustre: Unmounted lustre-client [ 8497.144904] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 8498.855746] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 8500.187660] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 8561.014947] Lustre: DEBUG MARKER: == sanityn test 77ki: Add rule with unsupported TBF type should fail for generic TBF ========================================================== 21:12:35 (1788829955) [ 8570.742199] Lustre: DEBUG MARKER: == sanityn test 77kj: Verify nodemap support for NRS TBF rule ========================================================== 21:12:45 (1788829965) [ 8713.509109] Lustre: DEBUG MARKER: == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 21:15:07 (1788830107) [ 8718.173194] Lustre: DEBUG MARKER: == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 21:15:12 (1788830112) [ 8770.173449] Lustre: DEBUG MARKER: == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 21:16:04 (1788830164) [ 8821.728157] Lustre: lustre-OST0001-osc-ffffa0bb7e709000: disconnect after 21s idle [ 8821.733776] Lustre: Skipped 15 previous similar messages [ 8825.955386] Lustre: DEBUG MARKER: == sanityn test 77o: Changing rank should not panic ====== 21:17:00 (1788830220) [ 8831.735678] Lustre: DEBUG MARKER: == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 21:17:05 (1788830225) [ 8935.215603] Lustre: DEBUG MARKER: == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 21:18:48 (1788830328) [ 8961.976634] Lustre: DEBUG MARKER: == sanityn test 77r: Change type of tbf policy at run time ========================================================== 21:19:15 (1788830355) [ 9008.158962] Lustre: DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 21:20:02 (1788830402) [ 9054.087729] Lustre: DEBUG MARKER: == sanityn test 77ta: Testing for dynamic|static classify parameter setting for TBF ========================================================== 21:20:47 (1788830447) [ 9085.045417] Lustre: DEBUG MARKER: == sanityn test 77tB: Request falling to default rule should not panic for dynamic TBF ========================================================== 21:21:19 (1788830479) [ 9207.608186] Lustre: DEBUG MARKER: == sanityn test 77th: TBF: a mixed classify head pair keeps each head type ========================================================== 21:23:21 (1788830601) [ 9218.058485] Lustre: DEBUG MARKER: == sanityn test 77tb: Testing for dynamic classify TBF Scheduler ========================================================== 21:23:31 (1788830611) [ 9278.074989] Lustre: DEBUG MARKER: == sanityn test 77tc: Testing for the setting of allowed TBF classification type ========================================================== 21:24:32 (1788830672) [ 9302.248372] Lustre: DEBUG MARKER: == sanityn test 77td: Testing Number of allowed rules larger or smaller than threshold ========================================================== 21:24:55 (1788830695) [ 9305.640376] Lustre: Unmounted lustre-client [ 9307.083742] Lustre: Unmounted lustre-client [ 9398.661569] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 9400.873654] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [ 9403.250955] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 9436.642048] Lustre: lustre-OST0001-osc-ffffa0bb46c33000: disconnect after 22s idle [ 9436.671390] Lustre: Skipped 10 previous similar messages [ 9677.636701] Lustre: DEBUG MARKER: == sanityn test 77tf: TBF: rule churn under load on a dynamic classify policy ========================================================== 21:31:11 (1788831071) [ 9734.411436] Lustre: DEBUG MARKER: == sanityn test 77te: Dynamic type lookup should obey the rule order ========================================================== 21:32:07 (1788831127) [ 9847.859987] Lustre: DEBUG MARKER: == sanityn test 77tg: TBF: the default rule holds its rate with many rules ========================================================== 21:34:01 (1788831241) [ 9905.277368] Lustre: DEBUG MARKER: == sanityn test 77ua: Setting TBF rate performance mode: BPS and IOPS ========================================================== 21:34:58 (1788831298) [ 9935.889312] Lustre: DEBUG MARKER: == sanityn test 77ub: Testing for TBF rate control in BPS performance mode ========================================================== 21:35:29 (1788831329) [10909.151193] Lustre: lustre-OST0000-osc-ffffa0bb46c33000: disconnect after 21s idle [10909.157900] Lustre: Skipped 17 previous similar messages [10917.494425] Lustre: DEBUG MARKER: == sanityn test 77uc: TBF: the realtime key does not work with a byte rate ========================================================== 21:51:50 (1788832310) [10937.180583] Lustre: DEBUG MARKER: == sanityn test 77ud: TBF: a rate change on a BPS rule leaves an IOPS rate ========================================================== 21:52:10 (1788832330) [10990.998485] Lustre: DEBUG MARKER: == sanityn test 77va: Reserved rate mClock: check OPCode NRS policy ========================================================== 21:53:04 (1788832384) [11016.680466] Lustre: lustre-OST0001-osc-ffffa0bb46c33000: disconnect after 22s idle [11016.687240] Lustre: Skipped 1 previous similar message [11048.346636] Lustre: DEBUG MARKER: == sanityn test 77vb: Reserved rate mClock: check UID/GID/JobID/OPCode expression ========================================================== 21:54:01 (1788832441) [11175.392913] Lustre: lustre-OST0001-osc-ffffa0bb46c33000: disconnect after 21s idle [11175.410507] Lustre: Skipped 4 previous similar messages [11403.360526] Lustre: DEBUG MARKER: == sanityn test 77vc: Reserved rate mClock: type granular combination: nid+opcode ========================================================== 21:59:56 (1788832796) [11448.821430] Lustre: DEBUG MARKER: == sanityn test 77vd: Reserved rate mClock: rate control in BPS performance mode ========================================================== 22:00:42 (1788832842) [11477.471231] Lustre: lustre-OST0001-osc-ffffa0bb46c33000: disconnect after 23s idle [11477.482501] Lustre: Skipped 6 previous similar messages [12388.836582] Lustre: lustre-OST0000-osc-ffffa0bb46c33000: disconnect after 24s idle [12390.075238] Lustre: DEBUG MARKER: == sanityn test 77ve: mClock: rule Reserved and Limit rate setting ========================================================== 22:16:23 (1788833783) [12431.457377] Lustre: DEBUG MARKER: == sanityn test 77vf: mClock: I/O testing with both Reserved and Limit rate control ========================================================== 22:17:04 (1788833824) [12469.463636] Lustre: DEBUG MARKER: == sanityn test 77vg: mClock: multiple flows with different reserved and limit rates ========================================================== 22:17:43 (1788833863) [12519.956158] Lustre: DEBUG MARKER: == sanityn test 77vm: mClock: reserve=0 turns the reserve dimension off ========================================================== 22:18:33 (1788833913) [12542.558602] Lustre: DEBUG MARKER: == sanityn test 77vr: mClock: a reserve only policy schedules the default class ========================================================== 22:18:55 (1788833935) [12564.333018] Lustre: DEBUG MARKER: == sanityn test 78: Enable policy and specify tunings right away ========================================================== 22:19:17 (1788833957) [12574.580300] Lustre: DEBUG MARKER: == sanityn test 79: xattr: intent error ================== 22:19:28 (1788833968) [12593.299243] Lustre: DEBUG MARKER: == sanityn test 80a: migrate directory when some children is being opened ========================================================== 22:19:46 (1788833986) [12603.912837] Lustre: DEBUG MARKER: == sanityn test 80b: Accessing directory during migration ========================================================== 22:19:57 (1788833997) [12606.151474] LustreError: 351221:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x200001b71:0xe2:0x0]: rc = -5 [12606.159306] LustreError: 351221:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12606.926383] LustreError: 351221:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x2400013a0:0x55:0x0]: rc = -5 [12606.934567] LustreError: 351221:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12608.252995] LustreError: 351221:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x200001b71:0xee:0x0]: rc = -5 [12608.265308] LustreError: 351221:0:(lcommon_cl.c:187:cl_file_inode_init()) Skipped 1 previous similar message [12608.277501] LustreError: 351221:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12608.283934] LustreError: 351221:0:(llite_lib.c:3893:ll_prep_inode()) Skipped 1 previous similar message [12610.390618] LustreError: 351473:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x2400013a0:0x61:0x0]: rc = -5 [12610.406143] LustreError: 351473:0:(lcommon_cl.c:187:cl_file_inode_init()) Skipped 5 previous similar messages [12610.418132] LustreError: 351473:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12610.425642] LustreError: 351473:0:(llite_lib.c:3893:ll_prep_inode()) Skipped 5 previous similar messages [12614.758189] LustreError: 351546:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x200001b71:0x10d:0x0]: rc = -5 [12614.768198] LustreError: 351546:0:(lcommon_cl.c:187:cl_file_inode_init()) Skipped 13 previous similar messages [12614.774600] LustreError: 351546:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12614.783513] LustreError: 351546:0:(llite_lib.c:3893:ll_prep_inode()) Skipped 13 previous similar messages [12621.220447] LustreError: 351657:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffffa0bb454c7000: inode [0x2400013a0:0xad:0x0] mdc close failed: rc = -2 [12623.024931] LustreError: 351689:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x2400013a0:0xb6:0x0]: rc = -5 [12623.036717] LustreError: 351689:0:(lcommon_cl.c:187:cl_file_inode_init()) Skipped 27 previous similar messages [12623.045595] LustreError: 351689:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12623.052581] LustreError: 351689:0:(llite_lib.c:3893:ll_prep_inode()) Skipped 27 previous similar messages [12639.397500] LustreError: 351980:0:(lcommon_cl.c:187:cl_file_inode_init()) lustre: failed to initialize cl_object [0x2400013a0:0x102:0x0]: rc = -5 [12639.403070] LustreError: 351980:0:(lcommon_cl.c:187:cl_file_inode_init()) Skipped 73 previous similar messages [12639.410161] LustreError: 351980:0:(llite_lib.c:3893:ll_prep_inode()) lustre: new_inode - fatal error: rc = -5 [12639.415709] LustreError: 351980:0:(llite_lib.c:3893:ll_prep_inode()) Skipped 73 previous similar messages [12680.292436] Lustre: DEBUG MARKER: == sanityn test 81a: rename and stat under striped directory ========================================================== 22:21:13 (1788834073) [12687.906402] Lustre: DEBUG MARKER: == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 22:21:21 (1788834081) [12906.921311] Lustre: DEBUG MARKER: == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 22:25:00 (1788834300) [12908.384390] Lustre: DEBUG MARKER: SKIP: sanityn test_81c needs >= 4 MDTs [12910.123643] Lustre: DEBUG MARKER: == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 22:25:03 (1788834303) [13128.811479] Lustre: DEBUG MARKER: == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 22:28:42 (1788834522) [13135.022227] Lustre: DEBUG MARKER: == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 22:28:48 (1788834528) [13141.480932] Lustre: lustre-OST0001-osc-ffffa0bb454c7000: disconnect after 20s idle [13141.485275] Lustre: Skipped 5 previous similar messages [13263.720444] Lustre: DEBUG MARKER: == sanityn test 84: 0-nlink race in lu_object_find() ===== 22:30:56 (1788834656) [13278.935737] Lustre: DEBUG MARKER: == sanityn test 85: Lustre API root cache race =========== 22:31:11 (1788834671) [13290.881750] Lustre: DEBUG MARKER: == sanityn test 90: open/create and unlink striped directory ========================================================== 22:31:24 (1788834684) [13478.825595] Lustre: DEBUG MARKER: == sanityn test 91: chmod and unlink striped directory === 22:34:31 (1788834871) [13664.419047] Lustre: DEBUG MARKER: == sanityn test 92: create remote directory under orphan directory ========================================================== 22:37:38 (1788835058) [13669.828385] Lustre: DEBUG MARKER: == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 22:37:43 (1788835063) [13686.186439] Lustre: DEBUG MARKER: == sanityn test 94: signal vs CP callback race =========== 22:37:59 (1788835079) [13686.455332] Lustre: DEBUG MARKER: write [13686.514962] LustreError: 321235:0:(ldlm_request.c:1533:ldlm_cli_cancel_req()) cfs_fail_timeout id 312 sleeping for 5000ms [13688.554430] Lustre: DEBUG MARKER: kill 382916 [13688.568060] LustreError: 382916:0:(ldlm_request.c:1393:ldlm_cli_cancel_local()) cfs_fail_timeout id 329 sleeping for 6000ms [13691.535119] LustreError: 321235:0:(ldlm_request.c:1533:ldlm_cli_cancel_req()) cfs_fail_timeout id 312 awake [13694.631398] LustreError: 382916:0:(ldlm_request.c:1393:ldlm_cli_cancel_local()) cfs_fail_timeout id 329 awake [13700.705531] Lustre: DEBUG MARKER: == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 22:38:14 (1788835094) [13703.446303] LustreError: 383529:0:(rw.c:1865:ll_readpage()) cfs_fail_timeout id 1422 sleeping for 10000ms [13713.449307] LustreError: 383529:0:(rw.c:1865:ll_readpage()) cfs_fail_timeout id 1422 awake [13720.451047] Lustre: DEBUG MARKER: == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 22:38:33 (1788835113) [13720.923469] LustreError: 384118:0:(rw.c:2112:ll_readpage()) cfs_fail_timeout id 1424 sleeping for 5000ms [13723.007370] LustreError: 384118:0:(rw.c:2112:ll_readpage()) cfs_fail_timeout interrupted [13733.077944] Lustre: DEBUG MARKER: == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 22:38:46 (1788835126) [13734.398796] Lustre: DEBUG MARKER: SKIP: sanityn test_100a Reserved for glimpse-ahead [13736.035298] Lustre: DEBUG MARKER: == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 22:38:49 (1788835129) [13742.196543] Lustre: DEBUG MARKER: == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 22:38:55 (1788835135) [13748.562797] Lustre: DEBUG MARKER: == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 22:39:02 (1788835142) [13755.689639] Lustre: DEBUG MARKER: == sanityn test 100e: DoM: read on open and file size ==== 22:39:09 (1788835149) [13762.973334] Lustre: DEBUG MARKER: == sanityn test 101a: Discard DoM data on unlink ========= 22:39:16 (1788835156) [13770.455401] Lustre: DEBUG MARKER: == sanityn test 101b: Discard DoM data on rename ========= 22:39:23 (1788835163) [13777.562781] Lustre: DEBUG MARKER: == sanityn test 101c: Discard DoM data on close-unlink === 22:39:31 (1788835171) [13785.155548] Lustre: DEBUG MARKER: == sanityn test 102: Test open by handle of unlinked file ========================================================== 22:39:38 (1788835178) [13793.557559] Lustre: DEBUG MARKER: == sanityn test 103: Test size correctness with lockahead ========================================================== 22:39:47 (1788835187) [13795.261482] Lustre: *** cfs_fail_loc=415, val=0*** [13806.637838] Lustre: DEBUG MARKER: == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 22:40:00 (1788835200) [13836.319742] Lustre: DEBUG MARKER: == sanityn test 105: Glimpse and lock cancel race ======== 22:40:29 (1788835229) [13836.868727] LustreError: 318532:0:(osc_lock.c:435:__osc_dlm_blocking_ast()) cfs_fail_timeout id 416 sleeping for 5000ms [13836.876190] LustreError: 318532:0:(osc_lock.c:435:__osc_dlm_blocking_ast()) Skipped 2 previous similar messages [13841.879130] LustreError: 318532:0:(osc_lock.c:435:__osc_dlm_blocking_ast()) cfs_fail_timeout id 416 awake [13851.991146] LustreError: 318532:0:(osc_lock.c:435:__osc_dlm_blocking_ast()) cfs_fail_timeout id 416 awake [13852.000327] LustreError: 318532:0:(osc_lock.c:435:__osc_dlm_blocking_ast()) Skipped 5 previous similar messages [13863.914751] Lustre: DEBUG MARKER: == sanityn test 106a: Verify the btime via statx() ======= 22:40:57 (1788835257) [13871.600588] Lustre: DEBUG MARKER: == sanityn test 106b: Glimpse RPCs test for statx ======== 22:41:05 (1788835265) [13879.329251] Lustre: DEBUG MARKER: == sanityn test 106c: Verify statx attributes mask ======= 22:41:12 (1788835272) [13886.014375] Lustre: DEBUG MARKER: == sanityn test 107a: Basic grouplock conflict =========== 22:41:19 (1788835279) [13898.545199] Lustre: DEBUG MARKER: == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 22:41:31 (1788835291) [13912.979774] Lustre: DEBUG MARKER: == sanityn test 108a: lseek: parallel updates ============ 22:41:46 (1788835306) [13913.954687] LustreError: 394861:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout id 414 sleeping for 4000ms [13913.975984] LustreError: 394861:0:(osc_request.c:2990:osc_build_rpc()) Skipped 6 previous similar messages [13917.975283] LustreError: 394861:0:(osc_request.c:2990:osc_build_rpc()) cfs_fail_timeout id 414 awake [13917.983611] LustreError: 394861:0:(osc_request.c:2990:osc_build_rpc()) Skipped 3 previous similar messages [13924.305165] Lustre: DEBUG MARKER: == sanityn test 109: Race with several mount instances on 1 node ========================================================== 22:41:57 (1788835317) [13927.647867] Lustre: Unmounted lustre-client [13929.939899] Lustre: Unmounted lustre-client [13931.225467] Lustre: DEBUG MARKER: Iteration 0 [13931.645071] LustreError: 395755:0:(llite_lib.c:1508:ll_fill_super()) cfs_race id 1417 sleeping [13931.653410] LustreError: 395757:0:(llite_lib.c:1508:ll_fill_super()) cfs_fail_race id 1417 waking [13931.669861] LustreError: 395755:0:(llite_lib.c:1508:ll_fill_super()) cfs_fail_race id 1417 awake: rc=4988 [13931.867664] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [13933.335706] Lustre: Unmounted lustre-client [13936.045222] Key type lgssc unregistered [13936.352759] LNet: 396102:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13936.365596] LNetError: 396102:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [13936.392990] LNet: Removed LNI 192.168.204.16@tcp [13937.297195] Key type .llcrypt unregistered [13937.300250] Key type ._llcrypt unregistered [13937.977667] Key type ._llcrypt registered [13937.982623] Key type .llcrypt registered [13938.587677] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [13938.609734] alg: No test for adler32 (adler32-zlib) [13939.898189] Lustre: Lustre: Build Version: 2.17.57_113_gf5ca795 [13940.630261] LNet: Added LNI 192.168.204.16@tcp [8/256/0/180] [13942.367393] Key type lgssc registered [13943.908243] Lustre: Echo OBD driver; http://www.lustre.org/ [13957.173494] Lustre: DEBUG MARKER: Iteration 1 [13957.655508] LustreError: 396930:0:(llite_lib.c:1508:ll_fill_super()) cfs_race id 1417 sleeping [13957.656684] LustreError: 396931:0:(llite_lib.c:1508:ll_fill_super()) cfs_fail_race id 1417 waking [13957.670090] LustreError: 396930:0:(llite_lib.c:1508:ll_fill_super()) cfs_fail_race id 1417 awake: rc=4993 [13958.960286] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [13960.813822] Lustre: Unmounted lustre-client [13964.172821] Key type lgssc unregistered [13964.475850] LNet: 397276:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [13964.488596] LNetError: 397276:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [13964.510575] LNet: Removed LNI 192.168.204.16@tcp [13965.291729] Key type .llcrypt unregistered [13965.300715] Key type ._llcrypt unregistered [13966.180112] Key type ._llcrypt registered [13966.187070] Key type .llcrypt registered [13966.940379] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [13966.962821] alg: No test for adler32 (adler32-zlib) [13968.160752] Lustre: Lustre: Build Version: 2.17.57_113_gf5ca795 [13968.539109] LNet: Added LNI 192.168.204.16@tcp [8/256/0/180] [13970.343171] Key type lgssc registered [13971.716835] Lustre: Echo OBD driver; http://www.lustre.org/ [13984.759742] Lustre: Mounted lustre-client - version 2.17.57_113_gf5ca795 [13992.491963] Lustre: DEBUG MARKER: == sanityn test 110: do not grant another lock on resend ========================================================== 22:43:06 (1788835386) [14009.823192] Lustre: 398618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835388/real 1788835388] req@ffffa0bb44aeaa00 x1875729829604864/t0(0) o36->lustre-MDT0000-mdc-ffffa0bb7e739000@192.168.204.116@tcp:12/10 lens 496/440 e 0 to 1 dl 1788835404 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'ln.0' uid:0 gid:0 projid:4294967295 [14009.862650] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection to lustre-MDT0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14009.921827] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14025.183314] Lustre: 398618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835404/real 1788835404] req@ffffa0bb44aeaa00 x1875729829604864/t0(0) o36->lustre-MDT0000-mdc-ffffa0bb7e739000@192.168.204.116@tcp:12/10 lens 496/440 e 0 to 1 dl 1788835420 ref 2 fl Rpc:XQr/202/ffffffff rc 0/-1 job:'ln.0' uid:0 gid:0 projid:4294967295 [14025.225555] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection to lustre-MDT0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14025.279758] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14041.567232] Lustre: 398618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835420/real 1788835420] req@ffffa0bb44aeaa00 x1875729829604864/t0(0) o36->lustre-MDT0000-mdc-ffffa0bb7e739000@192.168.204.116@tcp:12/10 lens 496/440 e 0 to 1 dl 1788835436 ref 2 fl Rpc:XQr/202/ffffffff rc 0/-1 job:'ln.0' uid:0 gid:0 projid:4294967295 [14041.609480] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection to lustre-MDT0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14041.648140] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14057.969495] Lustre: 398618:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835436/real 1788835436] req@ffffa0bb44aeaa00 x1875729829604864/t0(0) o36->lustre-MDT0000-mdc-ffffa0bb7e739000@192.168.204.116@tcp:12/10 lens 496/440 e 0 to 1 dl 1788835452 ref 2 fl Rpc:XQr/202/ffffffff rc 0/-1 job:'ln.0' uid:0 gid:0 projid:4294967295 [14058.028034] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection to lustre-MDT0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14058.077553] Lustre: lustre-MDT0000-mdc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14063.104990] Lustre: DEBUG MARKER: == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 22:44:16 (1788835456) [14074.971500] Lustre: DEBUG MARKER: == sanityn test 112: update max-inherit in default LMV === 22:44:28 (1788835468) [14086.307499] Lustre: DEBUG MARKER: == sanityn test 113: check servers of specified fs ======= 22:44:39 (1788835479) [14092.611519] Lustre: DEBUG MARKER: == sanityn test 114: implicit default LMV inherit ======== 22:44:46 (1788835486) [14114.474295] Lustre: DEBUG MARKER: == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 22:45:08 (1788835508) [14151.784397] Lustre: DEBUG MARKER: == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 22:45:44 (1788835544) [14159.313867] Lustre: DEBUG MARKER: == sanityn test 121: trunc append race =================== 22:45:52 (1788835552) [14159.651191] LustreError: 403399:0:(lcommon_cl.c:99:cl_setattr_ost()) cfs_fail_timeout id 1436 sleeping for 2000ms [14161.736630] LustreError: 403399:0:(lcommon_cl.c:99:cl_setattr_ost()) cfs_fail_timeout id 1436 awake [14168.646058] Lustre: DEBUG MARKER: == sanityn test 122: directory size is consistent across mounts ========================================================== 22:46:02 (1788835562) [14183.508375] Lustre: DEBUG MARKER: == sanityn test 200: service remains healthy while able to process request ========================================================== 22:46:17 (1788835577) [14205.407320] Lustre: 397464:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835584/real 1788835584] req@ffffa0bb6d1cf800 x1875729830667392/t0(0) o4->lustre-OST0000-osc-ffffa0bb7e739000@192.168.204.116@tcp:6/4 lens 4584/448 e 0 to 1 dl 1788835600 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 [14205.407543] Lustre: lustre-OST0000-osc-ffffa0bb7e739000: Connection to lustre-OST0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14205.430725] Lustre: 397464:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [14205.456855] Lustre: lustre-OST0000-osc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14221.791220] Lustre: 397467:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835600/real 1788835600] req@ffffa0bb6ca9d500 x1875729830669056/t0(0) o4->lustre-OST0000-osc-ffffa0bb7e739000@192.168.204.116@tcp:6/4 lens 4584/448 e 0 to 1 dl 1788835616 ref 2 fl Rpc:XQr/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 [14221.830305] Lustre: 397467:0:(client.c:2503:ptlrpc_expire_one_request()) Skipped 1 previous similar message [14221.844266] Lustre: lustre-OST0000-osc-ffffa0bb7e739000: Connection to lustre-OST0000 (at 192.168.204.116@tcp) was lost; in progress operations using this service will wait for recovery to complete [14221.887924] Lustre: lustre-OST0000-osc-ffffa0bb7e739000: Connection restored to 192.168.204.116@tcp (at 192.168.204.116@tcp) [14262.930764] Lustre: DEBUG MARKER: oleg416-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffffa0bb7e739000.ost_server_uuid 50 [14264.618646] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffffa0bb7e739000.ost_server_uuid in FULL state after 0 sec [14267.109618] Lustre: DEBUG MARKER: cleanup: ====================================================== [14268.823304] Lustre: DEBUG MARKER: == sanityn test complete, duration 13979 sec ============= 22:47:42 (1788835662) [14270.691413] Lustre: DEBUG MARKER: === sanityn: start cleanup 22:47:44 (1788835664) === [14571.354563] Lustre: Unmounted lustre-client [14574.572856] Lustre: DEBUG MARKER: === sanityn: finish cleanup 22:52:48 (1788835968) === [14576.205337] Lustre: Unmounted lustre-client [14638.229081] Key type lgssc unregistered [14638.446918] LNet: 407487:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [14638.455674] LNetError: 407487:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [14638.472236] LNet: Removed LNI 192.168.204.16@tcp [14639.041251] Key type .llcrypt unregistered [14639.043364] Key type ._llcrypt unregistered