[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2f2000-0xbffcffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 458939058 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffd9fff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043832 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782298 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffda000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027499 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820316k/5224448k available (8172k kernel code, 1049120k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.607361] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.610249] pid_max: default: 32768 minimum: 301 [ 0.611996] Security Framework initialized [ 0.613397] SELinux: Initializing. [ 0.614814] SELinux: Starting in permissive mode [ 0.616453] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.621063] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.624101] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.627526] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.630448] Initializing cgroup subsys memory [ 0.632357] Initializing cgroup subsys devices [ 0.634098] Initializing cgroup subsys freezer [ 0.636836] Initializing cgroup subsys net_cls [ 0.640232] Initializing cgroup subsys blkio [ 0.641732] Initializing cgroup subsys perf_event [ 0.643642] Initializing cgroup subsys hugetlb [ 0.645567] Initializing cgroup subsys pids [ 0.648182] Initializing cgroup subsys net_prio [ 0.650095] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.656324] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.658940] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.662328] tlb_flushall_shift: 6 [ 0.664106] FEATURE SPEC_CTRL Present [ 0.666046] FEATURE IBPB_SUPPORT Present [ 0.668110] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.671347] Spectre V2 : Vulnerable [ 0.673095] Speculative Store Bypass: Vulnerable [ 0.676206] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.686751] ACPI: Core revision 20130517 [ 0.690963] ACPI: All ACPI Tables successfully acquired [ 0.693896] ftrace: allocating 30294 entries in 119 pages [ 0.751495] Enabling x2apic [ 0.752387] Enabled x2apic [ 0.753707] Switched APIC routing to physical x2apic. [ 0.757265] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.759367] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.762666] TSC deadline timer enabled [ 0.762848] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.765229] ... version: 2 [ 0.766580] ... bit width: 48 [ 0.767930] ... generic registers: 4 [ 0.769255] ... value mask: 0000ffffffffffff [ 0.770901] ... max period: 00007fffffffffff [ 0.772239] ... fixed-purpose events: 3 [ 0.773450] ... event mask: 000000070000000f [ 0.774859] KVM setup paravirtual spinlock [ 0.779844] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.782582] KVM setup async PF for cpu 1 [ 0.783659] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.787685] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.777971] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.793931] KVM setup async PF for cpu 2 [ 0.793940] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.798495] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.802615] Brought up 4 CPUs [ 0.802642] KVM setup async PF for cpu 3 [ 0.802651] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.807108] smpboot: Max logical packages: 1 [ 0.808610] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.815016] devtmpfs: initialized [ 0.816904] x86/mm: Memory block size: 128MB [ 0.822600] EVM: security.selinux [ 0.824114] EVM: security.ima [ 0.825211] EVM: security.capability [ 0.828787] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.831675] NET: Registered protocol family 16 [ 0.833702] cpuidle: using governor haltpoll [ 0.835925] ACPI: bus type PCI registered [ 0.837400] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.839683] PCI: Using configuration type 1 for base access [ 0.841717] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.854152] ACPI: Added _OSI(Module Device) [ 0.855646] ACPI: Added _OSI(Processor Device) [ 0.857061] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.859300] ACPI: Added _OSI(Processor Aggregator Device) [ 0.862651] ACPI: Added _OSI(Linux-Dell-Video) [ 0.865888] ACPI: EC: Look up EC in DSDT [ 0.868575] ACPI: Interpreter enabled [ 0.869992] ACPI: (supports S0 S3 S4 S5) [ 0.871381] ACPI: Using IOAPIC for interrupt routing [ 0.873718] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.876401] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.882758] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.884592] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.887245] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.889987] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.896530] acpiphp: Slot [2] registered [ 0.898500] acpiphp: Slot [3] registered [ 0.900269] acpiphp: Slot [4] registered [ 0.902401] acpiphp: Slot [5] registered [ 0.904216] acpiphp: Slot [6] registered [ 0.905838] acpiphp: Slot [7] registered [ 0.907645] acpiphp: Slot [8] registered [ 0.913699] acpiphp: Slot [9] registered [ 0.915658] acpiphp: Slot [10] registered [ 0.917826] acpiphp: Slot [11] registered [ 0.919949] acpiphp: Slot [12] registered [ 0.924162] acpiphp: Slot [13] registered [ 0.926764] acpiphp: Slot [14] registered [ 0.930420] acpiphp: Slot [15] registered [ 0.933370] acpiphp: Slot [16] registered [ 0.935772] acpiphp: Slot [17] registered [ 0.937798] acpiphp: Slot [18] registered [ 0.939915] acpiphp: Slot [19] registered [ 0.943476] acpiphp: Slot [20] registered [ 0.945268] acpiphp: Slot [21] registered [ 0.961736] acpiphp: Slot [22] registered [ 0.963809] acpiphp: Slot [23] registered [ 0.965793] acpiphp: Slot [24] registered [ 0.967652] acpiphp: Slot [25] registered [ 0.969409] acpiphp: Slot [26] registered [ 0.972461] acpiphp: Slot [27] registered [ 0.974962] acpiphp: Slot [28] registered [ 0.977139] acpiphp: Slot [29] registered [ 0.978894] acpiphp: Slot [30] registered [ 0.980350] acpiphp: Slot [31] registered [ 0.982135] PCI host bridge to bus 0000:00 [ 0.983862] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.987119] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.990096] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.992999] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.996299] pci_bus 0000:00: root bus resource [mem 0x140000000-0x1bfffffff window] [ 1.000112] pci_bus 0000:00: root bus resource [bus 00-ff] [ 1.003182] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 1.004016] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 1.004943] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 1.012906] pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] [ 1.018622] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 1.024840] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 1.027676] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 1.031327] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 1.034590] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 1.035216] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 1.038858] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 1.042851] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 1.044276] pci 0000:00:02.0: reg 0x10: [io 0xc100-0xc11f] [ 1.061810] pci 0000:00:02.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] [ 1.062885] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 1.068918] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 1.077453] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 1.085883] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 1.105631] pci 0000:00:05.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] [ 1.114148] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 1.122670] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 1.126628] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 1.146844] pci 0000:00:06.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] [ 1.161527] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 1.164167] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 1.171405] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 1.181715] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 1.192362] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 1.200157] vgaarb: loaded [ 1.201609] SCSI subsystem initialized [ 1.202989] ACPI: bus type USB registered [ 1.204561] usbcore: registered new interface driver usbfs [ 1.206529] usbcore: registered new interface driver hub [ 1.208435] usbcore: registered new device driver usb [ 1.210734] PCI: Using ACPI for IRQ routing [ 1.212210] PCI: pci_cache_line_size set to 64 bytes [ 1.212418] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 1.212425] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff] [ 1.212427] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 1.213313] NetLabel: Initializing [ 1.214805] NetLabel: domain hash size = 128 [ 1.216970] NetLabel: protocols = UNLABELED CIPSOv4 [ 1.221542] NetLabel: unlabeled traffic allowed by default [ 1.231300] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.237027] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.255374] amd_nb: Cannot enumerate AMD northbridges [ 1.269726] Switched to clocksource kvm-clock [ 1.300111] pnp: PnP ACPI init [ 1.301323] ACPI: bus type PNP registered [ 1.302635] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 1.302714] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 1.302755] pnp 00:02: [dma 2] [ 1.302785] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 1.302855] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.302925] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.303000] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 1.303355] pnp: PnP ACPI: found 6 devices [ 1.304684] ACPI: bus type PNP unregistered [ 1.319862] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.319869] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.319872] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.319874] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.319876] pci_bus 0000:00: resource 8 [mem 0x140000000-0x1bfffffff window] [ 1.319960] NET: Registered protocol family 2 [ 1.322051] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 1.331345] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 1.337203] TCP: Hash tables configured (established 32768 bind 32768) [ 1.351698] TCP: reno registered [ 1.355348] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 1.358748] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 1.363841] NET: Registered protocol family 1 [ 1.365997] RPC: Registered named UNIX socket transport module. [ 1.369072] RPC: Registered udp transport module. [ 1.370412] RPC: Registered tcp transport module. [ 1.371845] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.382697] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.387958] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.392824] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.394525] PCI: CLS 0 bytes, default 64 [ 1.401515] Unpacking initramfs... [ 4.885601] debug: unmapping init [mem 0xffff8800bc2f2000-0xffff8800bffcffff] [ 4.893550] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.896871] software IO TLB [mem 0xb82f2000-0xbc2f2000] (64MB) mapped at [ffff8800b82f2000-ffff8800bc2f1fff] [ 4.901849] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 4.904127] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 4.905919] RAPL PMU: hw unit of domain package 2^-0 Joules [ 4.907603] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 4.914338] cryptomgr_test (52) used greatest stack depth: 14480 bytes left [ 4.915967] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 4.916017] Initialise system trusted keyring [ 4.959980] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 4.961890] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 4.973383] zpool: loaded [ 4.974728] zbud: loaded [ 4.975925] VFS: Disk quotas dquot_6.6.0 [ 4.977324] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 4.982859] NFS: Registering the id_resolver key type [ 4.984600] Key type id_resolver registered [ 4.986005] Key type id_legacy registered [ 4.987364] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 4.991244] Key type big_key registered [ 4.992477] SELinux: Registering netfilter hooks [ 4.999406] cryptomgr_test (58) used greatest stack depth: 14048 bytes left [ 5.008890] cryptomgr_test (63) used greatest stack depth: 13984 bytes left [ 5.014817] NET: Registered protocol family 38 [ 5.016776] Key type asymmetric registered [ 5.018179] Asymmetric key parser 'x509' registered [ 5.021379] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 5.032155] io scheduler noop registered [ 5.033268] io scheduler deadline registered (default) [ 5.036188] io scheduler cfq registered [ 5.037426] io scheduler mq-deadline registered [ 5.038813] io scheduler kyber registered [ 5.043656] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 5.045477] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 5.048174] intel_idle: does not run on family 6 model 62 [ 5.048323] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 5.050594] ACPI: Power Button [PWRF] [ 5.053067] GHES: HEST is not enabled! [ 5.139485] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 5.233370] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 5.388588] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 5.426989] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 5.490948] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 5.506652] Non-volatile memory driver v1.3 [ 5.510478] Linux agpgart interface v0.103 [ 5.516394] crash memory driver: version 1.1 [ 5.518495] nbd: registered device at major 43 [ 5.537971] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 5.538013] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 5.538049] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 5.538090] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 5.538125] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 5.557756] virtio_blk virtio1: [vda] 67296 512-byte logical blocks (34.4 MB/32.8 MiB) [ 5.573159] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 5.573196] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 5.573233] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 5.574763] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 5.574809] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 5.590183] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 5.605463] rdac: device handler registered [ 5.607711] hp_sw: device handler registered [ 5.608957] emc: device handler registered [ 5.610296] libphy: Fixed MDIO Bus: probed [ 5.619919] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 5.629838] ehci-pci: EHCI PCI platform driver [ 5.631350] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 5.642036] ohci-pci: OHCI PCI platform driver [ 5.643974] uhci_hcd: USB Universal Host Controller Interface driver [ 5.647145] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 5.651844] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 5.654409] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 5.657231] mousedev: PS/2 mouse device common for all mice [ 5.664461] rtc_cmos 00:05: RTC can wake from S4 [ 5.667088] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 5.667734] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 5.679949] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 5.689471] hidraw: raw HID events driver (C) Jiri Kosina [ 5.692404] usbcore: registered new interface driver usbhid [ 5.700188] usbhid: USB HID core driver [ 5.703768] drop_monitor: Initializing network drop monitor service [ 5.705760] Netfilter messages via NETLINK v0.30. [ 5.707148] TCP: cubic registered [ 5.709913] Initializing XFRM netlink socket [ 5.714726] NET: Registered protocol family 10 [ 5.721194] NET: Registered protocol family 17 [ 5.722747] Key type dns_resolver registered [ 5.724903] mce: Using 10 MCE banks [ 5.726210] Loading compiled-in X.509 certificates [ 5.728461] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 5.731329] registered taskstats version 1 [ 5.743655] modprobe (72) used greatest stack depth: 13456 bytes left [ 5.759638] Key type trusted registered [ 5.775193] Key type encrypted registered [ 5.784414] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 5.787551] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 5.800219] rtc_cmos 00:05: setting system clock to 2024-04-10 14:56:36 UTC (1712760996) [ 5.812446] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 5.816938] Write protecting the kernel read-only data: 12288k [ 5.819902] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 5.824830] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 5.841923] random: systemd: uninitialized urandom read (16 bytes read) [ 5.849295] random: systemd: uninitialized urandom read (16 bytes read) [ 5.853226] random: systemd: uninitialized urandom read (16 bytes read) [ 5.860831] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 5.873338] systemd[1]: Detected virtualization kvm. [ 5.875557] systemd[1]: Detected architecture x86-64. [ 5.877470] systemd[1]: Running in initial RAM disk. [ 5.884857] systemd[1]: No hostname configured. [ 5.887386] systemd[1]: Set hostname to . [ 5.890410] random: systemd: uninitialized urandom read (16 bytes read) [ 5.892495] systemd[1]: Initializing machine ID from random generator. [ 5.911704] tsc: Refined TSC clocksource calibration: 2399.984 MHz [ 6.063941] dracut-rootfs-g (86) used greatest stack depth: 13264 bytes left [ 6.073345] random: systemd: uninitialized urandom read (16 bytes read) [ 6.080886] random: systemd: uninitialized urandom read (16 bytes read) [ 6.087268] random: systemd: uninitialized urandom read (16 bytes read) [ 6.094679] random: systemd: uninitialized urandom read (16 bytes read) [ 6.098464] random: systemd: uninitialized urandom read (16 bytes read) [ 6.101231] random: systemd: uninitialized urandom read (16 bytes read) [ 6.131635] systemd[1]: Reached target Local File Systems. [ 6.135485] systemd[1]: Reached target Swap. [ 6.143874] systemd[1]: Reached target Timers. [ 6.155317] systemd[1]: Created slice Root Slice. [ 6.162332] systemd[1]: Listening on udev Control Socket. [ 6.187283] systemd[1]: Created slice System Slice. [ 6.202725] systemd[1]: Listening on Journal Socket. [ 6.220405] systemd[1]: Starting dracut cmdline hook... [ 6.231274] systemd[1]: Starting Setup Virtual Console... [ 6.263996] systemd[1]: Starting Journal Service... [ 6.277749] systemd[1]: Listening on udev Kernel Socket. [ 6.316736] systemd[1]: Reached target Sockets. [ 6.331552] systemd[1]: Reached target Slices. [ 6.362755] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 6.415700] systemd[1]: Starting Load Kernel Modules... [ 6.472598] systemd[1]: Started Journal Service. [ 6.667424] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 8.117997] libata version 3.00 loaded. [ 8.125890] ata_piix 0000:00:01.1: version 2.13 [ 8.130858] scsi host0: ata_piix [ 8.137974] scsi host1: ata_piix [ 8.139638] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 [ 8.143444] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 [ 8.161681] systemd-cgroups (301) used greatest stack depth: 13168 bytes left [ 8.220722] random: fast init done [ 8.414457] ip (323) used greatest stack depth: 13080 bytes left [ 8.521461] ip (346) used greatest stack depth: 12280 bytes left [ 12.142345] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 12.775054] systemd-journald[104]: Received SIGTERM from PID 1 (systemd). [ 13.161406] SELinux: Disabled at runtime. [ 13.162833] SELinux: Unregistering netfilter hooks [ 13.276909] ip_tables: (C) 2000-2006 Netfilter Core Team [ 13.282439] systemd[1]: Inserted module 'ip_tables' [ 14.566800] hrtimer: interrupt took 5789789 ns [ 14.798480] systemd-journald[568]: Received request to flush runtime journal from PID 1 [ 15.571754] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 15.650554] cryptd: max_cpu_qlen set to 1000 [ 15.912974] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 15.965516] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 15.983844] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 16.252570] AVX version of gcm_enc/dec engaged. [ 16.254801] AES CTR mode by8 optimization enabled [ 16.312527] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 16.317863] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 16.898654] EDAC MC: Ver: 3.0.0 [ 16.941854] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 16.941864] EDAC sbridge: Ver: 1.1.2 [ 21.818320] mount.nfs (776) used greatest stack depth: 10704 bytes left [ 47.473188] libcfs: loading out-of-tree module taints kernel. [ 47.492915] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 47.691816] alg: No test for adler32 (adler32-zlib) [ 48.443772] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 48.650148] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 48.857254] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 48.859038] LNet: Accept secure, port 988 [ 50.415994] Key type lgssc registered [ 50.837632] Lustre: Echo OBD driver; http://www.lustre.org/ [ 118.496117] Lustre: Mounted lustre-client [ 121.028891] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 131.686812] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing check_logdir /tmp/testlogs/ [ 132.654262] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing yml_node [ 134.068470] Lustre: DEBUG MARKER: Client: 2.15.62.1 [ 134.842836] Lustre: DEBUG MARKER: MDS: 2.15.62.1 [ 135.706924] Lustre: DEBUG MARKER: OSS: 2.15.62.1 [ 136.244847] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Wed Apr 10 10:58:46 EDT 2024 [ 138.171162] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball 110 [ 138.648837] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 138.907798] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 148.943021] Lustre: Unmounted lustre-client [ 203.059570] random: crng init done [ 209.436812] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 210.477198] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 218.302781] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 240.039913] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 11:00:30 (1712761230) [ 250.150981] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 250.989584] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 256.916777] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 257.163328] Lustre: Mounted lustre-client [ 264.896321] Lustre: Unmounted lustre-client [ 306.107181] Lustre: Mounted lustre-client [ 308.342078] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 317.379906] Lustre: Unmounted lustre-client [ 370.841254] Lustre: Mounted lustre-client [ 376.532610] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 383.146670] Lustre: Unmounted lustre-client [ 416.950224] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 11:03:27 (1712761407) [ 438.640516] Lustre: Mounted lustre-client [ 444.322932] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 450.690716] Lustre: Unmounted lustre-client [ 485.391739] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 11:04:35 (1712761475) [ 503.415016] Lustre: Mounted lustre-client [ 509.155708] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 518.436259] Lustre: lustre-MDT0000-mdc-ffff8800a9d84800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 523.442324] Lustre: lustre-MDT0001-mdc-ffff8800a9d84800: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 528.448052] Lustre: lustre-OST0000-osc-ffff8800a9d84800: disconnect after 20s idle [ 533.457754] LustreError: 166-1: MGC192.168.202.133@tcp: Connection to MGS (at 192.168.202.133@tcp) was lost; in progress operations using this service will fail [ 533.463566] Lustre: Evicted from MGS (at 192.168.202.133@tcp) after server handle changed from 0x2ad3b89158138875 to 0x2ad3b8915813896a [ 533.467556] Lustre: MGC192.168.202.133@tcp: Connection restored to (at 192.168.202.133@tcp) [ 538.722053] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 558.469923] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800a9d84800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 558.478524] Lustre: lustre-MDT0000-mdc-ffff8800a9d84800: Connection restored to 192.168.202.133@tcp (at 192.168.202.133@tcp) [ 559.465665] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 20 sec [ 560.097149] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 560.514896] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 560.959681] Lustre: Unmounted lustre-client [ 594.686117] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 11:06:25 (1712761585) [ 613.248737] Lustre: Mounted lustre-client [ 618.986018] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 627.487084] Lustre: Unmounted lustre-client [ 661.413899] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 11:07:31 (1712761651) [ 662.014852] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 663.949214] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 11:07:34 (1712761654) [ 676.684547] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 682.248933] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 682.367943] Lustre: Mounted lustre-client [ 682.369291] Lustre: Skipped 2 previous similar messages [ 682.740381] Lustre: DEBUG MARKER: create test files [ 689.143818] Lustre: Unmounted lustre-client [ 689.144893] Lustre: Skipped 2 previous similar messages [ 697.767819] Key type lgssc unregistered [ 697.836006] LNet: 32461:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 698.839584] LNet: Removed LNI 192.168.202.33@tcp [ 703.936569] alg: No test for adler32 (adler32-zlib) [ 704.687750] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 704.747953] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 704.794285] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 704.796302] LNet: Accept secure, port 988 [ 706.325791] Key type lgssc registered [ 706.556373] Lustre: Echo OBD driver; http://www.lustre.org/ [ 715.750899] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 720.224608] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 726.376901] Lustre: Mounted lustre-client [ 728.033428] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 728.075897] checkstat (2109) used greatest stack depth: 10688 bytes left [ 728.703727] checkstat (2175) used greatest stack depth: 10416 bytes left [ 729.460818] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 730.399955] Lustre: Unmounted lustre-client [ 739.104290] Key type lgssc unregistered [ 739.173011] LNet: 2721:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 740.176111] LNet: Removed LNI 192.168.202.33@tcp [ 746.110843] alg: No test for adler32 (adler32-zlib) [ 746.862817] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 746.932182] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 746.982097] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 746.984248] LNet: Accept secure, port 988 [ 748.522786] Key type lgssc registered [ 748.809878] Lustre: Echo OBD driver; http://www.lustre.org/ [ 758.053793] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 762.503591] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 768.659687] Lustre: Mounted lustre-client [ 770.305652] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 771.510785] Lustre: Unmounted lustre-client [ 786.247684] Key type lgssc unregistered [ 786.311200] LNet: 5274:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 787.314083] LNet: Removed LNI 192.168.202.33@tcp [ 793.412753] alg: No test for adler32 (adler32-zlib) [ 794.164747] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 794.241650] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 794.297906] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 794.300215] LNet: Accept secure, port 988 [ 795.836778] Key type lgssc registered [ 796.085441] Lustre: Echo OBD driver; http://www.lustre.org/ [ 819.137042] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 819.813571] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 825.422957] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 846.529068] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 11:10:36 (1712761836) [ 874.692510] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 875.213662] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 880.371765] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 901.036303] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 11:11:31 (1712761891) [ 907.551512] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 908.081442] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 911.987601] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 948.276084] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 963.548717] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 11:12:33 (1712761953) [ 963.912176] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 965.847656] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 11:12:36 (1712761956) [ 966.216217] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 968.135366] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 11:12:38 (1712761958) [ 968.511045] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 970.451572] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 11:12:40 (1712761960) [ 970.823483] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 972.635160] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 974.006534] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 1002.555843] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1003.085631] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1008.221106] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1034.417273] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 11:13:44 (1712762024) [ 1041.301399] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1041.907603] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1046.165442] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1055.415051] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 1058.224426] Lustre: Mounted lustre-client [ 1065.996653] Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000 [ 1073.345862] Lustre: lustre-MDT0000-mdc-ffff8800ab399800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1088.369213] LustreError: 166-1: MGC192.168.202.133@tcp: Connection to MGS (at 192.168.202.133@tcp) was lost; in progress operations using this service will fail [ 1088.374382] Lustre: Evicted from MGS (at 192.168.202.133@tcp) after server handle changed from 0x691dcf752c472723 to 0x691dcf752c47e8ec [ 1088.377521] Lustre: MGC192.168.202.133@tcp: Connection restored to (at 192.168.202.133@tcp) [ 1089.620725] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8645500 x1795960900424576/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762096 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1090.229458] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8647480 x1795960900424896/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762096 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1091.670268] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8646680 x1795960900425536/t8589934603(8589934603) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762098 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1091.678497] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) Skipped 1 previous similar message [ 1093.993596] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a8644700 x1795960900426496/t8589934609(8589934609) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762100 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1094.002148] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) Skipped 2 previous similar messages [ 1098.010075] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800ac819880 x1795960900428096/t8589934619(8589934619) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762104 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1098.019531] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) Skipped 4 previous similar messages [ 1106.550226] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800aa9ca680 x1795960900431616/t8589934641(8589934641) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762112 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1106.556697] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) Skipped 10 previous similar messages [ 1123.193189] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8800a4d6fb80 x1795960900438336/t8589934683(8589934683) o101->lustre-MDT0000-mdc-ffff8800ab399800@192.168.202.133@tcp:12/10 lens 592/608 e 0 to 0 dl 1712762129 ref 2 fl Interpret:RQU/204/0 rc 301/301 job:'' uid:0 gid:0 [ 1123.200405] LustreError: 5867:0:(client.c:3294:ptlrpc_replay_interpret()) Skipped 20 previous similar messages [ 1148.248024] LustreError: 11-0: lustre-MDT0000-mdc-ffff8800ab399800: operation mds_close to node 192.168.202.133@tcp failed: rc = -107 [ 1148.262782] Lustre: lustre-MDT0000-mdc-ffff88012b47d800: Connection restored to (at 192.168.202.133@tcp) [ 1149.474163] LustreError: 167-0: lustre-MDT0000-mdc-ffff8800ab399800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 1149.537649] LustreError: 26966:0:(file.c:5550:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -5 [ 1149.640012] Lustre: lustre-MDT0000-mdc-ffff8800ab399800: Connection restored to (at 192.168.202.133@tcp) [ 1150.904690] Lustre: Unmounted lustre-client [ 1176.360435] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 11:16:06 (1712762166) [ 1362.598138] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1366.705205] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 11:19:17 (1712762357) [ 1382.503963] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1409.871164] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1410.420362] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1415.805466] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1435.847208] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 11:20:26 (1712762426) [ 1436.327490] Key type lgssc unregistered [ 1436.392886] LNet: 2290:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1437.394992] LNet: Removed LNI 192.168.202.33@tcp [ 1443.253834] alg: No test for adler32 (adler32-zlib) [ 1444.004693] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 1444.068596] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1444.115186] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1444.117409] LNet: Accept secure, port 988 [ 1445.644843] Key type lgssc registered [ 1445.861063] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1474.287194] Lustre: Mounted lustre-client [ 1474.516678] Lustre: Unmounted lustre-client [ 1488.619321] Lustre: DEBUG MARKER: == conf-sanity test 88: check the default mount options can be overridden ========================================================== 11:21:18 (1712762478) [ 1497.243923] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 11:21:27 (1712762487) [ 1524.612310] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1525.205418] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1530.623749] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1551.592463] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 11:22:21 (1712762541) [ 1558.306912] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1558.866832] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1562.951057] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1568.057491] Lustre: Mounted lustre-client [ 1585.754800] Lustre: 13687:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762560/real 1712762560] req@ffff8800a9d1d500 x1795961582006400/t0(0) o36->lustre-MDT0000-mdc-ffff8800a8afb000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762576 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1585.760786] Lustre: lustre-MDT0000-mdc-ffff8800a8afb000: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1585.767639] Lustre: lustre-MDT0000-mdc-ffff8800a8afb000: Connection restored to (at 192.168.202.133@tcp) [ 1585.778422] Lustre: 13687:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [ 1602.029750] Lustre: 13734:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762576/real 1712762576] req@ffff88012e251c00 x1795961582010176/t0(0) o36->lustre-MDT0000-mdc-ffff8800a8afb000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762592 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1602.029837] Lustre: lustre-MDT0000-mdc-ffff8800a8afb000: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1602.035699] Lustre: lustre-MDT0000-mdc-ffff8800a8afb000: Connection restored to (at 192.168.202.133@tcp) [ 1602.049768] Lustre: 13734:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 1602.210564] Lustre: Unmounted lustre-client [ 1617.904434] Key type lgssc unregistered [ 1617.966040] LNet: 14161:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1618.968156] LNet: Removed LNI 192.168.202.33@tcp [ 1623.640876] Lustre: DEBUG MARKER: == conf-sanity test 90b: check max_mod_rpcs_in_flight is enforced after update ========================================================== 11:23:33 (1712762613) [ 1624.046838] alg: No test for adler32 (adler32-zlib) [ 1624.798691] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1624.868195] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1624.921031] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1624.922984] LNet: Accept secure, port 988 [ 1626.452751] Key type lgssc registered [ 1626.675212] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1639.162708] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1639.852521] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1643.909078] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1650.019207] Lustre: Mounted lustre-client [ 1670.204730] Lustre: 17271:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762644/real 1712762644] req@ffff8800a85d0a80 x1795961771790656/t0(0) o36->lustre-MDT0000-mdc-ffff8800b6d8c800@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762660 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1670.212695] Lustre: lustre-MDT0000-mdc-ffff8800b6d8c800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1670.223094] Lustre: lustre-MDT0000-mdc-ffff8800b6d8c800: Connection restored to (at 192.168.202.133@tcp) [ 1686.609798] Lustre: 17324:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762661/real 1712762661] req@ffff88012c4b5c00 x1795961771796608/t0(0) o36->lustre-MDT0001-mdc-ffff8800b6d8c800@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762677 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1686.616184] Lustre: lustre-MDT0001-mdc-ffff8800b6d8c800: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1686.626036] Lustre: lustre-MDT0001-mdc-ffff8800b6d8c800: Connection restored to (at 192.168.202.133@tcp) [ 1702.869765] Lustre: 17366:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762677/real 1712762677] req@ffff8800a8bfb100 x1795961771799424/t0(0) o36->lustre-MDT0001-mdc-ffff8800b6d8c800@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762693 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1702.869824] Lustre: lustre-MDT0001-mdc-ffff8800b6d8c800: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1702.874421] Lustre: lustre-MDT0001-mdc-ffff8800b6d8c800: Connection restored to (at 192.168.202.133@tcp) [ 1702.894581] Lustre: 17366:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 1703.346692] Lustre: Unmounted lustre-client [ 1703.662749] Lustre: Mounted lustre-client [ 1720.172761] Lustre: 17508:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762694/real 1712762694] req@ffff8800a8bf9500 x1795961771816064/t0(0) o36->lustre-MDT0000-mdc-ffff8800b632e800@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762710 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1720.176798] Lustre: lustre-MDT0000-mdc-ffff8800b632e800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1720.183140] Lustre: lustre-MDT0000-mdc-ffff8800b632e800: Connection restored to (at 192.168.202.133@tcp) [ 1720.194255] Lustre: 17508:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 1736.436749] Lustre: 17558:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762711/real 1712762711] req@ffff8800a85d1180 x1795961771823168/t0(0) o36->lustre-MDT0000-mdc-ffff8800b632e800@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762727 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1736.439761] Lustre: lustre-MDT0000-mdc-ffff8800b632e800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1736.447541] Lustre: 17558:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 1736.448497] Lustre: lustre-MDT0000-mdc-ffff8800b632e800: Connection restored to (at 192.168.202.133@tcp) [ 1737.079680] Lustre: Unmounted lustre-client [ 1752.749632] Key type lgssc unregistered [ 1752.813041] LNet: 18012:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1753.815084] LNet: Removed LNI 192.168.202.33@tcp [ 1758.366964] Lustre: DEBUG MARKER: == conf-sanity test 90c: check max_mod_rpcs_in_flight update limits ========================================================== 11:25:48 (1712762748) [ 1758.735758] alg: No test for adler32 (adler32-zlib) [ 1759.486736] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1759.544345] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1759.593951] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1759.595811] LNet: Accept secure, port 988 [ 1761.123820] Key type lgssc registered [ 1761.320315] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1773.024086] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1773.557998] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1777.460412] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1783.586352] Lustre: Mounted lustre-client [ 1785.467719] Lustre: Unmounted lustre-client [ 1785.769768] Lustre: Mounted lustre-client [ 1785.803281] LustreError: 21184:0:(genops.c:2121:obd_set_max_mod_rpcs_in_flight()) lustre-MDT0000-mdc-ffff8800b6d86000: can't set max_mod_rpcs_in_flight=9 higher than mdt.*.max_mod_rpcs_in_flight=8 returned by the MDT server at connection. [ 1786.422703] Lustre: Unmounted lustre-client [ 1803.111011] Key type lgssc unregistered [ 1803.179059] LNet: 21698:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1804.180970] LNet: Removed LNI 192.168.202.33@tcp [ 1809.206238] Lustre: DEBUG MARKER: == conf-sanity test 90d: check one close RPC is allowed above max_mod_rpcs_in_flight ========================================================== 11:26:39 (1712762799) [ 1809.639677] alg: No test for adler32 (adler32-zlib) [ 1810.390687] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1810.447571] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1810.500828] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1810.502502] LNet: Accept secure, port 988 [ 1812.034768] Key type lgssc registered [ 1812.255118] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1824.615994] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1825.222680] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1829.563343] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1830.676864] Lustre: Mounted lustre-client [ 1852.148765] Lustre: 24797:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712762826/real 1712762826] req@ffff880136809f80 x1795961966828608/t0(0) o36->lustre-MDT0000-mdc-ffff88012e287000@192.168.202.133@tcp:12/10 lens 488/512 e 0 to 1 dl 1712762842 ref 2 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 1852.152863] Lustre: lustre-MDT0000-mdc-ffff88012e287000: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 1852.159497] Lustre: lustre-MDT0000-mdc-ffff88012e287000: Connection restored to (at 192.168.202.133@tcp) [ 1852.166515] Lustre: 24797:0:(client.c:2340:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 1852.410345] Lustre: Unmounted lustre-client [ 1868.167051] Key type lgssc unregistered [ 1868.230059] LNet: 25232:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1869.232036] LNet: Removed LNI 192.168.202.33@tcp [ 1873.945928] Lustre: DEBUG MARKER: == conf-sanity test 91: evict-by-nid support ============= 11:27:44 (1712762864) [ 1874.405701] alg: No test for adler32 (adler32-zlib) [ 1875.156695] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1875.230317] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1875.283271] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1875.286109] LNet: Accept secure, port 988 [ 1876.821861] Key type lgssc registered [ 1877.075834] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1889.541735] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1890.133059] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1894.272063] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1895.392306] Lustre: Mounted lustre-client [ 1901.504883] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 1911.538687] Lustre: Unmounted lustre-client [ 1950.717886] Key type lgssc unregistered [ 1950.780111] LNet: 28819:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1951.781973] LNet: Removed LNI 192.168.202.33@tcp [ 1956.583431] Lustre: DEBUG MARKER: == conf-sanity test 92: ldev returns MGS NID correctly in command substitution ========================================================== 11:29:06 (1712762946) [ 1960.267388] Lustre: DEBUG MARKER: == conf-sanity test 93: register mulitple MDT at the same time ========================================================== 11:29:10 (1712762950) [ 1960.625244] Lustre: DEBUG MARKER: SKIP: conf-sanity test_93 needs >= 3 MDTs [ 1962.637376] Lustre: DEBUG MARKER: == conf-sanity test 94: ldev outputs correct labels for file system name query ========================================================== 11:29:12 (1712762952) [ 1966.031260] Lustre: DEBUG MARKER: == conf-sanity test 95: ldev should only allow one label filter ========================================================== 11:29:16 (1712762956) [ 1969.756859] Lustre: DEBUG MARKER: == conf-sanity test 96: ldev returns hostname and backend fs correctly in command sub ========================================================== 11:29:20 (1712762960) [ 1973.272254] Lustre: DEBUG MARKER: == conf-sanity test 97: ldev returns correct ouput when querying based on role ========================================================== 11:29:23 (1712762963) [ 1976.796983] Lustre: DEBUG MARKER: == conf-sanity test 98: Buffer-overflow check while parsing mount_opts ========================================================== 11:29:27 (1712762967) [ 1977.184106] alg: No test for adler32 (adler32-zlib) [ 1977.935701] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1978.001723] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 1978.048744] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 1978.050259] LNet: Accept secure, port 988 [ 1979.578813] Key type lgssc registered [ 1979.809361] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1992.312490] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 1992.895259] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 1997.129227] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 1998.243012] Lustre: Mounted lustre-client [ 2003.549698] Lustre: Unmounted lustre-client [ 2011.392573] Key type lgssc unregistered [ 2011.467242] LNet: 5039:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2012.470020] LNet: Removed LNI 192.168.202.33@tcp [ 2017.363951] Lustre: DEBUG MARKER: == conf-sanity test 99: Adding meta_bg option ============ 11:30:07 (1712763007) [ 2017.853100] alg: No test for adler32 (adler32-zlib) [ 2018.604693] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2018.669547] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2018.723249] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2018.725339] LNet: Accept secure, port 988 [ 2020.256756] Key type lgssc registered [ 2020.473960] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2029.912128] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 11:30:20 (1712763020) [ 2053.567511] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2054.134343] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2059.695584] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2065.826255] Lustre: Mounted lustre-client [ 2066.850702] Lustre: Unmounted lustre-client [ 2078.663034] Key type lgssc unregistered [ 2078.732100] LNet: 11203:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2079.735076] LNet: Removed LNI 192.168.202.33@tcp [ 2084.600362] Lustre: DEBUG MARKER: == conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 11:31:14 (1712763074) [ 2085.035063] alg: No test for adler32 (adler32-zlib) [ 2085.787701] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2085.851524] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2085.908064] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2085.910123] LNet: Accept secure, port 988 [ 2087.439748] Key type lgssc registered [ 2087.663677] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2099.907719] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2100.529368] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2104.751487] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2110.882279] Lustre: Mounted lustre-client [ 2158.003712] Lustre: Unmounted lustre-client [ 2173.772073] Key type lgssc unregistered [ 2173.839027] LNet: 16565:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2174.842025] LNet: Removed LNI 192.168.202.33@tcp [ 2179.641955] Lustre: DEBUG MARKER: == conf-sanity test 101b: Race events DISCONNECT and ACTIVE in osp ========================================================== 11:32:49 (1712763169) [ 2180.072554] alg: No test for adler32 (adler32-zlib) [ 2180.823732] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2180.890206] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2180.940383] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2180.942643] LNet: Accept secure, port 988 [ 2182.473776] Key type lgssc registered [ 2182.697418] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2194.855139] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2195.428050] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2199.486130] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2205.600293] Lustre: Mounted lustre-client [ 2226.631755] Lustre: 17655:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712763201/real 1712763201] req@ffff88012b085500 x1795962354797504/t0(0) o400->lustre-OST0000-osc-ffff8800b63af000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 1 dl 1712763217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 2226.639160] Lustre: lustre-OST0000-osc-ffff8800b63af000: Connection to lustre-OST0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2231.644711] Lustre: 17655:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712763206/real 1712763206] req@ffff88012b086300 x1795962354797760/t0(0) o400->lustre-OST0000-osc-ffff8800b63af000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 1 dl 1712763222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 2236.655760] Lustre: 17655:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712763211/real 1712763211] req@ffff8800ab15ed80 x1795962354798016/t0(0) o400->lustre-OST0000-osc-ffff8800b63af000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 1 dl 1712763227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 2239.652977] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2241.642764] Lustre: 17654:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1712763216/real 1712763216] req@ffff8800ab15fb80 x1795962354798272/t0(0) o400->lustre-OST0000-osc-ffff8800b63af000@192.168.202.133@tcp:28/4 lens 224/224 e 0 to 1 dl 1712763232 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 [ 2252.216410] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 12 sec [ 2252.804674] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b63af000.ost_server_uuid 50 [ 2253.156920] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff8800b63af000.ost_server_uuid in FULL state after 0 sec [ 2253.350370] Lustre: Unmounted lustre-client [ 2269.115784] Key type lgssc unregistered [ 2269.185005] LNet: 21217:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2270.187981] LNet: Removed LNI 192.168.202.33@tcp [ 2274.147055] Lustre: DEBUG MARKER: SKIP: conf-sanity test_102 skipping excluded test 102 [ 2275.583028] Lustre: DEBUG MARKER: == conf-sanity test 103: rename filesystem name ========== 11:34:25 (1712763265) [ 2277.297664] alg: No test for adler32 (adler32-zlib) [ 2278.048746] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2278.116515] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2278.170398] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2278.173251] LNet: Accept secure, port 988 [ 2279.704749] Key type lgssc registered [ 2279.917431] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2301.386951] Lustre: Mounted lustre-client [ 2303.348425] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2318.679091] Lustre: Unmounted lustre-client [ 2367.983314] Lustre: Mounted mylustre-client [ 2373.636003] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2382.703744] Lustre: Unmounted mylustre-client [ 2430.410600] Lustre: Mounted tfs-client [ 2436.028751] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2442.699668] Lustre: Unmounted tfs-client [ 2490.452661] Lustre: Mounted lustre-client [ 2496.076599] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 2504.950753] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 11:38:15 (1712763495) [ 2505.299939] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2515.341357] Lustre: Unmounted lustre-client [ 2571.797698] Lustre: client wants to enable acl, but mdt not! [ 2571.806902] Lustre: Mounted lustre-client [ 2575.284137] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 11:39:25 (1712763565) [ 2575.352873] Lustre: client wants to enable acl, but mdt not! [ 2575.544719] Lustre: Unmounted lustre-client [ 2579.215509] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 11:39:29 (1712763569) [ 2579.353966] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2579.355723] Lustre: Skipped 3 previous similar messages [ 2589.403755] Lustre: Unmounted lustre-client [ 2589.406996] Lustre: Skipped 2 previous similar messages [ 2611.396768] Key type lgssc unregistered [ 2611.456908] LNet: 4288:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2612.459163] LNet: Removed LNI 192.168.202.33@tcp [ 2624.217034] alg: No test for adler32 (adler32-zlib) [ 2624.967725] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2625.027431] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2625.076261] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2625.078932] LNet: Accept secure, port 988 [ 2626.616861] Key type lgssc registered [ 2626.827294] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2646.257688] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2646.810275] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2652.490560] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2653.676800] Lustre: Mounted lustre-client [ 2653.739678] Lustre: Remounted lustre-client read-only [ 2653.950457] Lustre: Unmounted lustre-client [ 2670.016319] Key type lgssc unregistered [ 2670.082930] LNet: 8188:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2671.086300] LNet: Removed LNI 192.168.202.33@tcp [ 2675.701623] Lustre: DEBUG MARKER: SKIP: conf-sanity test_106 skipping SLOW test 106 [ 2677.295925] Lustre: DEBUG MARKER: == conf-sanity test 107: Unknown config param should not fail target mounting ========================================================== 11:41:07 (1712763667) [ 2677.767593] alg: No test for adler32 (adler32-zlib) [ 2678.519690] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2678.576024] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2678.624941] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2678.627647] LNet: Accept secure, port 988 [ 2680.160795] Key type lgssc registered [ 2680.372920] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2693.290519] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 2693.853012] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 2698.164105] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2714.136725] Key type lgssc unregistered [ 2714.196943] LNet: 11707:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2714.201042] LNet: Removed LNI 192.168.202.33@tcp [ 2716.083914] alg: No test for adler32 (adler32-zlib) [ 2716.834730] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 2716.898723] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2716.962960] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2716.965143] LNet: Accept secure, port 988 [ 2718.509761] Key type lgssc registered [ 2718.812148] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2931.292715] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 2935.032258] Key type lgssc unregistered [ 2935.122165] LNet: 13623:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2935.125747] LNet: Removed LNI 192.168.202.33@tcp [ 2941.236643] Lustre: DEBUG MARKER: == conf-sanity test 108a: migrate from ldiskfs to ZFS ==== 11:45:31 (1712763931) [ 2941.612520] Lustre: DEBUG MARKER: SKIP: conf-sanity test_108a zfs only test [ 2943.495197] Lustre: DEBUG MARKER: == conf-sanity test 108b: migrate from ZFS to ldiskfs ==== 11:45:33 (1712763933) [ 2946.541400] alg: No test for adler32 (adler32-zlib) [ 2947.294767] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2947.364999] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 2947.407686] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 2947.408822] LNet: Accept secure, port 988 [ 2948.933941] Key type lgssc registered [ 2949.177372] Lustre: Echo OBD driver; http://www.lustre.org/ [ 2977.318534] Lustre: Mounted lustre-client [ 2977.405782] awk (16357) used greatest stack depth: 10384 bytes left [ 2977.424201] sha1sum (16358) used greatest stack depth: 10224 bytes left [ 2977.443236] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 2977.445917] LustreError: 16361:0:(file.c:264:ll_close_inode_openhandle()) lustre-clilmv-ffff8800ab3c2000: inode [0x200000bd1:0x2:0x0] mdc close failed: rc = -108 [ 2977.454163] Lustre: 15293:0:(llite_lib.c:4078:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.133@tcp:/lustre/fid: [0x240000402:0x3:0x0]/ may get corrupted (rc -108) [ 2977.454238] Lustre: 15290:0:(llite_lib.c:4078:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.202.133@tcp:/lustre/fid: [0x200000bd1:0x2:0x0]/ may get corrupted (rc -108) [ 2987.489661] Lustre: Unmounted lustre-client [ 3017.985407] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 11:46:48 (1712764008) [ 3055.738984] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3056.600160] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3064.051100] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3064.223234] Lustre: Mounted lustre-client [ 3124.858922] Lustre: Unmounted lustre-client [ 3154.714929] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3155.403388] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3160.186361] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3160.324916] Lustre: Mounted lustre-client [ 3171.039035] Lustre: Unmounted lustre-client [ 3187.463850] Key type lgssc unregistered [ 3187.548317] LNet: 23221:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3188.552054] LNet: Removed LNI 192.168.202.33@tcp [ 3194.594033] Lustre: DEBUG MARKER: == conf-sanity test 109b: test lctl clear_conf one config ========================================================== 11:49:44 (1712764184) [ 3203.096692] alg: No test for adler32 (adler32-zlib) [ 3203.848768] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3203.926647] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 3203.979466] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 3203.981795] LNet: Accept secure, port 988 [ 3205.514852] Key type lgssc registered [ 3205.783296] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3230.761363] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3231.447185] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3237.645820] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3238.816683] Lustre: Mounted lustre-client [ 3303.348687] Lustre: Unmounted lustre-client [ 3331.013353] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3331.589315] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3335.667975] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3340.779143] Lustre: Mounted lustre-client [ 3356.102694] Lustre: Unmounted lustre-client [ 3372.045793] Key type lgssc unregistered [ 3372.115339] LNet: 30424:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3373.118058] LNet: Removed LNI 192.168.202.33@tcp [ 3377.063571] Lustre: DEBUG MARKER: SKIP: conf-sanity test_110 skipping ALWAYS excluded test 110 [ 3377.531667] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [ 3379.069535] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 11:52:49 (1712764369) [ 3379.503156] alg: No test for adler32 (adler32-zlib) [ 3380.254700] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3380.315895] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 3380.365967] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 3380.367568] LNet: Accept secure, port 988 [ 3381.899820] Key type lgssc registered [ 3382.168489] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3394.274952] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3394.858136] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3398.800425] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3404.783998] Lustre: Mounted lustre-client [ 3406.191965] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff88012ab5f800.ost_server_uuid 50 [ 3406.537195] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff88012ab5f800.ost_server_uuid in FULL state after 0 sec [ 3407.081193] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff88012ab5f800.ost_server_uuid 50 [ 3407.394781] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff88012ab5f800.ost_server_uuid in FULL state after 0 sec [ 3419.809973] Lustre: lustre-OST0001-osc-ffff88012ab5f800: Connection to lustre-OST0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3425.131712] Lustre: Unmounted lustre-client [ 3440.840446] Key type lgssc unregistered [ 3440.909029] LNet: 2891:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3441.911984] LNet: Removed LNI 192.168.202.33@tcp [ 3447.084458] Lustre: DEBUG MARKER: == conf-sanity test 112b: mount MDT with no_create option ========================================================== 11:53:57 (1712764437) [ 3447.547797] alg: No test for adler32 (adler32-zlib) [ 3448.298712] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3448.371701] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 3448.427184] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 3448.429916] LNet: Accept secure, port 988 [ 3449.960804] Key type lgssc registered [ 3450.208537] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3459.033376] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3465.647085] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3469.342843] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid [ 3470.439525] Lustre: Mounted lustre-client [ 3550.943698] Lustre: Unmounted lustre-client [ 3566.433254] Key type lgssc unregistered [ 3566.505927] LNet: 6694:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3567.507973] LNet: Removed LNI 192.168.202.33@tcp [ 3572.133907] Lustre: DEBUG MARKER: == conf-sanity test 113: Shadow mountpoint correctly report ro/rw for mounts ========================================================== 11:56:02 (1712764562) [ 3579.659461] alg: No test for adler32 (adler32-zlib) [ 3580.410723] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3580.476114] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 3580.526381] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 3580.528049] LNet: Accept secure, port 988 [ 3582.056787] Key type lgssc registered [ 3582.282938] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3602.406844] Lustre: Mounted lustre-client [ 3607.983181] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3617.142356] Lustre: Unmounted lustre-client [ 3664.094320] Lustre: Mounted lustre-client [ 3669.780839] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 3675.849706] Lustre: Unmounted lustre-client [ 3706.920178] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [ 3707.291309] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [ 3708.685598] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 11:58:19 (1712764699) [ 3739.423873] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3739.974975] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3745.228308] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3766.318185] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 11:59:16 (1712764756) [ 3772.989510] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3773.523223] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3777.502064] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3782.616221] Lustre: Mounted lustre-client [ 3784.428450] Lustre: Unmounted lustre-client [ 3796.031041] Key type lgssc unregistered [ 3796.093112] LNet: 20287:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3797.096001] LNet: Removed LNI 192.168.202.33@tcp [ 3801.839648] Lustre: DEBUG MARKER: == conf-sanity test 119: writeconf on slave mdt shouldn't duplicate mdc/osp and crash ========================================================== 11:59:52 (1712764792) [ 3802.966986] alg: No test for adler32 (adler32-zlib) [ 3803.718744] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3803.788198] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 3803.844213] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 3803.845962] LNet: Accept secure, port 988 [ 3805.380764] Key type lgssc registered [ 3805.614813] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3817.639880] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3818.214121] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 3822.232926] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 3828.353993] Lustre: Mounted lustre-client [ 3833.361927] Lustre: lustre-MDT0001-mdc-ffff8800b632f000: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3848.336610] LustreError: 23704:0:(obd_config.c:2037:class_config_llog_handler()) MGC192.168.202.133@tcp: cfg command failed: rc = -17 [ 3848.339333] Lustre: cmd=cf001 0:lustre-MDT0001-mdc 1:mdc 2:lustre-clilmv_UUID [ 3848.341673] LustreError: 23285:0:(mgc_request.c:621:do_requeue()) failed processing log: -17 [ 4143.857394] Lustre: lustre-MDT0001-mdc-ffff8800b632f000: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4156.406326] LustreError: 26126:0:(obd_config.c:703:class_setup()) Device 4 already setup (type mdc) [ 4156.408201] LustreError: 26126:0:(obd_config.c:2037:class_config_llog_handler()) MGC192.168.202.133@tcp: cfg command failed: rc = -17 [ 4156.411978] Lustre: cmd=cf003 0:lustre-MDT0001-mdc 1:lustre-MDT0001_UUID 2:192.168.202.133@tcp [ 4156.416212] LustreError: 23285:0:(mgc_request.c:621:do_requeue()) failed processing log: -17 [ 4454.355069] Lustre: lustre-MDT0001-mdc-ffff8800b632f000: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4469.544650] LustreError: 28578:0:(obd_config.c:2037:class_config_llog_handler()) MGC192.168.202.133@tcp: cfg command failed: rc = -17 [ 4469.548710] Lustre: cmd=cf014 0:lustre-clilmv 1:lustre-MDT0001_UUID 2:1 3:1 4:lustre-MDT0001-mdc_UUID [ 4469.553038] LustreError: 23285:0:(mgc_request.c:621:do_requeue()) failed processing log: -17 [ 4766.486387] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 4776.525702] Lustre: Unmounted lustre-client [ 4804.860780] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 12:16:35 (1712765795) [ 4813.897349] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4814.451842] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4819.722902] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 4824.840837] Lustre: Mounted lustre-client [ 4826.331732] Lustre: Unmounted lustre-client [ 4851.638683] Lustre: DEBUG MARKER: == conf-sanity test 121: failover MGS ==================== 12:17:21 (1712765841) [ 4867.839656] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4868.785982] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4886.365539] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid [ 4917.897774] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4920.004494] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 4941.907019] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid [ 4958.713988] Lustre: DEBUG MARKER: == conf-sanity test 122a: Check OST sequence update ====== 12:19:08 (1712765948) [ 5011.466573] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5012.312214] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5018.625755] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5023.789546] Lustre: Mounted lustre-client [ 5028.030690] Lustre: Unmounted lustre-client [ 5046.031368] Key type lgssc unregistered [ 5046.157184] LNet: 11864:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5047.166662] LNet: Removed LNI 192.168.202.33@tcp [ 5056.139455] Lustre: DEBUG MARKER: == conf-sanity test 123aa: llog_print works with FIDs and simple names ========================================================== 12:20:46 (1712766046) [ 5056.691018] alg: No test for adler32 (adler32-zlib) [ 5057.442744] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5057.513721] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 5057.566485] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 5057.568392] LNet: Accept secure, port 988 [ 5059.098808] Key type lgssc registered [ 5059.361684] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5074.890121] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5075.712599] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5082.189148] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5092.431131] Lustre: Mounted lustre-client [ 5102.797096] Lustre: DEBUG MARKER: == conf-sanity test 123ab: llog_print params output values from set_param -P ========================================================== 12:21:32 (1712766092) [ 5115.934636] Lustre: DEBUG MARKER: == conf-sanity test 123ac: llog_print with --start and --end ========================================================== 12:21:45 (1712766105) [ 5126.632771] Lustre: DEBUG MARKER: == conf-sanity test 123ad: llog_print shows all records == 12:21:56 (1712766116) [ 5135.493258] Lustre: DEBUG MARKER: == conf-sanity test 123ae: llog_cancel can cancel requested record ========================================================== 12:22:05 (1712766125) [ 5153.538674] Lustre: DEBUG MARKER: == conf-sanity test 123af: llog_catlist can show all config files correctly ========================================================== 12:22:23 (1712766143) [ 5167.542524] Lustre: DEBUG MARKER: == conf-sanity test 123ag: llog_print skips values deleted by set_param -P -d ========================================================== 12:22:37 (1712766157) [ 5180.936211] Lustre: DEBUG MARKER: == conf-sanity test 123ah: del_ost cancels config log entries correctly ========================================================== 12:22:50 (1712766170) [ 5185.935883] Lustre: Unmounted lustre-client [ 5186.177692] Lustre: Mounted lustre-client [ 5186.820905] Lustre: Unmounted lustre-client [ 5205.720537] Key type lgssc unregistered [ 5205.859780] LNet: 21284:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5206.865147] LNet: Removed LNI 192.168.202.33@tcp [ 5218.727079] alg: No test for adler32 (adler32-zlib) [ 5219.479728] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 5219.643377] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 5219.751781] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 5219.757116] LNet: Accept secure, port 988 [ 5221.326756] Key type lgssc registered [ 5221.773950] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5256.468405] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5257.527584] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5265.055332] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5286.833892] Lustre: DEBUG MARKER: == conf-sanity test 123ai: llog_print display all non skipped records ========================================================== 12:24:37 (1712766277) [ 5295.484143] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5296.400664] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5302.836167] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5304.197745] Lustre: Mounted lustre-client [ 5373.543189] Lustre: DEBUG MARKER: == conf-sanity test 123F: clear and reset all parameters using set_param -F ========================================================== 12:26:03 (1712766363) [ 5379.115185] Lustre: Unmounted lustre-client [ 5414.543662] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5415.631294] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5423.016673] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5423.365470] Lustre: Mounted lustre-client [ 5425.259343] Lustre: Unmounted lustre-client [ 5455.641603] Key type lgssc unregistered [ 5455.791765] LNet: 31389:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5456.796933] LNet: Removed LNI 192.168.202.33@tcp [ 5467.403337] Lustre: DEBUG MARKER: == conf-sanity test 123G: clear and reset all parameters using apply_yaml ========================================================== 12:27:37 (1712766457) [ 5468.252215] alg: No test for adler32 (adler32-zlib) [ 5469.010195] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 5469.160285] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 5469.280616] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 5469.283273] LNet: Accept secure, port 988 [ 5470.872755] Key type lgssc registered [ 5471.543690] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5488.434799] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5489.153151] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5494.082780] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5495.232900] Lustre: Mounted lustre-client [ 5502.642704] Lustre: Unmounted lustre-client [ 5540.096998] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5541.205784] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5549.414368] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5549.762710] Lustre: Mounted lustre-client [ 5552.599187] Lustre: Unmounted lustre-client [ 5573.391997] Key type lgssc unregistered [ 5573.521170] LNet: 4290:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5574.528039] LNet: Removed LNI 192.168.202.33@tcp [ 5586.659740] Lustre: DEBUG MARKER: == conf-sanity test 124: check failover after replace_nids ========================================================== 12:29:36 (1712766576) [ 5587.679910] Lustre: DEBUG MARKER: SKIP: conf-sanity test_124 needs MDT failover setup [ 5592.719536] Lustre: DEBUG MARKER: == conf-sanity test 125: check l_tunedisk only tunes OSTs and their slave devices ========================================================== 12:29:42 (1712766582) [ 5616.894869] Lustre: DEBUG MARKER: == conf-sanity test 126: mount in parallel shouldn't cause a crash ========================================================== 12:30:06 (1712766606) [ 5633.789534] alg: No test for adler32 (adler32-zlib) [ 5634.545788] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 5634.691312] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 5634.786554] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 5634.790177] LNet: Accept secure, port 988 [ 5636.377246] Key type lgssc registered [ 5636.973370] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5664.642178] Lustre: DEBUG MARKER: == conf-sanity test 127: direct io overwrite on full ost ========================================================== 12:30:54 (1712766654) [ 5671.895981] Key type lgssc unregistered [ 5672.014069] LNet: 9314:0:(lib-ptl.c:966:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 5672.019387] LNet: Removed LNI 192.168.202.33@tcp [ 5676.735142] alg: No test for adler32 (adler32-zlib) [ 5677.488875] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 [ 5677.595289] Lustre: Lustre: Build Version: 2.15.62_1_ga509b3f [ 5677.697960] LNet: Added LNI 192.168.202.33@tcp [8/256/0/180] [ 5677.700286] LNet: Accept secure, port 988 [ 5679.248303] Key type lgssc registered [ 5679.751470] Lustre: Echo OBD driver; http://www.lustre.org/ [ 5699.601965] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5700.638800] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5708.093170] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 5718.391727] Lustre: Mounted lustre-client [ 5746.775986] Lustre: DEBUG MARKER: == conf-sanity test 128: Force using remote logs with --nolocallogs ========================================================== 12:32:16 (1712766736) [ 5747.421089] Lustre: DEBUG MARKER: SKIP: conf-sanity test_128 need separate mgs device [ 5750.580367] Lustre: DEBUG MARKER: == conf-sanity test 129: attempt to connect an OST with the same index should fail ========================================================== 12:32:20 (1712766740) [ 5750.934023] Lustre: Unmounted lustre-client [ 5786.738163] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 5787.553218] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 5815.070470] Lustre: DEBUG MARKER: == conf-sanity test 130: re-register an MDT after writeconf ========================================================== 12:33:25 (1712766805) [ 5834.908967] Lustre: Mounted lustre-client [ 5840.536864] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5849.938921] Lustre: lustre-MDT0001-mdc-ffff8800b6d8e000: Connection to lustre-MDT0001 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5858.415206] LustreError: 17849:0:(obd_config.c:2037:class_config_llog_handler()) MGC192.168.202.133@tcp: cfg command failed: rc = -17 [ 5858.419392] Lustre: cmd=cf001 0:lustre-MDT0001-mdc 1:mdc 2:lustre-clilmv_UUID [ 5858.422821] LustreError: 17041:0:(mgc_request.c:621:do_requeue()) failed processing log: -17 [ 5859.951931] Lustre: lustre-OST0000-osc-ffff8800b6d8e000: disconnect after 20s idle [ 5861.591998] Lustre: DEBUG MARKER: == conf-sanity test 131: MDT backup restore with project ID ========================================================== 12:34:11 (1712766851) [ 5874.579069] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5889.683545] Lustre: Unmounted lustre-client [ 5978.995986] Lustre: Mounted lustre-client [ 5982.017768] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 5987.998207] Lustre: 23582:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1712766978/real 1712766978] req@ffff8800ab2e2a00 x1795966022244608/t0(0) o503->MGC192.168.202.133@tcp@192.168.202.133@tcp:26/25 lens 272/8416 e 0 to 1 dl 1712766994 ref 2 fl Rpc:ReXQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 [ 5988.016944] LustreError: 166-1: MGC192.168.202.133@tcp: Connection to MGS (at 192.168.202.133@tcp) was lost; in progress operations using this service will fail [ 5988.023091] LustreError: 23582:0:(mgc_request.c:621:do_requeue()) failed processing log: -5 [ 5988.040914] Lustre: MGC192.168.202.133@tcp: Connection restored to (at 192.168.202.133@tcp) [ 6013.397963] Lustre: DEBUG MARKER: == conf-sanity test 132: hsm_actions processed after failover ========================================================== 12:36:43 (1712767003) [ 6013.591701] Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request [ 6023.897715] Lustre: Unmounted lustre-client [ 6085.869728] Lustre: DEBUG MARKER: == conf-sanity test 133: stripe QOS: free space balance in a pool ========================================================== 12:37:55 (1712767075) [ 6086.877510] Lustre: DEBUG MARKER: SKIP: conf-sanity test_133 needs >= 4 OSTs [ 6093.640517] Lustre: DEBUG MARKER: == conf-sanity test 134: check_iam works without faults == 12:38:03 (1712767083) [ 6137.653169] Lustre: DEBUG MARKER: == conf-sanity test 135: check the behavior when changelog is wrapped around ========================================================== 12:38:47 (1712767127) [ 6179.427206] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 6180.702827] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 6190.090609] Lustre: DEBUG MARKER: oleg233-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid [ 6190.293861] Lustre: Mounted lustre-client [ 6202.066651] Lustre: 1262:0:(client.c:2340:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1712767192/real 1712767192] req@ffff8800aab56680 x1795966022755456/t0(0) o35->lustre-MDT0000-mdc-ffff8800b6d88800@192.168.202.133@tcp:23/10 lens 392/624 e 0 to 1 dl 1712767208 ref 2 fl Rpc:ReXQU/200/ffffffff rc 0/-1 job:'createmany.0' uid:0 gid:0 [ 6202.087251] Lustre: lustre-MDT0000-mdc-ffff8800b6d88800: Connection to lustre-MDT0000 (at 192.168.202.133@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 6202.111827] Lustre: lustre-MDT0000-mdc-ffff8800b6d88800: Connection restored to (at 192.168.202.133@tcp) [ 6212.899545] Lustre: DEBUG MARKER: conf-sanity test_135: @@@@@@ FAIL: creation thread is running. Is changelog reader stuck?