Feb 27 12:08:13 oleg352-client journal: Runtime journal is using 8.0M (max allowed 186.5M, trying to leave 279.8M free of 1.8G available → current limit 186.5M). Feb 27 12:08:13 oleg352-client kernel: Initializing cgroup subsys cpuset Feb 27 12:08:13 oleg352-client kernel: Initializing cgroup subsys cpu Feb 27 12:08:13 oleg352-client kernel: Initializing cgroup subsys cpuacct Feb 27 12:08:13 oleg352-client kernel: Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 Feb 27 12:08:13 oleg352-client kernel: Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 Feb 27 12:08:13 oleg352-client kernel: e820: BIOS-provided physical RAM map: Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Feb 27 12:08:13 oleg352-client kernel: BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable Feb 27 12:08:13 oleg352-client kernel: NX (Execute Disable) protection: active Feb 27 12:08:13 oleg352-client kernel: SMBIOS 2.8 present. Feb 27 12:08:13 oleg352-client kernel: DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014 Feb 27 12:08:13 oleg352-client kernel: Hypervisor detected: KVM Feb 27 12:08:13 oleg352-client kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Feb 27 12:08:13 oleg352-client kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Feb 27 12:08:13 oleg352-client kernel: AGP: No AGP bridge found Feb 27 12:08:13 oleg352-client kernel: e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 Feb 27 12:08:13 oleg352-client kernel: MTRR default type: write-back Feb 27 12:08:13 oleg352-client kernel: MTRR fixed ranges enabled: Feb 27 12:08:13 oleg352-client kernel: 00000-9FFFF write-back Feb 27 12:08:13 oleg352-client kernel: A0000-BFFFF uncachable Feb 27 12:08:13 oleg352-client kernel: C0000-FFFFF write-protect Feb 27 12:08:13 oleg352-client kernel: MTRR variable ranges enabled: Feb 27 12:08:13 oleg352-client kernel: 0 base 00C0000000 mask FFC0000000 uncachable Feb 27 12:08:13 oleg352-client kernel: 1 disabled Feb 27 12:08:13 oleg352-client kernel: 2 disabled Feb 27 12:08:13 oleg352-client kernel: 3 disabled Feb 27 12:08:13 oleg352-client kernel: 4 disabled Feb 27 12:08:13 oleg352-client kernel: 5 disabled Feb 27 12:08:13 oleg352-client kernel: 6 disabled Feb 27 12:08:13 oleg352-client kernel: 7 disabled Feb 27 12:08:13 oleg352-client kernel: PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC Feb 27 12:08:13 oleg352-client kernel: e820: last_pfn = 0xbffda max_arch_pfn = 0x400000000 Feb 27 12:08:13 oleg352-client kernel: found SMP MP-table at [mem 0x000f5b50-0x000f5b5f] mapped at [ffffffffff200b50] Feb 27 12:08:13 oleg352-client kernel: Base memory trampoline at [ffff880000099000] 99000 size 24576 Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c1000, 0x023c1fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c2000, 0x023c2fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c3000, 0x023c3fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c4000, 0x023c4fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c5000, 0x023c5fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: BRK [0x023c6000, 0x023c6fff] PGTABLE Feb 27 12:08:13 oleg352-client kernel: RAMDISK: [mem 0xbc2f2000-0xbffcffff] Feb 27 12:08:13 oleg352-client kernel: Early table checksum verification disabled Feb 27 12:08:13 oleg352-client kernel: ACPI: RSDP 00000000000f5970 00014 (v00 BOCHS ) Feb 27 12:08:13 oleg352-client kernel: ACPI: RSDT 00000000bffe1bb7 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: FACP 00000000bffe1a53 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: DSDT 00000000bffe0040 01A13 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: FACS 00000000bffe0000 00040 Feb 27 12:08:13 oleg352-client kernel: ACPI: APIC 00000000bffe1ac7 00090 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: HPET 00000000bffe1b57 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: WAET 00000000bffe1b8f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Feb 27 12:08:13 oleg352-client kernel: ACPI: Local APIC address 0xfee00000 Feb 27 12:08:13 oleg352-client kernel: No NUMA configuration found Feb 27 12:08:13 oleg352-client kernel: Faking a node at [mem 0x0000000000000000-0x000000013edfffff] Feb 27 12:08:13 oleg352-client kernel: NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] Feb 27 12:08:13 oleg352-client kernel: Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) Feb 27 12:08:13 oleg352-client kernel: kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock Feb 27 12:08:13 oleg352-client kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Feb 27 12:08:13 oleg352-client kernel: kvm-clock: using sched offset of 294145447 cycles Feb 27 12:08:13 oleg352-client kernel: Zone ranges: Feb 27 12:08:13 oleg352-client kernel: DMA [mem 0x00001000-0x00ffffff] Feb 27 12:08:13 oleg352-client kernel: DMA32 [mem 0x01000000-0xffffffff] Feb 27 12:08:13 oleg352-client kernel: Normal [mem 0x100000000-0x13edfffff] Feb 27 12:08:13 oleg352-client kernel: Movable zone start for each node Feb 27 12:08:13 oleg352-client kernel: Early memory node ranges Feb 27 12:08:13 oleg352-client kernel: node 0: [mem 0x00001000-0x0009efff] Feb 27 12:08:13 oleg352-client kernel: node 0: [mem 0x00100000-0xbffd9fff] Feb 27 12:08:13 oleg352-client kernel: node 0: [mem 0x100000000-0x13edfffff] Feb 27 12:08:13 oleg352-client kernel: Initmem setup node 0 [mem 0x00001000-0x13edfffff] Feb 27 12:08:13 oleg352-client kernel: On node 0 totalpages: 1043832 Feb 27 12:08:13 oleg352-client kernel: DMA zone: 64 pages used for memmap Feb 27 12:08:13 oleg352-client kernel: DMA zone: 21 pages reserved Feb 27 12:08:13 oleg352-client kernel: DMA zone: 3998 pages, LIFO batch:0 Feb 27 12:08:13 oleg352-client kernel: DMA32 zone: 12224 pages used for memmap Feb 27 12:08:13 oleg352-client kernel: DMA32 zone: 782298 pages, LIFO batch:31 Feb 27 12:08:13 oleg352-client kernel: Normal zone: 4024 pages used for memmap Feb 27 12:08:13 oleg352-client kernel: Normal zone: 257536 pages, LIFO batch:31 Feb 27 12:08:13 oleg352-client kernel: ACPI: PM-Timer IO Port: 0x608 Feb 27 12:08:13 oleg352-client kernel: ACPI: Local APIC address 0xfee00000 Feb 27 12:08:13 oleg352-client kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Feb 27 12:08:13 oleg352-client kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) Feb 27 12:08:13 oleg352-client kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) Feb 27 12:08:13 oleg352-client kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) Feb 27 12:08:13 oleg352-client kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Feb 27 12:08:13 oleg352-client kernel: ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) Feb 27 12:08:13 oleg352-client kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Feb 27 12:08:13 oleg352-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Feb 27 12:08:13 oleg352-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Feb 27 12:08:13 oleg352-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Feb 27 12:08:13 oleg352-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Feb 27 12:08:13 oleg352-client kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Feb 27 12:08:28 oleg352-client sshd[1036]: Accepted publickey for root from 192.168.200.253 port 39460 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Feb 27 12:08:28 oleg352-client systemd: Created slice User Slice of root. Feb 27 12:08:28 oleg352-client systemd-logind: New session 1 of user root. Feb 27 12:08:28 oleg352-client systemd: Started Session 1 of user root. Feb 27 12:08:28 oleg352-client sshd[1036]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:08:28 oleg352-client sshd[1036]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:08:28 oleg352-client systemd: Cannot add dependency job for unit systemd-hwdb-update.service, ignoring: Unit is masked. Feb 27 12:08:29 oleg352-client sshd[1036]: Received disconnect from 192.168.200.253 port 39460:11: disconnected by user Feb 27 12:08:29 oleg352-client sshd[1036]: Disconnected from 192.168.200.253 port 39460 Feb 27 12:08:29 oleg352-client sshd[1036]: pam_unix(sshd:session): session closed for user root Feb 27 12:08:29 oleg352-client systemd-logind: Removed session 1. Feb 27 12:08:29 oleg352-client systemd: Removed slice User Slice of root. Feb 27 12:08:29 oleg352-client sshd[1091]: Accepted publickey for root from 192.168.200.253 port 39476 ssh2: RSA SHA256:9e8LCkrakioBi3TKSwi0ueMHJ3ih9q2KxjmcAXV6W0I Feb 27 12:08:29 oleg352-client systemd: Created slice User Slice of root. Feb 27 12:08:29 oleg352-client systemd-logind: New session 2 of user root. Feb 27 12:08:29 oleg352-client systemd: Started Session 2 of user root. Feb 27 12:08:29 oleg352-client sshd[1091]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:08:29 oleg352-client sshd[1091]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:08:29 oleg352-client sshd[1131]: lastlog_openseek: Couldn't stat /var/log/lastlog: No such file or directory Feb 27 12:08:29 oleg352-client sshd[1131]: lastlog_openseek: Couldn't stat /var/log/lastlog: No such file or directory Feb 27 12:08:34 oleg352-client systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Feb 27 12:08:34 oleg352-client kernel: libcfs: loading out-of-tree module taints kernel. Feb 27 12:08:34 oleg352-client kernel: libcfs: module verification failed: signature and/or required key missing - tainting kernel Feb 27 12:08:34 oleg352-client kernel: libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 Feb 27 12:08:34 oleg352-client kernel: alg: No test for adler32 (adler32-zlib) Feb 27 12:08:35 oleg352-client kernel: PCLMULQDQ-NI instructions are not detected. Feb 27 12:08:35 oleg352-client kernel: Lustre: Lustre: Build Version: 2.15.61_76_g2ee32a4 Feb 27 12:08:35 oleg352-client kernel: LNet: Added LNI 192.168.203.52@tcp [8/256/0/180] Feb 27 12:08:35 oleg352-client kernel: LNet: Accept secure, port 988 Feb 27 12:08:37 oleg352-client kernel: Key type lgssc registered Feb 27 12:08:37 oleg352-client kernel: Lustre: Echo OBD driver; http://www.lustre.org/ Feb 27 12:08:54 oleg352-client systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Feb 27 12:09:10 oleg352-client kernel: Lustre: Mounted lustre-client Feb 27 12:09:11 oleg352-client sshd[4677]: Accepted publickey for root from 192.168.203.52 port 41624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:11 oleg352-client systemd-logind: New session 3 of user root. Feb 27 12:09:11 oleg352-client systemd: Started Session 3 of user root. Feb 27 12:09:11 oleg352-client sshd[4677]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:11 oleg352-client sshd[4677]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:11 oleg352-client sshd[4677]: Received disconnect from 192.168.203.52 port 41624:11: disconnected by user Feb 27 12:09:11 oleg352-client sshd[4677]: Disconnected from 192.168.203.52 port 41624 Feb 27 12:09:11 oleg352-client sshd[4677]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:11 oleg352-client systemd-logind: Removed session 3. Feb 27 12:09:11 oleg352-client sshd[4860]: Accepted publickey for root from 192.168.203.52 port 41630 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:11 oleg352-client systemd-logind: New session 4 of user root. Feb 27 12:09:11 oleg352-client systemd: Started Session 4 of user root. Feb 27 12:09:11 oleg352-client sshd[4860]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:11 oleg352-client sshd[4860]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:12 oleg352-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Feb 27 12:09:12 oleg352-client sshd[4860]: Received disconnect from 192.168.203.52 port 41630:11: disconnected by user Feb 27 12:09:12 oleg352-client sshd[4860]: Disconnected from 192.168.203.52 port 41630 Feb 27 12:09:12 oleg352-client sshd[4860]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:12 oleg352-client systemd-logind: Removed session 4. Feb 27 12:09:12 oleg352-client sshd[5006]: Accepted publickey for root from 192.168.203.52 port 41632 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:12 oleg352-client systemd-logind: New session 5 of user root. Feb 27 12:09:12 oleg352-client systemd: Started Session 5 of user root. Feb 27 12:09:12 oleg352-client sshd[5006]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:12 oleg352-client sshd[5006]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:12 oleg352-client sshd[5006]: Received disconnect from 192.168.203.52 port 41632:11: disconnected by user Feb 27 12:09:12 oleg352-client sshd[5006]: Disconnected from 192.168.203.52 port 41632 Feb 27 12:09:12 oleg352-client sshd[5006]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:12 oleg352-client systemd-logind: Removed session 5. Feb 27 12:09:23 oleg352-client sshd[5291]: Accepted publickey for root from 192.168.203.52 port 41642 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:23 oleg352-client systemd-logind: New session 6 of user root. Feb 27 12:09:23 oleg352-client systemd: Started Session 6 of user root. Feb 27 12:09:23 oleg352-client sshd[5291]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:23 oleg352-client sshd[5291]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:23 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing check_logdir /tmp/testlogs/ Feb 27 12:09:23 oleg352-client sshd[5291]: Received disconnect from 192.168.203.52 port 41642:11: disconnected by user Feb 27 12:09:23 oleg352-client sshd[5291]: Disconnected from 192.168.203.52 port 41642 Feb 27 12:09:23 oleg352-client sshd[5291]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:23 oleg352-client systemd-logind: Removed session 6. Feb 27 12:09:24 oleg352-client sshd[5544]: Accepted publickey for root from 192.168.203.52 port 41648 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:24 oleg352-client systemd-logind: New session 7 of user root. Feb 27 12:09:24 oleg352-client systemd: Started Session 7 of user root. Feb 27 12:09:24 oleg352-client sshd[5544]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:24 oleg352-client sshd[5544]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:24 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing yml_node Feb 27 12:09:24 oleg352-client sshd[5544]: Received disconnect from 192.168.203.52 port 41648:11: disconnected by user Feb 27 12:09:24 oleg352-client sshd[5544]: Disconnected from 192.168.203.52 port 41648 Feb 27 12:09:24 oleg352-client sshd[5544]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:24 oleg352-client systemd-logind: Removed session 7. Feb 27 12:09:25 oleg352-client sshd[6156]: Accepted publickey for root from 192.168.203.52 port 41654 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:25 oleg352-client systemd-logind: New session 8 of user root. Feb 27 12:09:25 oleg352-client systemd: Started Session 8 of user root. Feb 27 12:09:25 oleg352-client sshd[6156]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:25 oleg352-client sshd[6156]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:25 oleg352-client kernel: Lustre: DEBUG MARKER: Client: 2.15.61.76 Feb 27 12:09:25 oleg352-client sshd[6156]: Received disconnect from 192.168.203.52 port 41654:11: disconnected by user Feb 27 12:09:25 oleg352-client sshd[6156]: Disconnected from 192.168.203.52 port 41654 Feb 27 12:09:25 oleg352-client sshd[6156]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:25 oleg352-client systemd-logind: Removed session 8. Feb 27 12:09:25 oleg352-client sshd[6323]: Accepted publickey for root from 192.168.203.52 port 41658 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:25 oleg352-client systemd-logind: New session 9 of user root. Feb 27 12:09:25 oleg352-client systemd: Started Session 9 of user root. Feb 27 12:09:25 oleg352-client sshd[6323]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:25 oleg352-client sshd[6323]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:26 oleg352-client kernel: Lustre: DEBUG MARKER: MDS: 2.15.61.76 Feb 27 12:09:26 oleg352-client sshd[6323]: Received disconnect from 192.168.203.52 port 41658:11: disconnected by user Feb 27 12:09:26 oleg352-client sshd[6323]: Disconnected from 192.168.203.52 port 41658 Feb 27 12:09:26 oleg352-client sshd[6323]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:26 oleg352-client systemd-logind: Removed session 9. Feb 27 12:09:26 oleg352-client sshd[6491]: Accepted publickey for root from 192.168.203.52 port 41666 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:26 oleg352-client systemd-logind: New session 10 of user root. Feb 27 12:09:26 oleg352-client systemd: Started Session 10 of user root. Feb 27 12:09:26 oleg352-client sshd[6491]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:26 oleg352-client sshd[6491]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:26 oleg352-client kernel: Lustre: DEBUG MARKER: OSS: 2.15.61.76 Feb 27 12:09:26 oleg352-client sshd[6491]: Received disconnect from 192.168.203.52 port 41666:11: disconnected by user Feb 27 12:09:26 oleg352-client sshd[6491]: Disconnected from 192.168.203.52 port 41666 Feb 27 12:09:26 oleg352-client sshd[6491]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:26 oleg352-client systemd-logind: Removed session 10. Feb 27 12:09:26 oleg352-client sshd[6649]: Accepted publickey for root from 192.168.203.52 port 41670 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:26 oleg352-client systemd-logind: New session 11 of user root. Feb 27 12:09:26 oleg352-client systemd: Started Session 11 of user root. Feb 27 12:09:26 oleg352-client sshd[6649]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:26 oleg352-client sshd[6649]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:26 oleg352-client kernel: Lustre: DEBUG MARKER: -----============= acceptance-small: insanity ============----- Tue Feb 27 12:09:26 EST 2024 Feb 27 12:09:26 oleg352-client sshd[6649]: Received disconnect from 192.168.203.52 port 41670:11: disconnected by user Feb 27 12:09:26 oleg352-client sshd[6649]: Disconnected from 192.168.203.52 port 41670 Feb 27 12:09:26 oleg352-client sshd[6649]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:26 oleg352-client systemd-logind: Removed session 11. Feb 27 12:09:28 oleg352-client sshd[6961]: Accepted publickey for root from 192.168.203.52 port 41678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:28 oleg352-client systemd-logind: New session 12 of user root. Feb 27 12:09:28 oleg352-client systemd: Started Session 12 of user root. Feb 27 12:09:28 oleg352-client sshd[6961]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:28 oleg352-client sshd[6961]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:28 oleg352-client kernel: Lustre: DEBUG MARKER: excepting tests: Feb 27 12:09:28 oleg352-client sshd[6961]: Received disconnect from 192.168.203.52 port 41678:11: disconnected by user Feb 27 12:09:28 oleg352-client sshd[6961]: Disconnected from 192.168.203.52 port 41678 Feb 27 12:09:28 oleg352-client sshd[6961]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:28 oleg352-client systemd-logind: Removed session 12. Feb 27 12:09:28 oleg352-client sshd[7276]: Accepted publickey for root from 192.168.203.52 port 41682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:28 oleg352-client systemd-logind: New session 13 of user root. Feb 27 12:09:28 oleg352-client systemd: Started Session 13 of user root. Feb 27 12:09:28 oleg352-client sshd[7276]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:28 oleg352-client sshd[7276]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:28 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre Feb 27 12:09:28 oleg352-client sshd[7276]: Received disconnect from 192.168.203.52 port 41682:11: disconnected by user Feb 27 12:09:28 oleg352-client sshd[7276]: Disconnected from 192.168.203.52 port 41682 Feb 27 12:09:28 oleg352-client sshd[7276]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:28 oleg352-client systemd-logind: Removed session 13. Feb 27 12:09:33 oleg352-client sshd[7932]: Accepted publickey for root from 192.168.203.52 port 41714 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:33 oleg352-client systemd-logind: New session 14 of user root. Feb 27 12:09:33 oleg352-client systemd: Started Session 14 of user root. Feb 27 12:09:33 oleg352-client sshd[7932]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:33 oleg352-client sshd[7932]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:33 oleg352-client kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 Feb 27 12:09:33 oleg352-client sshd[7932]: Received disconnect from 192.168.203.52 port 41714:11: disconnected by user Feb 27 12:09:33 oleg352-client sshd[7932]: Disconnected from 192.168.203.52 port 41714 Feb 27 12:09:33 oleg352-client sshd[7932]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:33 oleg352-client systemd-logind: Removed session 14. Feb 27 12:09:33 oleg352-client sshd[8079]: Accepted publickey for root from 192.168.203.52 port 41718 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:33 oleg352-client systemd-logind: New session 15 of user root. Feb 27 12:09:33 oleg352-client systemd: Started Session 15 of user root. Feb 27 12:09:33 oleg352-client sshd[8079]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:33 oleg352-client sshd[8079]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:33 oleg352-client sshd[8079]: Received disconnect from 192.168.203.52 port 41718:11: disconnected by user Feb 27 12:09:33 oleg352-client sshd[8079]: Disconnected from 192.168.203.52 port 41718 Feb 27 12:09:33 oleg352-client sshd[8079]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:33 oleg352-client systemd-logind: Removed session 15. Feb 27 12:09:35 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: disconnect after 24s idle Feb 27 12:09:35 oleg352-client sshd[8454]: Accepted publickey for root from 192.168.203.52 port 41734 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:35 oleg352-client systemd-logind: New session 16 of user root. Feb 27 12:09:35 oleg352-client systemd: Started Session 16 of user root. Feb 27 12:09:35 oleg352-client sshd[8454]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:35 oleg352-client sshd[8454]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:35 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 0: Fail all nodes, independently ======== 12:09:35 (1709053775) Feb 27 12:09:35 oleg352-client sshd[8454]: Received disconnect from 192.168.203.52 port 41734:11: disconnected by user Feb 27 12:09:35 oleg352-client sshd[8454]: Disconnected from 192.168.203.52 port 41734 Feb 27 12:09:35 oleg352-client sshd[8454]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:35 oleg352-client systemd-logind: Removed session 16. Feb 27 12:09:50 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection to lustre-MDT0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:09:50 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:09:50 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6cf332 to 0xb0e2427ff6cf60a Feb 27 12:09:50 oleg352-client kernel: Lustre: MGC192.168.203.152@tcp: Connection restored to (at 192.168.203.152@tcp) Feb 27 12:09:50 oleg352-client sshd[8776]: Accepted publickey for root from 192.168.203.52 port 41760 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:50 oleg352-client systemd-logind: New session 17 of user root. Feb 27 12:09:50 oleg352-client systemd: Started Session 17 of user root. Feb 27 12:09:50 oleg352-client sshd[8776]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:50 oleg352-client sshd[8776]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:50 oleg352-client sshd[8776]: Received disconnect from 192.168.203.52 port 41760:11: disconnected by user Feb 27 12:09:50 oleg352-client sshd[8776]: Disconnected from 192.168.203.52 port 41760 Feb 27 12:09:50 oleg352-client sshd[8776]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:50 oleg352-client systemd-logind: Removed session 17. Feb 27 12:09:51 oleg352-client sshd[9011]: Accepted publickey for root from 192.168.203.52 port 41764 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:51 oleg352-client systemd-logind: New session 18 of user root. Feb 27 12:09:51 oleg352-client systemd: Started Session 18 of user root. Feb 27 12:09:51 oleg352-client sshd[9011]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:51 oleg352-client sshd[9011]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:51 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Feb 27 12:09:51 oleg352-client sshd[9011]: Received disconnect from 192.168.203.52 port 41764:11: disconnected by user Feb 27 12:09:51 oleg352-client sshd[9011]: Disconnected from 192.168.203.52 port 41764 Feb 27 12:09:51 oleg352-client sshd[9011]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:51 oleg352-client systemd-logind: Removed session 18. Feb 27 12:09:51 oleg352-client sshd[9179]: Accepted publickey for root from 192.168.203.52 port 41768 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:51 oleg352-client systemd-logind: New session 19 of user root. Feb 27 12:09:51 oleg352-client systemd: Started Session 19 of user root. Feb 27 12:09:51 oleg352-client sshd[9179]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:51 oleg352-client sshd[9179]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:51 oleg352-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Feb 27 12:09:51 oleg352-client sshd[9179]: Received disconnect from 192.168.203.52 port 41768:11: disconnected by user Feb 27 12:09:51 oleg352-client sshd[9179]: Disconnected from 192.168.203.52 port 41768 Feb 27 12:09:51 oleg352-client sshd[9179]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:51 oleg352-client systemd-logind: Removed session 19. Feb 27 12:09:52 oleg352-client sshd[9252]: Accepted publickey for root from 192.168.203.52 port 41770 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:09:52 oleg352-client systemd-logind: New session 20 of user root. Feb 27 12:09:52 oleg352-client systemd: Started Session 20 of user root. Feb 27 12:09:52 oleg352-client sshd[9252]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:09:52 oleg352-client sshd[9252]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:09:52 oleg352-client sshd[9252]: Received disconnect from 192.168.203.52 port 41770:11: disconnected by user Feb 27 12:09:52 oleg352-client sshd[9252]: Disconnected from 192.168.203.52 port 41770 Feb 27 12:09:52 oleg352-client sshd[9252]: pam_unix(sshd:session): session closed for user root Feb 27 12:09:52 oleg352-client systemd-logind: Removed session 20. Feb 27 12:09:55 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection to lustre-OST0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:09:56 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053780/real 1709053780] req@ffff8800ac3f7b80 x1792072708264256/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053796 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:10:01 oleg352-client kernel: Lustre: 1798:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053785/real 1709053785] req@ffff880136959180 x1792072708264384/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053801 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:10:06 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection restored to (at 192.168.203.152@tcp) Feb 27 12:10:06 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:10:07 oleg352-client sshd[9575]: Accepted publickey for root from 192.168.203.52 port 41798 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:07 oleg352-client systemd-logind: New session 21 of user root. Feb 27 12:10:07 oleg352-client systemd: Started Session 21 of user root. Feb 27 12:10:07 oleg352-client sshd[9575]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:07 oleg352-client sshd[9575]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:07 oleg352-client sshd[9575]: Received disconnect from 192.168.203.52 port 41798:11: disconnected by user Feb 27 12:10:07 oleg352-client sshd[9575]: Disconnected from 192.168.203.52 port 41798 Feb 27 12:10:07 oleg352-client sshd[9575]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:07 oleg352-client systemd-logind: Removed session 21. Feb 27 12:10:08 oleg352-client sshd[9811]: Accepted publickey for root from 192.168.203.52 port 41800 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:08 oleg352-client systemd-logind: New session 22 of user root. Feb 27 12:10:08 oleg352-client systemd: Started Session 22 of user root. Feb 27 12:10:08 oleg352-client sshd[9811]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:08 oleg352-client sshd[9811]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:08 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid Feb 27 12:10:08 oleg352-client sshd[9811]: Received disconnect from 192.168.203.52 port 41800:11: disconnected by user Feb 27 12:10:08 oleg352-client sshd[9811]: Disconnected from 192.168.203.52 port 41800 Feb 27 12:10:08 oleg352-client sshd[9811]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:08 oleg352-client systemd-logind: Removed session 22. Feb 27 12:10:08 oleg352-client sshd[9979]: Accepted publickey for root from 192.168.203.52 port 41804 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:08 oleg352-client systemd-logind: New session 23 of user root. Feb 27 12:10:08 oleg352-client systemd: Started Session 23 of user root. Feb 27 12:10:08 oleg352-client sshd[9979]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:08 oleg352-client sshd[9979]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:08 oleg352-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Feb 27 12:10:08 oleg352-client sshd[9979]: Received disconnect from 192.168.203.52 port 41804:11: disconnected by user Feb 27 12:10:08 oleg352-client sshd[9979]: Disconnected from 192.168.203.52 port 41804 Feb 27 12:10:08 oleg352-client sshd[9979]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:08 oleg352-client systemd-logind: Removed session 23. Feb 27 12:10:09 oleg352-client sshd[10048]: Accepted publickey for root from 192.168.203.52 port 41808 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:09 oleg352-client systemd-logind: New session 24 of user root. Feb 27 12:10:09 oleg352-client systemd: Started Session 24 of user root. Feb 27 12:10:09 oleg352-client sshd[10048]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:09 oleg352-client sshd[10048]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:09 oleg352-client sshd[10048]: Received disconnect from 192.168.203.52 port 41808:11: disconnected by user Feb 27 12:10:09 oleg352-client sshd[10048]: Disconnected from 192.168.203.52 port 41808 Feb 27 12:10:09 oleg352-client sshd[10048]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:09 oleg352-client systemd-logind: Removed session 24. Feb 27 12:10:15 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: Connection to lustre-OST0001 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:10:23 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:10:24 oleg352-client sshd[10397]: Accepted publickey for root from 192.168.203.52 port 41836 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:24 oleg352-client systemd-logind: New session 25 of user root. Feb 27 12:10:24 oleg352-client systemd: Started Session 25 of user root. Feb 27 12:10:24 oleg352-client sshd[10397]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:24 oleg352-client sshd[10397]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:24 oleg352-client sshd[10397]: Received disconnect from 192.168.203.52 port 41836:11: disconnected by user Feb 27 12:10:24 oleg352-client sshd[10397]: Disconnected from 192.168.203.52 port 41836 Feb 27 12:10:24 oleg352-client sshd[10397]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:24 oleg352-client systemd-logind: Removed session 25. Feb 27 12:10:25 oleg352-client sshd[10633]: Accepted publickey for root from 192.168.203.52 port 41838 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:25 oleg352-client systemd-logind: New session 26 of user root. Feb 27 12:10:25 oleg352-client systemd: Started Session 26 of user root. Feb 27 12:10:25 oleg352-client sshd[10633]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:25 oleg352-client sshd[10633]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:25 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid Feb 27 12:10:25 oleg352-client sshd[10633]: Received disconnect from 192.168.203.52 port 41838:11: disconnected by user Feb 27 12:10:25 oleg352-client sshd[10633]: Disconnected from 192.168.203.52 port 41838 Feb 27 12:10:25 oleg352-client sshd[10633]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:25 oleg352-client systemd-logind: Removed session 26. Feb 27 12:10:25 oleg352-client sshd[10801]: Accepted publickey for root from 192.168.203.52 port 41842 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:25 oleg352-client systemd-logind: New session 27 of user root. Feb 27 12:10:25 oleg352-client systemd: Started Session 27 of user root. Feb 27 12:10:25 oleg352-client sshd[10801]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:25 oleg352-client sshd[10801]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:25 oleg352-client kernel: Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec Feb 27 12:10:25 oleg352-client sshd[10801]: Received disconnect from 192.168.203.52 port 41842:11: disconnected by user Feb 27 12:10:25 oleg352-client sshd[10801]: Disconnected from 192.168.203.52 port 41842 Feb 27 12:10:25 oleg352-client sshd[10801]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:25 oleg352-client systemd-logind: Removed session 27. Feb 27 12:10:26 oleg352-client sshd[10870]: Accepted publickey for root from 192.168.203.52 port 41846 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:27 oleg352-client systemd-logind: New session 28 of user root. Feb 27 12:10:27 oleg352-client systemd: Started Session 28 of user root. Feb 27 12:10:27 oleg352-client sshd[10870]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:27 oleg352-client sshd[10870]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:27 oleg352-client sshd[10870]: Received disconnect from 192.168.203.52 port 41846:11: disconnected by user Feb 27 12:10:27 oleg352-client sshd[10870]: Disconnected from 192.168.203.52 port 41846 Feb 27 12:10:27 oleg352-client sshd[10870]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:27 oleg352-client systemd-logind: Removed session 28. Feb 27 12:10:27 oleg352-client sshd[11015]: Accepted publickey for root from 192.168.203.52 port 41848 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:27 oleg352-client systemd-logind: New session 29 of user root. Feb 27 12:10:27 oleg352-client systemd: Started Session 29 of user root. Feb 27 12:10:27 oleg352-client sshd[11015]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:27 oleg352-client sshd[11015]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:27 oleg352-client sshd[11015]: Received disconnect from 192.168.203.52 port 41848:11: disconnected by user Feb 27 12:10:27 oleg352-client sshd[11015]: Disconnected from 192.168.203.52 port 41848 Feb 27 12:10:27 oleg352-client sshd[11015]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:27 oleg352-client systemd-logind: Removed session 29. Feb 27 12:10:27 oleg352-client sshd[11166]: Accepted publickey for root from 192.168.203.52 port 41854 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:27 oleg352-client systemd-logind: New session 30 of user root. Feb 27 12:10:27 oleg352-client systemd: Started Session 30 of user root. Feb 27 12:10:27 oleg352-client sshd[11166]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:27 oleg352-client sshd[11166]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:27 oleg352-client sshd[11166]: Received disconnect from 192.168.203.52 port 41854:11: disconnected by user Feb 27 12:10:27 oleg352-client sshd[11166]: Disconnected from 192.168.203.52 port 41854 Feb 27 12:10:27 oleg352-client sshd[11166]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:27 oleg352-client systemd-logind: Removed session 30. Feb 27 12:10:27 oleg352-client sshd[11320]: Accepted publickey for root from 192.168.203.52 port 41858 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:28 oleg352-client systemd-logind: New session 31 of user root. Feb 27 12:10:28 oleg352-client systemd: Started Session 31 of user root. Feb 27 12:10:28 oleg352-client sshd[11320]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:28 oleg352-client sshd[11320]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:28 oleg352-client sshd[11320]: Received disconnect from 192.168.203.52 port 41858:11: disconnected by user Feb 27 12:10:28 oleg352-client sshd[11320]: Disconnected from 192.168.203.52 port 41858 Feb 27 12:10:28 oleg352-client sshd[11320]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:28 oleg352-client systemd-logind: Removed session 31. Feb 27 12:10:29 oleg352-client sshd[11597]: Accepted publickey for root from 192.168.203.52 port 41872 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:29 oleg352-client systemd-logind: New session 32 of user root. Feb 27 12:10:29 oleg352-client systemd: Started Session 32 of user root. Feb 27 12:10:29 oleg352-client sshd[11597]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:29 oleg352-client sshd[11597]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:29 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 1: MDS/MDS failure ====================== 12:10:29 (1709053829) Feb 27 12:10:29 oleg352-client sshd[11597]: Received disconnect from 192.168.203.52 port 41872:11: disconnected by user Feb 27 12:10:29 oleg352-client sshd[11597]: Disconnected from 192.168.203.52 port 41872 Feb 27 12:10:29 oleg352-client sshd[11597]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:29 oleg352-client systemd-logind: Removed session 32. Feb 27 12:10:30 oleg352-client sshd[11747]: Accepted publickey for root from 192.168.203.52 port 41876 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:30 oleg352-client systemd-logind: New session 33 of user root. Feb 27 12:10:30 oleg352-client systemd: Started Session 33 of user root. Feb 27 12:10:30 oleg352-client sshd[11747]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:30 oleg352-client sshd[11747]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:30 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_1 needs >= 2 MDTs Feb 27 12:10:30 oleg352-client sshd[11747]: Received disconnect from 192.168.203.52 port 41876:11: disconnected by user Feb 27 12:10:30 oleg352-client sshd[11747]: Disconnected from 192.168.203.52 port 41876 Feb 27 12:10:30 oleg352-client sshd[11747]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:30 oleg352-client systemd-logind: Removed session 33. Feb 27 12:10:32 oleg352-client sshd[12023]: Accepted publickey for root from 192.168.203.52 port 41894 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:32 oleg352-client systemd-logind: New session 34 of user root. Feb 27 12:10:32 oleg352-client systemd: Started Session 34 of user root. Feb 27 12:10:32 oleg352-client sshd[12023]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:32 oleg352-client sshd[12023]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:32 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 2: Second Failure Mode: MDS/OST Tue Feb 27 12:10:30 EST 2024 ========================================================== 12:10:31 (1709053831) Feb 27 12:10:32 oleg352-client sshd[12023]: Received disconnect from 192.168.203.52 port 41894:11: disconnected by user Feb 27 12:10:32 oleg352-client sshd[12023]: Disconnected from 192.168.203.52 port 41894 Feb 27 12:10:32 oleg352-client sshd[12023]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:32 oleg352-client systemd-logind: Removed session 34. Feb 27 12:10:33 oleg352-client sshd[12094]: Accepted publickey for root from 192.168.203.52 port 41896 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:33 oleg352-client systemd-logind: New session 35 of user root. Feb 27 12:10:33 oleg352-client systemd: Started Session 35 of user root. Feb 27 12:10:33 oleg352-client sshd[12094]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:33 oleg352-client sshd[12094]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:33 oleg352-client sshd[12094]: Received disconnect from 192.168.203.52 port 41896:11: disconnected by user Feb 27 12:10:33 oleg352-client sshd[12094]: Disconnected from 192.168.203.52 port 41896 Feb 27 12:10:33 oleg352-client sshd[12094]: pam_unix(sshd:session): session closed for user root Feb 27 12:10:33 oleg352-client systemd-logind: Removed session 35. Feb 27 12:10:50 oleg352-client kernel: random: crng init done Feb 27 12:10:51 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053835/real 1709053835] req@ffff8800ac3f5880 x1792072708269312/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053851 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:10:51 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:10:51 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) Skipped 1 previous similar message Feb 27 12:10:51 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection to lustre-MDT0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:10:55 oleg352-client sshd[12254]: Accepted publickey for root from 192.168.203.52 port 41906 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:10:55 oleg352-client systemd-logind: New session 36 of user root. Feb 27 12:10:55 oleg352-client systemd: Started Session 36 of user root. Feb 27 12:10:55 oleg352-client sshd[12254]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:10:55 oleg352-client sshd[12254]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:10:56 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053840/real 1709053840] req@ffff8800ac3f7480 x1792072708269568/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053856 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:10:56 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: disconnect after 23s idle Feb 27 12:10:56 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:11:01 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053845/real 1709053845] req@ffff8800ac3f7100 x1792072708269824/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053861 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:12:26 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6cf60a to 0xb0e2427ff6cf7c3 Feb 27 12:12:26 oleg352-client kernel: Lustre: MGC192.168.203.152@tcp: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:12:51 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:12:51 oleg352-client sshd[12254]: Received disconnect from 192.168.203.52 port 41906:11: disconnected by user Feb 27 12:12:51 oleg352-client sshd[12254]: Disconnected from 192.168.203.52 port 41906 Feb 27 12:12:51 oleg352-client sshd[12254]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:51 oleg352-client systemd-logind: Removed session 36. Feb 27 12:12:52 oleg352-client sshd[12872]: Accepted publickey for root from 192.168.203.52 port 41956 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:12:52 oleg352-client systemd-logind: New session 37 of user root. Feb 27 12:12:52 oleg352-client systemd: Started Session 37 of user root. Feb 27 12:12:52 oleg352-client sshd[12872]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:12:52 oleg352-client sshd[12872]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:12:52 oleg352-client sshd[12872]: Received disconnect from 192.168.203.52 port 41956:11: disconnected by user Feb 27 12:12:52 oleg352-client sshd[12872]: Disconnected from 192.168.203.52 port 41956 Feb 27 12:12:52 oleg352-client sshd[12872]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:52 oleg352-client systemd-logind: Removed session 37. Feb 27 12:12:52 oleg352-client sshd[13017]: Accepted publickey for root from 192.168.203.52 port 41960 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:12:52 oleg352-client systemd-logind: New session 38 of user root. Feb 27 12:12:52 oleg352-client systemd: Started Session 38 of user root. Feb 27 12:12:52 oleg352-client sshd[13017]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:12:52 oleg352-client sshd[13017]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:12:52 oleg352-client sshd[13017]: Received disconnect from 192.168.203.52 port 41960:11: disconnected by user Feb 27 12:12:52 oleg352-client sshd[13017]: Disconnected from 192.168.203.52 port 41960 Feb 27 12:12:52 oleg352-client sshd[13017]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:53 oleg352-client systemd-logind: Removed session 38. Feb 27 12:12:53 oleg352-client sshd[13168]: Accepted publickey for root from 192.168.203.52 port 41962 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:12:53 oleg352-client systemd-logind: New session 39 of user root. Feb 27 12:12:53 oleg352-client systemd: Started Session 39 of user root. Feb 27 12:12:53 oleg352-client sshd[13168]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:12:53 oleg352-client sshd[13168]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:12:53 oleg352-client sshd[13168]: Received disconnect from 192.168.203.52 port 41962:11: disconnected by user Feb 27 12:12:53 oleg352-client sshd[13168]: Disconnected from 192.168.203.52 port 41962 Feb 27 12:12:53 oleg352-client sshd[13168]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:53 oleg352-client systemd-logind: Removed session 39. Feb 27 12:12:53 oleg352-client sshd[13322]: Accepted publickey for root from 192.168.203.52 port 41966 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:12:53 oleg352-client systemd-logind: New session 40 of user root. Feb 27 12:12:53 oleg352-client systemd: Started Session 40 of user root. Feb 27 12:12:53 oleg352-client sshd[13322]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:12:53 oleg352-client sshd[13322]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:12:53 oleg352-client sshd[13322]: Received disconnect from 192.168.203.52 port 41966:11: disconnected by user Feb 27 12:12:53 oleg352-client sshd[13322]: Disconnected from 192.168.203.52 port 41966 Feb 27 12:12:53 oleg352-client sshd[13322]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:53 oleg352-client systemd-logind: Removed session 40. Feb 27 12:12:55 oleg352-client sshd[13599]: Accepted publickey for root from 192.168.203.52 port 41980 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:12:55 oleg352-client systemd-logind: New session 41 of user root. Feb 27 12:12:55 oleg352-client systemd: Started Session 41 of user root. Feb 27 12:12:55 oleg352-client sshd[13599]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:12:55 oleg352-client sshd[13599]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:12:55 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 3: Third Failure Mode: MDS/CLIENT Tue Feb 27 12:12:54 EST 2024 ========================================================== 12:12:55 (1709053975) Feb 27 12:12:55 oleg352-client sshd[13599]: Received disconnect from 192.168.203.52 port 41980:11: disconnected by user Feb 27 12:12:55 oleg352-client sshd[13599]: Disconnected from 192.168.203.52 port 41980 Feb 27 12:12:55 oleg352-client sshd[13599]: pam_unix(sshd:session): session closed for user root Feb 27 12:12:55 oleg352-client systemd-logind: Removed session 41. Feb 27 12:13:10 oleg352-client sshd[13920]: Accepted publickey for root from 192.168.203.52 port 42006 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:10 oleg352-client systemd: Started Session 42 of user root. Feb 27 12:13:10 oleg352-client systemd-logind: New session 42 of user root. Feb 27 12:13:10 oleg352-client sshd[13920]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:10 oleg352-client sshd[13920]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:11 oleg352-client kernel: LustreError: 11-0: lustre-MDT0000-mdc-ffff8800b6d21800: operation mds_statfs to node 192.168.203.152@tcp failed: rc = -107 Feb 27 12:13:11 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection to lustre-MDT0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:13:11 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:13:11 oleg352-client sshd[13920]: Received disconnect from 192.168.203.52 port 42006:11: disconnected by user Feb 27 12:13:11 oleg352-client sshd[13920]: Disconnected from 192.168.203.52 port 42006 Feb 27 12:13:11 oleg352-client sshd[13920]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:11 oleg352-client systemd-logind: Removed session 42. Feb 27 12:13:11 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:13:11 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6cf7c3 to 0xb0e2427ff6cfb12 Feb 27 12:13:11 oleg352-client sshd[14159]: Accepted publickey for root from 192.168.203.52 port 42008 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:11 oleg352-client systemd-logind: New session 43 of user root. Feb 27 12:13:11 oleg352-client systemd: Started Session 43 of user root. Feb 27 12:13:11 oleg352-client sshd[14159]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:11 oleg352-client sshd[14159]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:11 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Feb 27 12:13:11 oleg352-client sshd[14159]: Received disconnect from 192.168.203.52 port 42008:11: disconnected by user Feb 27 12:13:11 oleg352-client sshd[14159]: Disconnected from 192.168.203.52 port 42008 Feb 27 12:13:11 oleg352-client sshd[14159]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:11 oleg352-client systemd-logind: Removed session 43. Feb 27 12:13:11 oleg352-client sshd[14327]: Accepted publickey for root from 192.168.203.52 port 42012 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:11 oleg352-client systemd-logind: New session 44 of user root. Feb 27 12:13:11 oleg352-client systemd: Started Session 44 of user root. Feb 27 12:13:11 oleg352-client sshd[14327]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:11 oleg352-client sshd[14327]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:12 oleg352-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Feb 27 12:13:12 oleg352-client sshd[14327]: Received disconnect from 192.168.203.52 port 42012:11: disconnected by user Feb 27 12:13:12 oleg352-client sshd[14327]: Disconnected from 192.168.203.52 port 42012 Feb 27 12:13:12 oleg352-client sshd[14327]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:12 oleg352-client systemd-logind: Removed session 44. Feb 27 12:13:12 oleg352-client kernel: Lustre: 1797:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709053976/real 1709053976] req@ffff88013695bb80 x1792072708273280/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709053992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:13:12 oleg352-client kernel: Lustre: 1797:0:(client.c:2338:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Feb 27 12:13:13 oleg352-client sshd[14401]: Accepted publickey for root from 192.168.203.52 port 42016 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:13 oleg352-client systemd-logind: New session 45 of user root. Feb 27 12:13:13 oleg352-client systemd: Started Session 45 of user root. Feb 27 12:13:13 oleg352-client sshd[14401]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:13 oleg352-client sshd[14401]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:13 oleg352-client sshd[14401]: Received disconnect from 192.168.203.52 port 42016:11: disconnected by user Feb 27 12:13:13 oleg352-client sshd[14401]: Disconnected from 192.168.203.52 port 42016 Feb 27 12:13:13 oleg352-client sshd[14401]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:13 oleg352-client systemd-logind: Removed session 45. Feb 27 12:13:14 oleg352-client sshd[14468]: Accepted publickey for root from 192.168.203.52 port 42018 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:14 oleg352-client systemd-logind: New session 46 of user root. Feb 27 12:13:14 oleg352-client systemd: Started Session 46 of user root. Feb 27 12:13:14 oleg352-client sshd[14468]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:14 oleg352-client sshd[14468]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:14 oleg352-client sshd[14468]: Received disconnect from 192.168.203.52 port 42018:11: disconnected by user Feb 27 12:13:14 oleg352-client sshd[14468]: Disconnected from 192.168.203.52 port 42018 Feb 27 12:13:14 oleg352-client sshd[14468]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:14 oleg352-client systemd-logind: Removed session 46. Feb 27 12:13:14 oleg352-client sshd[14616]: Accepted publickey for root from 192.168.203.52 port 42022 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:14 oleg352-client systemd-logind: New session 47 of user root. Feb 27 12:13:14 oleg352-client systemd: Started Session 47 of user root. Feb 27 12:13:14 oleg352-client sshd[14616]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:14 oleg352-client sshd[14616]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:14 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: 2, to fail: 0, failed: 0 Feb 27 12:13:14 oleg352-client sshd[14616]: Received disconnect from 192.168.203.52 port 42022:11: disconnected by user Feb 27 12:13:14 oleg352-client sshd[14616]: Disconnected from 192.168.203.52 port 42022 Feb 27 12:13:14 oleg352-client sshd[14616]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:14 oleg352-client systemd-logind: Removed session 47. Feb 27 12:13:15 oleg352-client sshd[14767]: Accepted publickey for root from 192.168.203.52 port 42026 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:15 oleg352-client systemd-logind: New session 48 of user root. Feb 27 12:13:15 oleg352-client systemd: Started Session 48 of user root. Feb 27 12:13:15 oleg352-client sshd[14767]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:15 oleg352-client sshd[14767]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:15 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:13:15 oleg352-client sshd[14767]: Received disconnect from 192.168.203.52 port 42026:11: disconnected by user Feb 27 12:13:15 oleg352-client sshd[14767]: Disconnected from 192.168.203.52 port 42026 Feb 27 12:13:15 oleg352-client sshd[14767]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:15 oleg352-client systemd-logind: Removed session 48. Feb 27 12:13:16 oleg352-client sshd[14837]: Accepted publickey for root from 192.168.203.52 port 42028 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:16 oleg352-client systemd-logind: New session 49 of user root. Feb 27 12:13:16 oleg352-client systemd: Started Session 49 of user root. Feb 27 12:13:16 oleg352-client sshd[14837]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:16 oleg352-client sshd[14837]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:16 oleg352-client sshd[14837]: Received disconnect from 192.168.203.52 port 42028:11: disconnected by user Feb 27 12:13:16 oleg352-client sshd[14837]: Disconnected from 192.168.203.52 port 42028 Feb 27 12:13:16 oleg352-client sshd[14837]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:16 oleg352-client systemd-logind: Removed session 49. Feb 27 12:13:17 oleg352-client sshd[14904]: Accepted publickey for root from 192.168.203.52 port 42030 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:17 oleg352-client systemd-logind: New session 50 of user root. Feb 27 12:13:17 oleg352-client systemd: Started Session 50 of user root. Feb 27 12:13:17 oleg352-client sshd[14904]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:17 oleg352-client sshd[14904]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:17 oleg352-client sshd[14904]: Received disconnect from 192.168.203.52 port 42030:11: disconnected by user Feb 27 12:13:17 oleg352-client sshd[14904]: Disconnected from 192.168.203.52 port 42030 Feb 27 12:13:17 oleg352-client sshd[14904]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:17 oleg352-client systemd-logind: Removed session 50. Feb 27 12:13:19 oleg352-client sshd[15051]: Accepted publickey for root from 192.168.203.52 port 42032 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:19 oleg352-client systemd-logind: New session 51 of user root. Feb 27 12:13:19 oleg352-client systemd: Started Session 51 of user root. Feb 27 12:13:19 oleg352-client sshd[15051]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:19 oleg352-client sshd[15051]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:20 oleg352-client sshd[15051]: Received disconnect from 192.168.203.52 port 42032:11: disconnected by user Feb 27 12:13:20 oleg352-client sshd[15051]: Disconnected from 192.168.203.52 port 42032 Feb 27 12:13:20 oleg352-client sshd[15051]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:20 oleg352-client systemd-logind: Removed session 51. Feb 27 12:13:20 oleg352-client sshd[15202]: Accepted publickey for root from 192.168.203.52 port 42036 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:20 oleg352-client systemd-logind: New session 52 of user root. Feb 27 12:13:20 oleg352-client systemd: Started Session 52 of user root. Feb 27 12:13:20 oleg352-client sshd[15202]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:20 oleg352-client sshd[15202]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:20 oleg352-client sshd[15202]: Received disconnect from 192.168.203.52 port 42036:11: disconnected by user Feb 27 12:13:20 oleg352-client sshd[15202]: Disconnected from 192.168.203.52 port 42036 Feb 27 12:13:20 oleg352-client sshd[15202]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:20 oleg352-client systemd-logind: Removed session 52. Feb 27 12:13:21 oleg352-client sshd[15357]: Accepted publickey for root from 192.168.203.52 port 42040 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:21 oleg352-client systemd-logind: New session 53 of user root. Feb 27 12:13:21 oleg352-client systemd: Started Session 53 of user root. Feb 27 12:13:21 oleg352-client sshd[15357]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:21 oleg352-client sshd[15357]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:21 oleg352-client sshd[15357]: Received disconnect from 192.168.203.52 port 42040:11: disconnected by user Feb 27 12:13:21 oleg352-client sshd[15357]: Disconnected from 192.168.203.52 port 42040 Feb 27 12:13:21 oleg352-client sshd[15357]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:21 oleg352-client systemd-logind: Removed session 53. Feb 27 12:13:23 oleg352-client sshd[15634]: Accepted publickey for root from 192.168.203.52 port 42056 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:23 oleg352-client systemd-logind: New session 54 of user root. Feb 27 12:13:23 oleg352-client systemd: Started Session 54 of user root. Feb 27 12:13:23 oleg352-client sshd[15634]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:23 oleg352-client sshd[15634]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:24 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 4: Fourth Failure Mode: OST/MDS Tue Feb 27 12:13:22 EST 2024 ========================================================== 12:13:23 (1709054003) Feb 27 12:13:24 oleg352-client sshd[15634]: Received disconnect from 192.168.203.52 port 42056:11: disconnected by user Feb 27 12:13:24 oleg352-client sshd[15634]: Disconnected from 192.168.203.52 port 42056 Feb 27 12:13:24 oleg352-client sshd[15634]: pam_unix(sshd:session): session closed for user root Feb 27 12:13:24 oleg352-client systemd-logind: Removed session 54. Feb 27 12:13:26 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection to lustre-OST0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:13:26 oleg352-client sshd[15754]: Accepted publickey for root from 192.168.203.52 port 42068 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:26 oleg352-client systemd-logind: New session 55 of user root. Feb 27 12:13:26 oleg352-client systemd: Started Session 55 of user root. Feb 27 12:13:26 oleg352-client sshd[15754]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:26 oleg352-client sshd[15754]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:13:36 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: disconnect after 20s idle Feb 27 12:13:36 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:13:47 oleg352-client kernel: Lustre: 1800:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709054011/real 1709054011] req@ffff8800ac3f6300 x1792072708276800/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709054027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:13:47 oleg352-client kernel: Lustre: 1800:0:(client.c:2338:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Feb 27 12:13:47 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection to lustre-MDT0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:13:47 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:13:53 oleg352-client sshd[15898]: Accepted publickey for root from 192.168.203.52 port 42078 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:13:53 oleg352-client systemd: Started Session 56 of user root. Feb 27 12:13:53 oleg352-client systemd-logind: New session 56 of user root. Feb 27 12:13:53 oleg352-client sshd[15898]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:13:53 oleg352-client sshd[15898]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:22 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6cfb12 to 0xb0e2427ff6cfbc1 Feb 27 12:15:22 oleg352-client kernel: Lustre: MGC192.168.203.152@tcp: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:15:22 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:15:29 oleg352-client sshd[15754]: Received disconnect from 192.168.203.52 port 42068:11: disconnected by user Feb 27 12:15:29 oleg352-client sshd[15754]: Disconnected from 192.168.203.52 port 42068 Feb 27 12:15:29 oleg352-client sshd[15754]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:30 oleg352-client systemd-logind: Removed session 55. Feb 27 12:15:48 oleg352-client sshd[15898]: Received disconnect from 192.168.203.52 port 42078:11: disconnected by user Feb 27 12:15:48 oleg352-client sshd[15898]: Disconnected from 192.168.203.52 port 42078 Feb 27 12:15:48 oleg352-client sshd[15898]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:48 oleg352-client systemd-logind: Removed session 56. Feb 27 12:15:49 oleg352-client sshd[16490]: Accepted publickey for root from 192.168.203.52 port 42120 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:49 oleg352-client systemd-logind: New session 57 of user root. Feb 27 12:15:49 oleg352-client systemd: Started Session 57 of user root. Feb 27 12:15:49 oleg352-client sshd[16490]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:49 oleg352-client sshd[16490]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:49 oleg352-client sshd[16490]: Received disconnect from 192.168.203.52 port 42120:11: disconnected by user Feb 27 12:15:49 oleg352-client sshd[16490]: Disconnected from 192.168.203.52 port 42120 Feb 27 12:15:49 oleg352-client sshd[16490]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:49 oleg352-client systemd-logind: Removed session 57. Feb 27 12:15:49 oleg352-client sshd[16634]: Accepted publickey for root from 192.168.203.52 port 42122 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:49 oleg352-client systemd-logind: New session 58 of user root. Feb 27 12:15:49 oleg352-client systemd: Started Session 58 of user root. Feb 27 12:15:49 oleg352-client sshd[16634]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:49 oleg352-client sshd[16634]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:50 oleg352-client sshd[16634]: Received disconnect from 192.168.203.52 port 42122:11: disconnected by user Feb 27 12:15:50 oleg352-client sshd[16634]: Disconnected from 192.168.203.52 port 42122 Feb 27 12:15:50 oleg352-client sshd[16634]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:50 oleg352-client systemd-logind: Removed session 58. Feb 27 12:15:50 oleg352-client sshd[16786]: Accepted publickey for root from 192.168.203.52 port 42126 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:50 oleg352-client systemd-logind: New session 59 of user root. Feb 27 12:15:50 oleg352-client systemd: Started Session 59 of user root. Feb 27 12:15:50 oleg352-client sshd[16786]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:50 oleg352-client sshd[16786]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:50 oleg352-client sshd[16786]: Received disconnect from 192.168.203.52 port 42126:11: disconnected by user Feb 27 12:15:50 oleg352-client sshd[16786]: Disconnected from 192.168.203.52 port 42126 Feb 27 12:15:50 oleg352-client sshd[16786]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:50 oleg352-client systemd-logind: Removed session 59. Feb 27 12:15:51 oleg352-client sshd[16940]: Accepted publickey for root from 192.168.203.52 port 42132 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:51 oleg352-client systemd-logind: New session 60 of user root. Feb 27 12:15:51 oleg352-client systemd: Started Session 60 of user root. Feb 27 12:15:51 oleg352-client sshd[16940]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:51 oleg352-client sshd[16940]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:51 oleg352-client sshd[16940]: Received disconnect from 192.168.203.52 port 42132:11: disconnected by user Feb 27 12:15:51 oleg352-client sshd[16940]: Disconnected from 192.168.203.52 port 42132 Feb 27 12:15:51 oleg352-client sshd[16940]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:51 oleg352-client systemd-logind: Removed session 60. Feb 27 12:15:54 oleg352-client sshd[17219]: Accepted publickey for root from 192.168.203.52 port 42148 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:54 oleg352-client systemd: Started Session 61 of user root. Feb 27 12:15:54 oleg352-client systemd-logind: New session 61 of user root. Feb 27 12:15:54 oleg352-client sshd[17219]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:54 oleg352-client sshd[17219]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:55 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 5: Fifth Failure Mode: OST/OST Tue Feb 27 12:15:52 EST 2024 ========================================================== 12:15:54 (1709054154) Feb 27 12:15:55 oleg352-client sshd[17219]: Received disconnect from 192.168.203.52 port 42148:11: disconnected by user Feb 27 12:15:55 oleg352-client sshd[17219]: Disconnected from 192.168.203.52 port 42148 Feb 27 12:15:55 oleg352-client sshd[17219]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:55 oleg352-client systemd-logind: Removed session 61. Feb 27 12:15:56 oleg352-client sshd[17291]: Accepted publickey for root from 192.168.203.52 port 42150 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:15:56 oleg352-client systemd-logind: New session 62 of user root. Feb 27 12:15:56 oleg352-client systemd: Started Session 62 of user root. Feb 27 12:15:56 oleg352-client sshd[17291]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:15:56 oleg352-client sshd[17291]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:15:56 oleg352-client sshd[17291]: Received disconnect from 192.168.203.52 port 42150:11: disconnected by user Feb 27 12:15:56 oleg352-client sshd[17291]: Disconnected from 192.168.203.52 port 42150 Feb 27 12:15:56 oleg352-client sshd[17291]: pam_unix(sshd:session): session closed for user root Feb 27 12:15:56 oleg352-client systemd-logind: Removed session 62. Feb 27 12:15:57 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection to lustre-OST0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:16:09 oleg352-client sshd[17420]: Accepted publickey for root from 192.168.203.52 port 42160 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:16:09 oleg352-client systemd-logind: New session 63 of user root. Feb 27 12:16:09 oleg352-client systemd: Started Session 63 of user root. Feb 27 12:16:09 oleg352-client sshd[17420]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:16:09 oleg352-client sshd[17420]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:16:18 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: disconnect after 22s idle Feb 27 12:16:26 oleg352-client sshd[17539]: Accepted publickey for root from 192.168.203.52 port 42170 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:16:26 oleg352-client systemd: Started Session 64 of user root. Feb 27 12:16:26 oleg352-client systemd-logind: New session 64 of user root. Feb 27 12:16:27 oleg352-client sshd[17539]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:16:27 oleg352-client sshd[17539]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:16:28 oleg352-client kernel: Lustre: 1796:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709054178/real 1709054178] req@ffff8800ac3f5c00 x1792072708283840/t0(0) o9->lustre-OST0001-osc-ffff8800b6d21800@192.168.203.152@tcp:28/4 lens 224/224 e 0 to 1 dl 1709054188 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:16:28 oleg352-client kernel: Lustre: 1796:0:(client.c:2338:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Feb 27 12:16:43 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:16:43 oleg352-client kernel: Lustre: Skipped 2 previous similar messages Feb 27 12:16:43 oleg352-client sshd[17420]: Received disconnect from 192.168.203.52 port 42160:11: disconnected by user Feb 27 12:16:43 oleg352-client sshd[17420]: Disconnected from 192.168.203.52 port 42160 Feb 27 12:16:43 oleg352-client sshd[17539]: Received disconnect from 192.168.203.52 port 42170:11: disconnected by user Feb 27 12:16:43 oleg352-client sshd[17539]: Disconnected from 192.168.203.52 port 42170 Feb 27 12:16:43 oleg352-client sshd[17420]: pam_unix(sshd:session): session closed for user root Feb 27 12:16:43 oleg352-client sshd[17539]: pam_unix(sshd:session): session closed for user root Feb 27 12:16:43 oleg352-client systemd-logind: Removed session 64. Feb 27 12:16:43 oleg352-client systemd-logind: Removed session 63. Feb 27 12:17:02 oleg352-client sshd[18104]: Accepted publickey for root from 192.168.203.52 port 42216 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:02 oleg352-client systemd-logind: New session 65 of user root. Feb 27 12:17:02 oleg352-client systemd: Started Session 65 of user root. Feb 27 12:17:02 oleg352-client sshd[18104]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:02 oleg352-client sshd[18104]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:02 oleg352-client sshd[18104]: Received disconnect from 192.168.203.52 port 42216:11: disconnected by user Feb 27 12:17:02 oleg352-client sshd[18104]: Disconnected from 192.168.203.52 port 42216 Feb 27 12:17:02 oleg352-client sshd[18104]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:02 oleg352-client systemd-logind: Removed session 65. Feb 27 12:17:02 oleg352-client sshd[18250]: Accepted publickey for root from 192.168.203.52 port 42220 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:02 oleg352-client systemd: Started Session 66 of user root. Feb 27 12:17:02 oleg352-client systemd-logind: New session 66 of user root. Feb 27 12:17:02 oleg352-client sshd[18250]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:03 oleg352-client sshd[18250]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:03 oleg352-client sshd[18250]: Received disconnect from 192.168.203.52 port 42220:11: disconnected by user Feb 27 12:17:03 oleg352-client sshd[18250]: Disconnected from 192.168.203.52 port 42220 Feb 27 12:17:03 oleg352-client sshd[18250]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:03 oleg352-client systemd-logind: Removed session 66. Feb 27 12:17:03 oleg352-client sshd[18401]: Accepted publickey for root from 192.168.203.52 port 42222 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:03 oleg352-client systemd-logind: New session 67 of user root. Feb 27 12:17:03 oleg352-client systemd: Started Session 67 of user root. Feb 27 12:17:03 oleg352-client sshd[18401]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:03 oleg352-client sshd[18401]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:03 oleg352-client sshd[18401]: Received disconnect from 192.168.203.52 port 42222:11: disconnected by user Feb 27 12:17:03 oleg352-client sshd[18401]: Disconnected from 192.168.203.52 port 42222 Feb 27 12:17:03 oleg352-client sshd[18401]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:03 oleg352-client systemd-logind: Removed session 67. Feb 27 12:17:03 oleg352-client sshd[18556]: Accepted publickey for root from 192.168.203.52 port 42228 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:04 oleg352-client systemd-logind: New session 68 of user root. Feb 27 12:17:04 oleg352-client systemd: Started Session 68 of user root. Feb 27 12:17:04 oleg352-client sshd[18556]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:04 oleg352-client sshd[18556]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:04 oleg352-client sshd[18556]: Received disconnect from 192.168.203.52 port 42228:11: disconnected by user Feb 27 12:17:04 oleg352-client sshd[18556]: Disconnected from 192.168.203.52 port 42228 Feb 27 12:17:04 oleg352-client sshd[18556]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:04 oleg352-client systemd-logind: Removed session 68. Feb 27 12:17:07 oleg352-client sshd[18833]: Accepted publickey for root from 192.168.203.52 port 42244 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:07 oleg352-client systemd: Started Session 69 of user root. Feb 27 12:17:07 oleg352-client sshd[18833]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:07 oleg352-client systemd-logind: New session 69 of user root. Feb 27 12:17:07 oleg352-client sshd[18833]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:07 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 6: Sixth Failure Mode: OST/CLIENT Tue Feb 27 12:17:04 EST 2024 ========================================================== 12:17:06 (1709054226) Feb 27 12:17:07 oleg352-client sshd[18833]: Received disconnect from 192.168.203.52 port 42244:11: disconnected by user Feb 27 12:17:07 oleg352-client sshd[18833]: Disconnected from 192.168.203.52 port 42244 Feb 27 12:17:07 oleg352-client sshd[18833]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:07 oleg352-client systemd-logind: Removed session 69. Feb 27 12:17:08 oleg352-client sshd[18906]: Accepted publickey for root from 192.168.203.52 port 42246 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:08 oleg352-client systemd: Started Session 70 of user root. Feb 27 12:17:08 oleg352-client systemd-logind: New session 70 of user root. Feb 27 12:17:08 oleg352-client sshd[18906]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:08 oleg352-client sshd[18906]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:08 oleg352-client sshd[18906]: Received disconnect from 192.168.203.52 port 42246:11: disconnected by user Feb 27 12:17:08 oleg352-client sshd[18906]: Disconnected from 192.168.203.52 port 42246 Feb 27 12:17:08 oleg352-client sshd[18906]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:08 oleg352-client systemd-logind: Removed session 70. Feb 27 12:17:09 oleg352-client sshd[18964]: Accepted publickey for root from 192.168.203.52 port 42248 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:09 oleg352-client systemd-logind: New session 71 of user root. Feb 27 12:17:09 oleg352-client systemd: Started Session 71 of user root. Feb 27 12:17:09 oleg352-client sshd[18964]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:09 oleg352-client sshd[18964]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:09 oleg352-client sshd[18964]: Received disconnect from 192.168.203.52 port 42248:11: disconnected by user Feb 27 12:17:09 oleg352-client sshd[18964]: Disconnected from 192.168.203.52 port 42248 Feb 27 12:17:09 oleg352-client sshd[18964]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:09 oleg352-client systemd-logind: Removed session 71. Feb 27 12:17:13 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection to lustre-OST0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:17:23 oleg352-client sshd[19102]: Accepted publickey for root from 192.168.203.52 port 42258 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:23 oleg352-client systemd: Started Session 72 of user root. Feb 27 12:17:23 oleg352-client systemd-logind: New session 72 of user root. Feb 27 12:17:23 oleg352-client sshd[19102]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:23 oleg352-client sshd[19102]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:27 oleg352-client sshd[19234]: Accepted publickey for root from 192.168.203.52 port 42262 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:27 oleg352-client systemd-logind: New session 73 of user root. Feb 27 12:17:27 oleg352-client systemd: Started Session 73 of user root. Feb 27 12:17:27 oleg352-client sshd[19234]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:27 oleg352-client sshd[19234]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:27 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: , to fail: 0, failed: 0 Feb 27 12:17:27 oleg352-client sshd[19234]: Received disconnect from 192.168.203.52 port 42262:11: disconnected by user Feb 27 12:17:27 oleg352-client sshd[19234]: Disconnected from 192.168.203.52 port 42262 Feb 27 12:17:27 oleg352-client sshd[19234]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:27 oleg352-client systemd-logind: Removed session 73. Feb 27 12:17:28 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: disconnect after 20s idle Feb 27 12:17:28 oleg352-client sshd[19385]: Accepted publickey for root from 192.168.203.52 port 42264 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:28 oleg352-client systemd-logind: New session 74 of user root. Feb 27 12:17:28 oleg352-client systemd: Started Session 74 of user root. Feb 27 12:17:28 oleg352-client sshd[19385]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:28 oleg352-client sshd[19385]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:28 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:17:28 oleg352-client sshd[19385]: Received disconnect from 192.168.203.52 port 42264:11: disconnected by user Feb 27 12:17:28 oleg352-client sshd[19385]: Disconnected from 192.168.203.52 port 42264 Feb 27 12:17:28 oleg352-client sshd[19385]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:28 oleg352-client systemd-logind: Removed session 74. Feb 27 12:17:29 oleg352-client sshd[19456]: Accepted publickey for root from 192.168.203.52 port 42268 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:29 oleg352-client systemd-logind: New session 75 of user root. Feb 27 12:17:29 oleg352-client systemd: Started Session 75 of user root. Feb 27 12:17:29 oleg352-client sshd[19456]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:29 oleg352-client sshd[19456]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:38 oleg352-client sshd[19102]: Received disconnect from 192.168.203.52 port 42258:11: disconnected by user Feb 27 12:17:38 oleg352-client sshd[19102]: Disconnected from 192.168.203.52 port 42258 Feb 27 12:17:38 oleg352-client sshd[19456]: Received disconnect from 192.168.203.52 port 42268:11: disconnected by user Feb 27 12:17:38 oleg352-client sshd[19456]: Disconnected from 192.168.203.52 port 42268 Feb 27 12:17:38 oleg352-client sshd[19102]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:38 oleg352-client sshd[19456]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:38 oleg352-client systemd-logind: Removed session 72. Feb 27 12:17:38 oleg352-client systemd-logind: Removed session 75. Feb 27 12:17:47 oleg352-client sshd[19776]: Accepted publickey for root from 192.168.203.52 port 42292 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:47 oleg352-client systemd-logind: New session 76 of user root. Feb 27 12:17:47 oleg352-client systemd: Started Session 76 of user root. Feb 27 12:17:47 oleg352-client sshd[19776]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:47 oleg352-client sshd[19776]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:47 oleg352-client sshd[19776]: Received disconnect from 192.168.203.52 port 42292:11: disconnected by user Feb 27 12:17:47 oleg352-client sshd[19776]: Disconnected from 192.168.203.52 port 42292 Feb 27 12:17:47 oleg352-client sshd[19776]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:47 oleg352-client systemd-logind: Removed session 76. Feb 27 12:17:48 oleg352-client sshd[19921]: Accepted publickey for root from 192.168.203.52 port 42294 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:48 oleg352-client sshd[19921]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:48 oleg352-client systemd: Started Session 77 of user root. Feb 27 12:17:48 oleg352-client sshd[19921]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:48 oleg352-client systemd-logind: New session 77 of user root. Feb 27 12:17:48 oleg352-client sshd[19921]: Received disconnect from 192.168.203.52 port 42294:11: disconnected by user Feb 27 12:17:48 oleg352-client sshd[19921]: Disconnected from 192.168.203.52 port 42294 Feb 27 12:17:48 oleg352-client sshd[19921]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:48 oleg352-client systemd-logind: Removed session 77. Feb 27 12:17:48 oleg352-client sshd[20072]: Accepted publickey for root from 192.168.203.52 port 42298 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:48 oleg352-client systemd-logind: New session 78 of user root. Feb 27 12:17:48 oleg352-client systemd: Started Session 78 of user root. Feb 27 12:17:48 oleg352-client sshd[20072]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:48 oleg352-client sshd[20072]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:49 oleg352-client sshd[20072]: Received disconnect from 192.168.203.52 port 42298:11: disconnected by user Feb 27 12:17:49 oleg352-client sshd[20072]: Disconnected from 192.168.203.52 port 42298 Feb 27 12:17:49 oleg352-client sshd[20072]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:49 oleg352-client systemd-logind: Removed session 78. Feb 27 12:17:49 oleg352-client sshd[20227]: Accepted publickey for root from 192.168.203.52 port 42302 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:49 oleg352-client systemd: Started Session 79 of user root. Feb 27 12:17:49 oleg352-client systemd-logind: New session 79 of user root. Feb 27 12:17:49 oleg352-client sshd[20227]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:49 oleg352-client sshd[20227]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:49 oleg352-client sshd[20227]: Received disconnect from 192.168.203.52 port 42302:11: disconnected by user Feb 27 12:17:49 oleg352-client sshd[20227]: Disconnected from 192.168.203.52 port 42302 Feb 27 12:17:49 oleg352-client sshd[20227]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:49 oleg352-client systemd-logind: Removed session 79. Feb 27 12:17:53 oleg352-client sshd[20506]: Accepted publickey for root from 192.168.203.52 port 42318 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:54 oleg352-client systemd: Started Session 80 of user root. Feb 27 12:17:54 oleg352-client systemd-logind: New session 80 of user root. Feb 27 12:17:54 oleg352-client sshd[20506]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:54 oleg352-client sshd[20506]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:54 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 7: Seventh Failure Mode: CLIENT/MDS Tue Feb 27 12:17:51 EST 2024 ========================================================== 12:17:53 (1709054273) Feb 27 12:17:54 oleg352-client sshd[20506]: Received disconnect from 192.168.203.52 port 42318:11: disconnected by user Feb 27 12:17:54 oleg352-client sshd[20506]: Disconnected from 192.168.203.52 port 42318 Feb 27 12:17:54 oleg352-client sshd[20506]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:54 oleg352-client systemd-logind: Removed session 80. Feb 27 12:17:55 oleg352-client sshd[20578]: Accepted publickey for root from 192.168.203.52 port 42322 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:55 oleg352-client systemd-logind: New session 81 of user root. Feb 27 12:17:55 oleg352-client systemd: Started Session 81 of user root. Feb 27 12:17:55 oleg352-client sshd[20578]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:55 oleg352-client sshd[20578]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:55 oleg352-client sshd[20578]: Received disconnect from 192.168.203.52 port 42322:11: disconnected by user Feb 27 12:17:55 oleg352-client sshd[20578]: Disconnected from 192.168.203.52 port 42322 Feb 27 12:17:55 oleg352-client sshd[20578]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:55 oleg352-client systemd-logind: Removed session 81. Feb 27 12:17:55 oleg352-client sshd[20633]: Accepted publickey for root from 192.168.203.52 port 42324 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:55 oleg352-client systemd-logind: New session 82 of user root. Feb 27 12:17:55 oleg352-client sshd[20633]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:55 oleg352-client systemd: Started Session 82 of user root. Feb 27 12:17:55 oleg352-client sshd[20633]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:56 oleg352-client sshd[20633]: Received disconnect from 192.168.203.52 port 42324:11: disconnected by user Feb 27 12:17:56 oleg352-client sshd[20633]: Disconnected from 192.168.203.52 port 42324 Feb 27 12:17:56 oleg352-client sshd[20633]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:56 oleg352-client systemd-logind: Removed session 82. Feb 27 12:17:56 oleg352-client sshd[20794]: Accepted publickey for root from 192.168.203.52 port 42328 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:56 oleg352-client systemd: Started Session 83 of user root. Feb 27 12:17:56 oleg352-client systemd-logind: New session 83 of user root. Feb 27 12:17:56 oleg352-client sshd[20794]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:56 oleg352-client sshd[20794]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:56 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: 2, to fail: 0, failed: 0 Feb 27 12:17:56 oleg352-client sshd[20794]: Received disconnect from 192.168.203.52 port 42328:11: disconnected by user Feb 27 12:17:56 oleg352-client sshd[20794]: Disconnected from 192.168.203.52 port 42328 Feb 27 12:17:56 oleg352-client sshd[20794]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:57 oleg352-client systemd-logind: Removed session 83. Feb 27 12:17:57 oleg352-client sshd[20945]: Accepted publickey for root from 192.168.203.52 port 42330 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:57 oleg352-client systemd-logind: New session 84 of user root. Feb 27 12:17:57 oleg352-client systemd: Started Session 84 of user root. Feb 27 12:17:57 oleg352-client sshd[20945]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:57 oleg352-client sshd[20945]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:57 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:17:57 oleg352-client sshd[20945]: Received disconnect from 192.168.203.52 port 42330:11: disconnected by user Feb 27 12:17:57 oleg352-client sshd[20945]: Disconnected from 192.168.203.52 port 42330 Feb 27 12:17:57 oleg352-client sshd[20945]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:57 oleg352-client systemd-logind: Removed session 84. Feb 27 12:17:59 oleg352-client sshd[21014]: Accepted publickey for root from 192.168.203.52 port 42334 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:59 oleg352-client systemd: Started Session 85 of user root. Feb 27 12:17:59 oleg352-client systemd-logind: New session 85 of user root. Feb 27 12:17:59 oleg352-client sshd[21014]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:59 oleg352-client sshd[21014]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:59 oleg352-client sshd[21014]: Received disconnect from 192.168.203.52 port 42334:11: disconnected by user Feb 27 12:17:59 oleg352-client sshd[21014]: Disconnected from 192.168.203.52 port 42334 Feb 27 12:17:59 oleg352-client sshd[21014]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:59 oleg352-client systemd-logind: Removed session 85. Feb 27 12:17:59 oleg352-client sshd[21071]: Accepted publickey for root from 192.168.203.52 port 42336 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:59 oleg352-client systemd-logind: New session 86 of user root. Feb 27 12:17:59 oleg352-client systemd: Started Session 86 of user root. Feb 27 12:17:59 oleg352-client sshd[21071]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:59 oleg352-client sshd[21071]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:17:59 oleg352-client sshd[21071]: Received disconnect from 192.168.203.52 port 42336:11: disconnected by user Feb 27 12:17:59 oleg352-client sshd[21071]: Disconnected from 192.168.203.52 port 42336 Feb 27 12:17:59 oleg352-client sshd[21071]: pam_unix(sshd:session): session closed for user root Feb 27 12:17:59 oleg352-client systemd-logind: Removed session 86. Feb 27 12:17:59 oleg352-client sshd[21142]: Accepted publickey for root from 192.168.203.52 port 42338 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:17:59 oleg352-client systemd-logind: New session 87 of user root. Feb 27 12:17:59 oleg352-client systemd: Started Session 87 of user root. Feb 27 12:17:59 oleg352-client sshd[21142]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:17:59 oleg352-client sshd[21142]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:18:00 oleg352-client sshd[21142]: Received disconnect from 192.168.203.52 port 42338:11: disconnected by user Feb 27 12:18:00 oleg352-client sshd[21142]: Disconnected from 192.168.203.52 port 42338 Feb 27 12:18:00 oleg352-client sshd[21142]: pam_unix(sshd:session): session closed for user root Feb 27 12:18:00 oleg352-client systemd-logind: Removed session 87. Feb 27 12:18:23 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: disconnect after 21s idle Feb 27 12:19:01 oleg352-client sshd[21265]: Accepted publickey for root from 192.168.203.52 port 42340 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:01 oleg352-client systemd-logind: New session 88 of user root. Feb 27 12:19:01 oleg352-client systemd: Started Session 88 of user root. Feb 27 12:19:01 oleg352-client sshd[21265]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:01 oleg352-client sshd[21265]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:01 oleg352-client sshd[21265]: Received disconnect from 192.168.203.52 port 42340:11: disconnected by user Feb 27 12:19:01 oleg352-client sshd[21265]: Disconnected from 192.168.203.52 port 42340 Feb 27 12:19:01 oleg352-client sshd[21265]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:01 oleg352-client systemd-logind: Removed session 88. Feb 27 12:19:01 oleg352-client sshd[21326]: Accepted publickey for root from 192.168.203.52 port 42342 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:01 oleg352-client systemd-logind: New session 89 of user root. Feb 27 12:19:01 oleg352-client systemd: Started Session 89 of user root. Feb 27 12:19:01 oleg352-client sshd[21326]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:01 oleg352-client sshd[21326]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:01 oleg352-client sshd[21326]: Received disconnect from 192.168.203.52 port 42342:11: disconnected by user Feb 27 12:19:01 oleg352-client sshd[21326]: Disconnected from 192.168.203.52 port 42342 Feb 27 12:19:01 oleg352-client sshd[21326]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:01 oleg352-client systemd-logind: Removed session 89. Feb 27 12:19:18 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:19:18 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6cfbc1 to 0xb0e2427ff6d01fd Feb 27 12:19:18 oleg352-client kernel: Lustre: MGC192.168.203.152@tcp: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:19:18 oleg352-client kernel: Lustre: Skipped 2 previous similar messages Feb 27 12:19:18 oleg352-client sshd[21652]: Accepted publickey for root from 192.168.203.52 port 42366 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:18 oleg352-client systemd-logind: New session 90 of user root. Feb 27 12:19:18 oleg352-client systemd: Started Session 90 of user root. Feb 27 12:19:18 oleg352-client sshd[21652]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:18 oleg352-client sshd[21652]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:18 oleg352-client sshd[21652]: Received disconnect from 192.168.203.52 port 42366:11: disconnected by user Feb 27 12:19:18 oleg352-client sshd[21652]: Disconnected from 192.168.203.52 port 42366 Feb 27 12:19:18 oleg352-client sshd[21652]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:19 oleg352-client systemd-logind: Removed session 90. Feb 27 12:19:19 oleg352-client kernel: Lustre: 1800:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709054343/real 1709054343] req@ffff8800ac3f4380 x1792072708295104/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709054359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:19:19 oleg352-client sshd[21892]: Accepted publickey for root from 192.168.203.52 port 42370 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:19 oleg352-client systemd-logind: New session 91 of user root. Feb 27 12:19:19 oleg352-client systemd: Started Session 91 of user root. Feb 27 12:19:19 oleg352-client sshd[21892]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:19 oleg352-client sshd[21892]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:19 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Feb 27 12:19:19 oleg352-client sshd[21892]: Received disconnect from 192.168.203.52 port 42370:11: disconnected by user Feb 27 12:19:19 oleg352-client sshd[21892]: Disconnected from 192.168.203.52 port 42370 Feb 27 12:19:19 oleg352-client sshd[21892]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:19 oleg352-client systemd-logind: Removed session 91. Feb 27 12:19:20 oleg352-client sshd[22061]: Accepted publickey for root from 192.168.203.52 port 42372 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:20 oleg352-client systemd-logind: New session 92 of user root. Feb 27 12:19:20 oleg352-client systemd: Started Session 92 of user root. Feb 27 12:19:20 oleg352-client sshd[22061]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:20 oleg352-client sshd[22061]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:20 oleg352-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Feb 27 12:19:20 oleg352-client sshd[22061]: Received disconnect from 192.168.203.52 port 42372:11: disconnected by user Feb 27 12:19:20 oleg352-client sshd[22061]: Disconnected from 192.168.203.52 port 42372 Feb 27 12:19:20 oleg352-client sshd[22061]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:20 oleg352-client systemd-logind: Removed session 92. Feb 27 12:19:21 oleg352-client sshd[22130]: Accepted publickey for root from 192.168.203.52 port 42376 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:21 oleg352-client systemd-logind: New session 93 of user root. Feb 27 12:19:21 oleg352-client systemd: Started Session 93 of user root. Feb 27 12:19:21 oleg352-client sshd[22130]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:21 oleg352-client sshd[22130]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:21 oleg352-client sshd[22130]: Received disconnect from 192.168.203.52 port 42376:11: disconnected by user Feb 27 12:19:21 oleg352-client sshd[22130]: Disconnected from 192.168.203.52 port 42376 Feb 27 12:19:21 oleg352-client sshd[22130]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:22 oleg352-client systemd-logind: Removed session 93. Feb 27 12:19:22 oleg352-client sshd[22186]: Accepted publickey for root from 192.168.203.52 port 42378 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:22 oleg352-client systemd-logind: New session 94 of user root. Feb 27 12:19:22 oleg352-client systemd: Started Session 94 of user root. Feb 27 12:19:22 oleg352-client sshd[22186]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:22 oleg352-client sshd[22186]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:22 oleg352-client sshd[22186]: Received disconnect from 192.168.203.52 port 42378:11: disconnected by user Feb 27 12:19:22 oleg352-client sshd[22186]: Disconnected from 192.168.203.52 port 42378 Feb 27 12:19:22 oleg352-client sshd[22186]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:22 oleg352-client systemd-logind: Removed session 94. Feb 27 12:19:22 oleg352-client sshd[22257]: Accepted publickey for root from 192.168.203.52 port 42380 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:22 oleg352-client systemd-logind: New session 95 of user root. Feb 27 12:19:22 oleg352-client systemd: Started Session 95 of user root. Feb 27 12:19:22 oleg352-client sshd[22257]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:22 oleg352-client sshd[22257]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:22 oleg352-client sshd[22257]: Received disconnect from 192.168.203.52 port 42380:11: disconnected by user Feb 27 12:19:22 oleg352-client sshd[22257]: Disconnected from 192.168.203.52 port 42380 Feb 27 12:19:22 oleg352-client sshd[22257]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:22 oleg352-client systemd-logind: Removed session 95. Feb 27 12:19:23 oleg352-client sshd[22328]: Accepted publickey for root from 192.168.203.52 port 42382 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:19:23 oleg352-client systemd: Started Session 96 of user root. Feb 27 12:19:23 oleg352-client systemd-logind: New session 96 of user root. Feb 27 12:19:23 oleg352-client sshd[22328]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:19:23 oleg352-client sshd[22328]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:19:23 oleg352-client sshd[22328]: Received disconnect from 192.168.203.52 port 42382:11: disconnected by user Feb 27 12:19:23 oleg352-client sshd[22328]: Disconnected from 192.168.203.52 port 42382 Feb 27 12:19:23 oleg352-client sshd[22328]: pam_unix(sshd:session): session closed for user root Feb 27 12:19:23 oleg352-client systemd-logind: Removed session 96. Feb 27 12:19:43 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: disconnect after 20s idle Feb 27 12:19:43 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:20:24 oleg352-client sshd[22521]: Accepted publickey for root from 192.168.203.52 port 42384 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:24 oleg352-client systemd-logind: New session 97 of user root. Feb 27 12:20:24 oleg352-client sshd[22521]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:24 oleg352-client systemd: Started Session 97 of user root. Feb 27 12:20:24 oleg352-client sshd[22521]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:24 oleg352-client sshd[22521]: Received disconnect from 192.168.203.52 port 42384:11: disconnected by user Feb 27 12:20:24 oleg352-client sshd[22521]: Disconnected from 192.168.203.52 port 42384 Feb 27 12:20:24 oleg352-client sshd[22521]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:24 oleg352-client systemd-logind: Removed session 97. Feb 27 12:20:24 oleg352-client sshd[22673]: Accepted publickey for root from 192.168.203.52 port 42390 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:24 oleg352-client systemd-logind: New session 98 of user root. Feb 27 12:20:24 oleg352-client systemd: Started Session 98 of user root. Feb 27 12:20:24 oleg352-client sshd[22673]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:24 oleg352-client sshd[22673]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:25 oleg352-client sshd[22673]: Received disconnect from 192.168.203.52 port 42390:11: disconnected by user Feb 27 12:20:25 oleg352-client sshd[22673]: Disconnected from 192.168.203.52 port 42390 Feb 27 12:20:25 oleg352-client sshd[22673]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:25 oleg352-client systemd-logind: Removed session 98. Feb 27 12:20:25 oleg352-client sshd[22827]: Accepted publickey for root from 192.168.203.52 port 42392 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:25 oleg352-client systemd-logind: New session 99 of user root. Feb 27 12:20:25 oleg352-client systemd: Started Session 99 of user root. Feb 27 12:20:25 oleg352-client sshd[22827]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:25 oleg352-client sshd[22827]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:25 oleg352-client sshd[22827]: Received disconnect from 192.168.203.52 port 42392:11: disconnected by user Feb 27 12:20:25 oleg352-client sshd[22827]: Disconnected from 192.168.203.52 port 42392 Feb 27 12:20:25 oleg352-client sshd[22827]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:25 oleg352-client systemd-logind: Removed session 99. Feb 27 12:20:28 oleg352-client sshd[23105]: Accepted publickey for root from 192.168.203.52 port 42410 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:28 oleg352-client systemd: Started Session 100 of user root. Feb 27 12:20:28 oleg352-client sshd[23105]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:28 oleg352-client systemd-logind: New session 100 of user root. Feb 27 12:20:28 oleg352-client sshd[23105]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:29 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 8: Eighth Failure Mode: CLIENT/OST Tue Feb 27 12:20:26 EST 2024 ========================================================== 12:20:28 (1709054428) Feb 27 12:20:29 oleg352-client sshd[23105]: Received disconnect from 192.168.203.52 port 42410:11: disconnected by user Feb 27 12:20:29 oleg352-client sshd[23105]: Disconnected from 192.168.203.52 port 42410 Feb 27 12:20:29 oleg352-client sshd[23105]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:29 oleg352-client systemd-logind: Removed session 100. Feb 27 12:20:30 oleg352-client sshd[23177]: Accepted publickey for root from 192.168.203.52 port 42412 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:30 oleg352-client systemd-logind: New session 101 of user root. Feb 27 12:20:30 oleg352-client systemd: Started Session 101 of user root. Feb 27 12:20:30 oleg352-client sshd[23177]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:30 oleg352-client sshd[23177]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:30 oleg352-client sshd[23177]: Received disconnect from 192.168.203.52 port 42412:11: disconnected by user Feb 27 12:20:30 oleg352-client sshd[23177]: Disconnected from 192.168.203.52 port 42412 Feb 27 12:20:30 oleg352-client sshd[23177]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:30 oleg352-client systemd-logind: Removed session 101. Feb 27 12:20:30 oleg352-client sshd[23238]: Accepted publickey for root from 192.168.203.52 port 42414 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:30 oleg352-client systemd: Started Session 102 of user root. Feb 27 12:20:30 oleg352-client systemd-logind: New session 102 of user root. Feb 27 12:20:30 oleg352-client sshd[23238]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:30 oleg352-client sshd[23238]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:30 oleg352-client sshd[23238]: Received disconnect from 192.168.203.52 port 42414:11: disconnected by user Feb 27 12:20:30 oleg352-client sshd[23238]: Disconnected from 192.168.203.52 port 42414 Feb 27 12:20:30 oleg352-client sshd[23238]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:30 oleg352-client systemd-logind: Removed session 102. Feb 27 12:20:31 oleg352-client sshd[23393]: Accepted publickey for root from 192.168.203.52 port 42416 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:31 oleg352-client systemd-logind: New session 103 of user root. Feb 27 12:20:31 oleg352-client systemd: Started Session 103 of user root. Feb 27 12:20:31 oleg352-client sshd[23393]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:31 oleg352-client sshd[23393]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:31 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: 2, to fail: 0, failed: 0 Feb 27 12:20:31 oleg352-client sshd[23393]: Received disconnect from 192.168.203.52 port 42416:11: disconnected by user Feb 27 12:20:31 oleg352-client sshd[23393]: Disconnected from 192.168.203.52 port 42416 Feb 27 12:20:31 oleg352-client sshd[23393]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:31 oleg352-client systemd-logind: Removed session 103. Feb 27 12:20:31 oleg352-client sshd[23544]: Accepted publickey for root from 192.168.203.52 port 42420 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:31 oleg352-client systemd: Started Session 104 of user root. Feb 27 12:20:31 oleg352-client systemd-logind: New session 104 of user root. Feb 27 12:20:31 oleg352-client sshd[23544]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:31 oleg352-client sshd[23544]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:32 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:20:32 oleg352-client sshd[23544]: Received disconnect from 192.168.203.52 port 42420:11: disconnected by user Feb 27 12:20:32 oleg352-client sshd[23544]: Disconnected from 192.168.203.52 port 42420 Feb 27 12:20:32 oleg352-client sshd[23544]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:32 oleg352-client systemd-logind: Removed session 104. Feb 27 12:20:33 oleg352-client sshd[23613]: Accepted publickey for root from 192.168.203.52 port 42424 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:33 oleg352-client systemd-logind: New session 105 of user root. Feb 27 12:20:33 oleg352-client systemd: Started Session 105 of user root. Feb 27 12:20:33 oleg352-client sshd[23613]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:33 oleg352-client sshd[23613]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:33 oleg352-client sshd[23613]: Received disconnect from 192.168.203.52 port 42424:11: disconnected by user Feb 27 12:20:33 oleg352-client sshd[23613]: Disconnected from 192.168.203.52 port 42424 Feb 27 12:20:33 oleg352-client sshd[23613]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:33 oleg352-client systemd-logind: Removed session 105. Feb 27 12:20:33 oleg352-client sshd[23669]: Accepted publickey for root from 192.168.203.52 port 42426 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:33 oleg352-client systemd-logind: New session 106 of user root. Feb 27 12:20:33 oleg352-client systemd: Started Session 106 of user root. Feb 27 12:20:33 oleg352-client sshd[23669]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:33 oleg352-client sshd[23669]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:33 oleg352-client sshd[23669]: Received disconnect from 192.168.203.52 port 42426:11: disconnected by user Feb 27 12:20:33 oleg352-client sshd[23669]: Disconnected from 192.168.203.52 port 42426 Feb 27 12:20:33 oleg352-client sshd[23669]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:33 oleg352-client systemd-logind: Removed session 106. Feb 27 12:20:33 oleg352-client sshd[23737]: Accepted publickey for root from 192.168.203.52 port 42428 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:20:34 oleg352-client systemd: Started Session 107 of user root. Feb 27 12:20:34 oleg352-client systemd-logind: New session 107 of user root. Feb 27 12:20:34 oleg352-client sshd[23737]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:20:34 oleg352-client sshd[23737]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:20:34 oleg352-client sshd[23737]: Received disconnect from 192.168.203.52 port 42428:11: disconnected by user Feb 27 12:20:34 oleg352-client sshd[23737]: Disconnected from 192.168.203.52 port 42428 Feb 27 12:20:34 oleg352-client sshd[23737]: pam_unix(sshd:session): session closed for user root Feb 27 12:20:34 oleg352-client systemd-logind: Removed session 107. Feb 27 12:20:53 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: disconnect after 20s idle Feb 27 12:20:53 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:21:35 oleg352-client sshd[23866]: Accepted publickey for root from 192.168.203.52 port 42430 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:21:35 oleg352-client systemd: Started Session 108 of user root. Feb 27 12:21:35 oleg352-client systemd-logind: New session 108 of user root. Feb 27 12:21:35 oleg352-client sshd[23866]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:21:35 oleg352-client sshd[23866]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:21:35 oleg352-client sshd[23866]: Received disconnect from 192.168.203.52 port 42430:11: disconnected by user Feb 27 12:21:35 oleg352-client sshd[23866]: Disconnected from 192.168.203.52 port 42430 Feb 27 12:21:35 oleg352-client sshd[23866]: pam_unix(sshd:session): session closed for user root Feb 27 12:21:35 oleg352-client systemd-logind: Removed session 108. Feb 27 12:21:36 oleg352-client sshd[23931]: Accepted publickey for root from 192.168.203.52 port 42432 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:21:36 oleg352-client systemd-logind: New session 109 of user root. Feb 27 12:21:36 oleg352-client systemd: Started Session 109 of user root. Feb 27 12:21:36 oleg352-client sshd[23931]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:21:36 oleg352-client sshd[23931]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:21:36 oleg352-client sshd[23931]: Received disconnect from 192.168.203.52 port 42432:11: disconnected by user Feb 27 12:21:36 oleg352-client sshd[23931]: Disconnected from 192.168.203.52 port 42432 Feb 27 12:21:36 oleg352-client sshd[23931]: pam_unix(sshd:session): session closed for user root Feb 27 12:21:36 oleg352-client systemd-logind: Removed session 109. Feb 27 12:21:38 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection to lustre-OST0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:21:38 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:21:49 oleg352-client sshd[24062]: Accepted publickey for root from 192.168.203.52 port 42442 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:21:49 oleg352-client systemd: Started Session 110 of user root. Feb 27 12:21:49 oleg352-client systemd-logind: New session 110 of user root. Feb 27 12:21:49 oleg352-client sshd[24062]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:21:49 oleg352-client sshd[24062]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:21:58 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: Connection restored to 192.168.203.152@tcp (at 192.168.203.152@tcp) Feb 27 12:21:58 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:21:58 oleg352-client sshd[24062]: Received disconnect from 192.168.203.52 port 42442:11: disconnected by user Feb 27 12:21:58 oleg352-client sshd[24062]: Disconnected from 192.168.203.52 port 42442 Feb 27 12:21:58 oleg352-client sshd[24062]: pam_unix(sshd:session): session closed for user root Feb 27 12:21:58 oleg352-client systemd-logind: Removed session 110. Feb 27 12:22:00 oleg352-client sshd[24350]: Accepted publickey for root from 192.168.203.52 port 42466 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:22:00 oleg352-client systemd-logind: New session 111 of user root. Feb 27 12:22:00 oleg352-client systemd: Started Session 111 of user root. Feb 27 12:22:00 oleg352-client sshd[24350]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:22:00 oleg352-client sshd[24350]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:22:00 oleg352-client sshd[24350]: Received disconnect from 192.168.203.52 port 42466:11: disconnected by user Feb 27 12:22:00 oleg352-client sshd[24350]: Disconnected from 192.168.203.52 port 42466 Feb 27 12:22:00 oleg352-client sshd[24350]: pam_unix(sshd:session): session closed for user root Feb 27 12:22:01 oleg352-client systemd-logind: Removed session 111. Feb 27 12:22:01 oleg352-client sshd[24418]: Accepted publickey for root from 192.168.203.52 port 42468 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:22:01 oleg352-client systemd-logind: New session 112 of user root. Feb 27 12:22:01 oleg352-client systemd: Started Session 112 of user root. Feb 27 12:22:01 oleg352-client sshd[24418]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:22:01 oleg352-client sshd[24418]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:22:01 oleg352-client sshd[24418]: Received disconnect from 192.168.203.52 port 42468:11: disconnected by user Feb 27 12:22:01 oleg352-client sshd[24418]: Disconnected from 192.168.203.52 port 42468 Feb 27 12:22:01 oleg352-client sshd[24418]: pam_unix(sshd:session): session closed for user root Feb 27 12:22:01 oleg352-client systemd-logind: Removed session 112. Feb 27 12:22:23 oleg352-client kernel: Lustre: lustre-OST0000-osc-ffff8800b6d21800: disconnect after 22s idle Feb 27 12:22:23 oleg352-client kernel: Lustre: Skipped 1 previous similar message Feb 27 12:23:01 oleg352-client sshd[24611]: Accepted publickey for root from 192.168.203.52 port 42472 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:01 oleg352-client systemd: Started Session 113 of user root. Feb 27 12:23:01 oleg352-client systemd-logind: New session 113 of user root. Feb 27 12:23:01 oleg352-client sshd[24611]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:01 oleg352-client sshd[24611]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:02 oleg352-client sshd[24611]: Received disconnect from 192.168.203.52 port 42472:11: disconnected by user Feb 27 12:23:02 oleg352-client sshd[24611]: Disconnected from 192.168.203.52 port 42472 Feb 27 12:23:02 oleg352-client sshd[24611]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:02 oleg352-client systemd-logind: Removed session 113. Feb 27 12:23:02 oleg352-client sshd[24763]: Accepted publickey for root from 192.168.203.52 port 42476 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:02 oleg352-client systemd-logind: New session 114 of user root. Feb 27 12:23:02 oleg352-client systemd: Started Session 114 of user root. Feb 27 12:23:02 oleg352-client sshd[24763]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:02 oleg352-client sshd[24763]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:02 oleg352-client sshd[24763]: Received disconnect from 192.168.203.52 port 42476:11: disconnected by user Feb 27 12:23:02 oleg352-client sshd[24763]: Disconnected from 192.168.203.52 port 42476 Feb 27 12:23:02 oleg352-client sshd[24763]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:02 oleg352-client systemd-logind: Removed session 114. Feb 27 12:23:02 oleg352-client sshd[24917]: Accepted publickey for root from 192.168.203.52 port 42480 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:02 oleg352-client systemd-logind: New session 115 of user root. Feb 27 12:23:02 oleg352-client systemd: Started Session 115 of user root. Feb 27 12:23:02 oleg352-client sshd[24917]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:02 oleg352-client sshd[24917]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:03 oleg352-client sshd[24917]: Received disconnect from 192.168.203.52 port 42480:11: disconnected by user Feb 27 12:23:03 oleg352-client sshd[24917]: Disconnected from 192.168.203.52 port 42480 Feb 27 12:23:03 oleg352-client sshd[24917]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:03 oleg352-client systemd-logind: Removed session 115. Feb 27 12:23:05 oleg352-client sshd[25195]: Accepted publickey for root from 192.168.203.52 port 42496 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:05 oleg352-client systemd: Started Session 116 of user root. Feb 27 12:23:05 oleg352-client systemd-logind: New session 116 of user root. Feb 27 12:23:05 oleg352-client sshd[25195]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:05 oleg352-client sshd[25195]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:06 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 9: Ninth Failure Mode: CLIENT/CLIENT Tue Feb 27 12:23:04 EST 2024 ========================================================== 12:23:05 (1709054585) Feb 27 12:23:06 oleg352-client sshd[25195]: Received disconnect from 192.168.203.52 port 42496:11: disconnected by user Feb 27 12:23:06 oleg352-client sshd[25195]: Disconnected from 192.168.203.52 port 42496 Feb 27 12:23:06 oleg352-client sshd[25195]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:06 oleg352-client systemd-logind: Removed session 116. Feb 27 12:23:07 oleg352-client sshd[25266]: Accepted publickey for root from 192.168.203.52 port 42498 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:07 oleg352-client systemd: Started Session 117 of user root. Feb 27 12:23:07 oleg352-client systemd-logind: New session 117 of user root. Feb 27 12:23:07 oleg352-client sshd[25266]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:07 oleg352-client sshd[25266]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:07 oleg352-client sshd[25266]: Received disconnect from 192.168.203.52 port 42498:11: disconnected by user Feb 27 12:23:07 oleg352-client sshd[25266]: Disconnected from 192.168.203.52 port 42498 Feb 27 12:23:07 oleg352-client sshd[25266]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:07 oleg352-client systemd-logind: Removed session 117. Feb 27 12:23:07 oleg352-client sshd[25328]: Accepted publickey for root from 192.168.203.52 port 42500 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:07 oleg352-client systemd-logind: New session 118 of user root. Feb 27 12:23:07 oleg352-client systemd: Started Session 118 of user root. Feb 27 12:23:07 oleg352-client sshd[25328]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:07 oleg352-client sshd[25328]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:07 oleg352-client sshd[25328]: Received disconnect from 192.168.203.52 port 42500:11: disconnected by user Feb 27 12:23:07 oleg352-client sshd[25328]: Disconnected from 192.168.203.52 port 42500 Feb 27 12:23:07 oleg352-client sshd[25328]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:07 oleg352-client systemd-logind: Removed session 118. Feb 27 12:23:08 oleg352-client sshd[25483]: Accepted publickey for root from 192.168.203.52 port 42504 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:08 oleg352-client systemd-logind: New session 119 of user root. Feb 27 12:23:08 oleg352-client systemd: Started Session 119 of user root. Feb 27 12:23:08 oleg352-client sshd[25483]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:08 oleg352-client sshd[25483]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:08 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: 2, to fail: 0, failed: 0 Feb 27 12:23:08 oleg352-client sshd[25483]: Received disconnect from 192.168.203.52 port 42504:11: disconnected by user Feb 27 12:23:08 oleg352-client sshd[25483]: Disconnected from 192.168.203.52 port 42504 Feb 27 12:23:08 oleg352-client sshd[25483]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:08 oleg352-client systemd-logind: Removed session 119. Feb 27 12:23:08 oleg352-client sshd[25633]: Accepted publickey for root from 192.168.203.52 port 42508 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:08 oleg352-client systemd: Started Session 120 of user root. Feb 27 12:23:08 oleg352-client systemd-logind: New session 120 of user root. Feb 27 12:23:08 oleg352-client sshd[25633]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:08 oleg352-client sshd[25633]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:09 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:23:09 oleg352-client sshd[25633]: Received disconnect from 192.168.203.52 port 42508:11: disconnected by user Feb 27 12:23:09 oleg352-client sshd[25633]: Disconnected from 192.168.203.52 port 42508 Feb 27 12:23:09 oleg352-client sshd[25633]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:09 oleg352-client systemd-logind: Removed session 120. Feb 27 12:23:10 oleg352-client sshd[25703]: Accepted publickey for root from 192.168.203.52 port 42510 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:10 oleg352-client systemd: Started Session 121 of user root. Feb 27 12:23:10 oleg352-client systemd-logind: New session 121 of user root. Feb 27 12:23:10 oleg352-client sshd[25703]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:10 oleg352-client sshd[25703]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:10 oleg352-client sshd[25703]: Received disconnect from 192.168.203.52 port 42510:11: disconnected by user Feb 27 12:23:10 oleg352-client sshd[25703]: Disconnected from 192.168.203.52 port 42510 Feb 27 12:23:10 oleg352-client sshd[25703]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:10 oleg352-client systemd-logind: Removed session 121. Feb 27 12:23:10 oleg352-client sshd[25757]: Accepted publickey for root from 192.168.203.52 port 42512 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:10 oleg352-client systemd-logind: New session 122 of user root. Feb 27 12:23:10 oleg352-client systemd: Started Session 122 of user root. Feb 27 12:23:10 oleg352-client sshd[25757]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:10 oleg352-client sshd[25757]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:10 oleg352-client sshd[25757]: Received disconnect from 192.168.203.52 port 42512:11: disconnected by user Feb 27 12:23:10 oleg352-client sshd[25757]: Disconnected from 192.168.203.52 port 42512 Feb 27 12:23:10 oleg352-client sshd[25757]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:11 oleg352-client systemd-logind: Removed session 122. Feb 27 12:23:11 oleg352-client sshd[25832]: Accepted publickey for root from 192.168.203.52 port 42514 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:23:11 oleg352-client systemd-logind: New session 123 of user root. Feb 27 12:23:11 oleg352-client systemd: Started Session 123 of user root. Feb 27 12:23:11 oleg352-client sshd[25832]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:23:11 oleg352-client sshd[25832]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:23:11 oleg352-client sshd[25832]: Received disconnect from 192.168.203.52 port 42514:11: disconnected by user Feb 27 12:23:11 oleg352-client sshd[25832]: Disconnected from 192.168.203.52 port 42514 Feb 27 12:23:11 oleg352-client sshd[25832]: pam_unix(sshd:session): session closed for user root Feb 27 12:23:11 oleg352-client systemd: Starting Cleanup of Temporary Directories... Feb 27 12:23:11 oleg352-client systemd: Started Cleanup of Temporary Directories. Feb 27 12:23:11 oleg352-client systemd-logind: Removed session 123. Feb 27 12:24:12 oleg352-client sshd[25954]: Accepted publickey for root from 192.168.203.52 port 42516 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:12 oleg352-client systemd-logind: New session 124 of user root. Feb 27 12:24:12 oleg352-client systemd: Started Session 124 of user root. Feb 27 12:24:12 oleg352-client sshd[25954]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:12 oleg352-client sshd[25954]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:12 oleg352-client sshd[25954]: Received disconnect from 192.168.203.52 port 42516:11: disconnected by user Feb 27 12:24:12 oleg352-client sshd[25954]: Disconnected from 192.168.203.52 port 42516 Feb 27 12:24:12 oleg352-client sshd[25954]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:12 oleg352-client systemd-logind: Removed session 124. Feb 27 12:24:12 oleg352-client sshd[26018]: Accepted publickey for root from 192.168.203.52 port 42518 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:12 oleg352-client systemd-logind: New session 125 of user root. Feb 27 12:24:12 oleg352-client systemd: Started Session 125 of user root. Feb 27 12:24:12 oleg352-client sshd[26018]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:12 oleg352-client sshd[26018]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:13 oleg352-client sshd[26018]: Received disconnect from 192.168.203.52 port 42518:11: disconnected by user Feb 27 12:24:13 oleg352-client sshd[26018]: Disconnected from 192.168.203.52 port 42518 Feb 27 12:24:13 oleg352-client sshd[26018]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:13 oleg352-client systemd-logind: Removed session 125. Feb 27 12:24:13 oleg352-client sshd[26169]: Accepted publickey for root from 192.168.203.52 port 42522 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:13 oleg352-client systemd-logind: New session 126 of user root. Feb 27 12:24:13 oleg352-client systemd: Started Session 126 of user root. Feb 27 12:24:13 oleg352-client sshd[26169]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:13 oleg352-client sshd[26169]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:13 oleg352-client kernel: Lustre: DEBUG MARKER: Request fail clients: 2, to fail: 0, failed: 0 Feb 27 12:24:13 oleg352-client sshd[26169]: Received disconnect from 192.168.203.52 port 42522:11: disconnected by user Feb 27 12:24:13 oleg352-client sshd[26169]: Disconnected from 192.168.203.52 port 42522 Feb 27 12:24:13 oleg352-client sshd[26169]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:13 oleg352-client systemd-logind: Removed session 126. Feb 27 12:24:14 oleg352-client sshd[26321]: Accepted publickey for root from 192.168.203.52 port 42524 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:14 oleg352-client systemd-logind: New session 127 of user root. Feb 27 12:24:14 oleg352-client systemd: Started Session 127 of user root. Feb 27 12:24:14 oleg352-client sshd[26321]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:14 oleg352-client sshd[26321]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:14 oleg352-client kernel: Lustre: DEBUG MARKER: No clients failed! Feb 27 12:24:14 oleg352-client sshd[26321]: Received disconnect from 192.168.203.52 port 42524:11: disconnected by user Feb 27 12:24:14 oleg352-client sshd[26321]: Disconnected from 192.168.203.52 port 42524 Feb 27 12:24:14 oleg352-client sshd[26321]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:14 oleg352-client systemd-logind: Removed session 127. Feb 27 12:24:15 oleg352-client sshd[26390]: Accepted publickey for root from 192.168.203.52 port 42528 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:15 oleg352-client systemd-logind: New session 128 of user root. Feb 27 12:24:15 oleg352-client systemd: Started Session 128 of user root. Feb 27 12:24:15 oleg352-client sshd[26390]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:15 oleg352-client sshd[26390]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:15 oleg352-client sshd[26390]: Received disconnect from 192.168.203.52 port 42528:11: disconnected by user Feb 27 12:24:15 oleg352-client sshd[26390]: Disconnected from 192.168.203.52 port 42528 Feb 27 12:24:15 oleg352-client sshd[26390]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:15 oleg352-client systemd-logind: Removed session 128. Feb 27 12:24:15 oleg352-client sshd[26453]: Accepted publickey for root from 192.168.203.52 port 42530 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:15 oleg352-client systemd-logind: New session 129 of user root. Feb 27 12:24:15 oleg352-client systemd: Started Session 129 of user root. Feb 27 12:24:15 oleg352-client sshd[26453]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:15 oleg352-client sshd[26453]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:15 oleg352-client sshd[26453]: Received disconnect from 192.168.203.52 port 42530:11: disconnected by user Feb 27 12:24:15 oleg352-client sshd[26453]: Disconnected from 192.168.203.52 port 42530 Feb 27 12:24:15 oleg352-client sshd[26453]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:15 oleg352-client systemd-logind: Removed session 129. Feb 27 12:24:16 oleg352-client sshd[26518]: Accepted publickey for root from 192.168.203.52 port 42532 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:16 oleg352-client systemd: Started Session 130 of user root. Feb 27 12:24:16 oleg352-client systemd-logind: New session 130 of user root. Feb 27 12:24:16 oleg352-client sshd[26518]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:16 oleg352-client sshd[26518]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:16 oleg352-client sshd[26518]: Received disconnect from 192.168.203.52 port 42532:11: disconnected by user Feb 27 12:24:16 oleg352-client sshd[26518]: Disconnected from 192.168.203.52 port 42532 Feb 27 12:24:16 oleg352-client sshd[26518]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:16 oleg352-client systemd-logind: Removed session 130. Feb 27 12:24:17 oleg352-client sshd[26590]: Accepted publickey for root from 192.168.203.52 port 42534 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:24:17 oleg352-client systemd-logind: New session 131 of user root. Feb 27 12:24:17 oleg352-client systemd: Started Session 131 of user root. Feb 27 12:24:17 oleg352-client sshd[26590]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:24:17 oleg352-client sshd[26590]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:24:17 oleg352-client sshd[26590]: Received disconnect from 192.168.203.52 port 42534:11: disconnected by user Feb 27 12:24:17 oleg352-client sshd[26590]: Disconnected from 192.168.203.52 port 42534 Feb 27 12:24:17 oleg352-client sshd[26590]: pam_unix(sshd:session): session closed for user root Feb 27 12:24:17 oleg352-client systemd-logind: Removed session 131. Feb 27 12:24:38 oleg352-client kernel: Lustre: lustre-OST0001-osc-ffff8800b6d21800: disconnect after 21s idle Feb 27 12:24:38 oleg352-client kernel: Lustre: Skipped 2 previous similar messages Feb 27 12:25:18 oleg352-client sshd[26784]: Accepted publickey for root from 192.168.203.52 port 42536 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:18 oleg352-client systemd-logind: New session 132 of user root. Feb 27 12:25:18 oleg352-client systemd: Started Session 132 of user root. Feb 27 12:25:18 oleg352-client sshd[26784]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:18 oleg352-client sshd[26784]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:18 oleg352-client sshd[26784]: Received disconnect from 192.168.203.52 port 42536:11: disconnected by user Feb 27 12:25:18 oleg352-client sshd[26784]: Disconnected from 192.168.203.52 port 42536 Feb 27 12:25:18 oleg352-client sshd[26784]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:18 oleg352-client systemd-logind: Removed session 132. Feb 27 12:25:18 oleg352-client sshd[26935]: Accepted publickey for root from 192.168.203.52 port 42540 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:19 oleg352-client systemd: Started Session 133 of user root. Feb 27 12:25:19 oleg352-client systemd-logind: New session 133 of user root. Feb 27 12:25:19 oleg352-client sshd[26935]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:19 oleg352-client sshd[26935]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:19 oleg352-client sshd[26935]: Received disconnect from 192.168.203.52 port 42540:11: disconnected by user Feb 27 12:25:19 oleg352-client sshd[26935]: Disconnected from 192.168.203.52 port 42540 Feb 27 12:25:19 oleg352-client sshd[26935]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:19 oleg352-client systemd-logind: Removed session 133. Feb 27 12:25:19 oleg352-client sshd[27090]: Accepted publickey for root from 192.168.203.52 port 42546 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:19 oleg352-client systemd-logind: New session 134 of user root. Feb 27 12:25:19 oleg352-client systemd: Started Session 134 of user root. Feb 27 12:25:19 oleg352-client sshd[27090]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:19 oleg352-client sshd[27090]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:20 oleg352-client sshd[27090]: Received disconnect from 192.168.203.52 port 42546:11: disconnected by user Feb 27 12:25:20 oleg352-client sshd[27090]: Disconnected from 192.168.203.52 port 42546 Feb 27 12:25:20 oleg352-client sshd[27090]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:20 oleg352-client systemd-logind: Removed session 134. Feb 27 12:25:24 oleg352-client sshd[27369]: Accepted publickey for root from 192.168.203.52 port 42562 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:24 oleg352-client systemd: Started Session 135 of user root. Feb 27 12:25:24 oleg352-client systemd-logind: New session 135 of user root. Feb 27 12:25:24 oleg352-client sshd[27369]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:24 oleg352-client sshd[27369]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:24 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 10: Tenth Failure Mode: MDT0/OST/MDT1 Tue Feb 27 12:25:21 EST 2024 ========================================================== 12:25:23 (1709054723) Feb 27 12:25:24 oleg352-client sshd[27369]: Received disconnect from 192.168.203.52 port 42562:11: disconnected by user Feb 27 12:25:24 oleg352-client sshd[27369]: Disconnected from 192.168.203.52 port 42562 Feb 27 12:25:24 oleg352-client sshd[27369]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:24 oleg352-client systemd-logind: Removed session 135. Feb 27 12:25:24 oleg352-client sshd[27519]: Accepted publickey for root from 192.168.203.52 port 42564 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:24 oleg352-client systemd-logind: New session 136 of user root. Feb 27 12:25:24 oleg352-client sshd[27519]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:24 oleg352-client systemd: Started Session 136 of user root. Feb 27 12:25:24 oleg352-client sshd[27519]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:24 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_10 needs >= 2 MDTs Feb 27 12:25:24 oleg352-client sshd[27519]: Received disconnect from 192.168.203.52 port 42564:11: disconnected by user Feb 27 12:25:24 oleg352-client sshd[27519]: Disconnected from 192.168.203.52 port 42564 Feb 27 12:25:24 oleg352-client sshd[27519]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:25 oleg352-client systemd-logind: Removed session 136. Feb 27 12:25:28 oleg352-client sshd[27798]: Accepted publickey for root from 192.168.203.52 port 42582 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:28 oleg352-client systemd-logind: New session 137 of user root. Feb 27 12:25:28 oleg352-client sshd[27798]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:28 oleg352-client systemd: Started Session 137 of user root. Feb 27 12:25:28 oleg352-client sshd[27798]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:29 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 11: Eleventh Failure Mode: MDS0/CLIENT/MDS1 Tue Feb 27 12:25:26 EST 2024 ========================================================== 12:25:28 (1709054728) Feb 27 12:25:29 oleg352-client sshd[27798]: Received disconnect from 192.168.203.52 port 42582:11: disconnected by user Feb 27 12:25:29 oleg352-client sshd[27798]: Disconnected from 192.168.203.52 port 42582 Feb 27 12:25:29 oleg352-client sshd[27798]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:29 oleg352-client systemd-logind: Removed session 137. Feb 27 12:25:29 oleg352-client sshd[27948]: Accepted publickey for root from 192.168.203.52 port 42586 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:29 oleg352-client systemd: Started Session 138 of user root. Feb 27 12:25:29 oleg352-client systemd-logind: New session 138 of user root. Feb 27 12:25:29 oleg352-client sshd[27948]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:29 oleg352-client sshd[27948]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:29 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_11 needs >= 2 MDTs Feb 27 12:25:29 oleg352-client sshd[27948]: Received disconnect from 192.168.203.52 port 42586:11: disconnected by user Feb 27 12:25:29 oleg352-client sshd[27948]: Disconnected from 192.168.203.52 port 42586 Feb 27 12:25:29 oleg352-client sshd[27948]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:29 oleg352-client systemd-logind: Removed session 138. Feb 27 12:25:33 oleg352-client sshd[28226]: Accepted publickey for root from 192.168.203.52 port 42600 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:33 oleg352-client systemd-logind: New session 139 of user root. Feb 27 12:25:33 oleg352-client systemd: Started Session 139 of user root. Feb 27 12:25:33 oleg352-client sshd[28226]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:33 oleg352-client sshd[28226]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:34 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 12: Twelve Failure Mode: MDS0,MDS1/OST0, OST1/CLIENTS Tue Feb 27 12:25:31 EST 2024 ========================================================== 12:25:33 (1709054733) Feb 27 12:25:34 oleg352-client sshd[28226]: Received disconnect from 192.168.203.52 port 42600:11: disconnected by user Feb 27 12:25:34 oleg352-client sshd[28226]: Disconnected from 192.168.203.52 port 42600 Feb 27 12:25:34 oleg352-client sshd[28226]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:34 oleg352-client systemd-logind: Removed session 139. Feb 27 12:25:34 oleg352-client sshd[28377]: Accepted publickey for root from 192.168.203.52 port 42604 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:34 oleg352-client systemd-logind: New session 140 of user root. Feb 27 12:25:34 oleg352-client systemd: Started Session 140 of user root. Feb 27 12:25:34 oleg352-client sshd[28377]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:34 oleg352-client sshd[28377]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:34 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_12 needs >= 2 MDTs Feb 27 12:25:34 oleg352-client sshd[28377]: Received disconnect from 192.168.203.52 port 42604:11: disconnected by user Feb 27 12:25:34 oleg352-client sshd[28377]: Disconnected from 192.168.203.52 port 42604 Feb 27 12:25:34 oleg352-client sshd[28377]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:34 oleg352-client systemd-logind: Removed session 140. Feb 27 12:25:38 oleg352-client sshd[28654]: Accepted publickey for root from 192.168.203.52 port 42622 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:38 oleg352-client systemd: Started Session 141 of user root. Feb 27 12:25:38 oleg352-client systemd-logind: New session 141 of user root. Feb 27 12:25:38 oleg352-client sshd[28654]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:38 oleg352-client sshd[28654]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:38 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 13: Thirteen Failure Mode: MDS0,MDS1/CLIENTS/OST0,OST1 Tue Feb 27 12:25:35 EST 2024 ========================================================== 12:25:38 (1709054738) Feb 27 12:25:38 oleg352-client sshd[28654]: Received disconnect from 192.168.203.52 port 42622:11: disconnected by user Feb 27 12:25:38 oleg352-client sshd[28654]: Disconnected from 192.168.203.52 port 42622 Feb 27 12:25:38 oleg352-client sshd[28654]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:38 oleg352-client systemd-logind: Removed session 141. Feb 27 12:25:39 oleg352-client sshd[28804]: Accepted publickey for root from 192.168.203.52 port 42624 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:39 oleg352-client systemd: Started Session 142 of user root. Feb 27 12:25:39 oleg352-client systemd-logind: New session 142 of user root. Feb 27 12:25:39 oleg352-client sshd[28804]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:39 oleg352-client sshd[28804]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:39 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_13 needs >= 2 MDTs Feb 27 12:25:39 oleg352-client sshd[28804]: Received disconnect from 192.168.203.52 port 42624:11: disconnected by user Feb 27 12:25:39 oleg352-client sshd[28804]: Disconnected from 192.168.203.52 port 42624 Feb 27 12:25:39 oleg352-client sshd[28804]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:39 oleg352-client systemd-logind: Removed session 142. Feb 27 12:25:43 oleg352-client sshd[29081]: Accepted publickey for root from 192.168.203.52 port 42640 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:43 oleg352-client systemd-logind: New session 143 of user root. Feb 27 12:25:43 oleg352-client systemd: Started Session 143 of user root. Feb 27 12:25:43 oleg352-client sshd[29081]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:43 oleg352-client sshd[29081]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:43 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test 14: Fourteen Failure Mode: OST0,OST1/CLIENTS/MDS0,MDS1 Tue Feb 27 12:25:40 EST 2024 ========================================================== 12:25:42 (1709054742) Feb 27 12:25:43 oleg352-client sshd[29081]: Received disconnect from 192.168.203.52 port 42640:11: disconnected by user Feb 27 12:25:43 oleg352-client sshd[29081]: Disconnected from 192.168.203.52 port 42640 Feb 27 12:25:43 oleg352-client sshd[29081]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:43 oleg352-client systemd-logind: Removed session 143. Feb 27 12:25:43 oleg352-client sshd[29232]: Accepted publickey for root from 192.168.203.52 port 42646 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:43 oleg352-client systemd: Started Session 144 of user root. Feb 27 12:25:43 oleg352-client systemd-logind: New session 144 of user root. Feb 27 12:25:43 oleg352-client sshd[29232]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:43 oleg352-client sshd[29232]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:43 oleg352-client kernel: Lustre: DEBUG MARKER: SKIP: insanity test_14 needs >= 2 MDTs Feb 27 12:25:43 oleg352-client sshd[29232]: Received disconnect from 192.168.203.52 port 42646:11: disconnected by user Feb 27 12:25:43 oleg352-client sshd[29232]: Disconnected from 192.168.203.52 port 42646 Feb 27 12:25:43 oleg352-client sshd[29232]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:43 oleg352-client systemd-logind: Removed session 144. Feb 27 12:25:45 oleg352-client sshd[29433]: Accepted publickey for root from 192.168.203.52 port 42652 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:25:45 oleg352-client systemd-logind: New session 145 of user root. Feb 27 12:25:45 oleg352-client systemd: Started Session 145 of user root. Feb 27 12:25:45 oleg352-client sshd[29433]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:25:45 oleg352-client sshd[29433]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:25:45 oleg352-client kernel: Lustre: DEBUG MARKER: == insanity test complete, duration 979 sec ============== 12:25:45 (1709054745) Feb 27 12:25:45 oleg352-client sshd[29433]: Received disconnect from 192.168.203.52 port 42652:11: disconnected by user Feb 27 12:25:45 oleg352-client sshd[29433]: Disconnected from 192.168.203.52 port 42652 Feb 27 12:25:45 oleg352-client sshd[29433]: pam_unix(sshd:session): session closed for user root Feb 27 12:25:46 oleg352-client systemd-logind: Removed session 145. Feb 27 12:26:04 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1709054748/real 1709054748] req@ffff88012dc24e00 x1792072708323072/t0(0) o400->lustre-MDT0000-mdc-ffff8800b6d21800@192.168.203.152@tcp:12/10 lens 224/224 e 0 to 1 dl 1709054764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 Feb 27 12:26:04 oleg352-client kernel: Lustre: 1799:0:(client.c:2338:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Feb 27 12:26:04 oleg352-client kernel: Lustre: lustre-MDT0000-mdc-ffff8800b6d21800: Connection to lustre-MDT0000 (at 192.168.203.152@tcp) was lost; in progress operations using this service will wait for recovery to complete Feb 27 12:26:04 oleg352-client kernel: LustreError: 166-1: MGC192.168.203.152@tcp: Connection to MGS (at 192.168.203.152@tcp) was lost; in progress operations using this service will fail Feb 27 12:26:04 oleg352-client kernel: Lustre: Evicted from MGS (at 192.168.203.152@tcp) after server handle changed from 0xb0e2427ff6d01fd to 0xb0e2427ff6d094a Feb 27 12:26:05 oleg352-client sshd[29781]: Accepted publickey for root from 192.168.203.52 port 42678 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:26:05 oleg352-client systemd-logind: New session 146 of user root. Feb 27 12:26:05 oleg352-client systemd: Started Session 146 of user root. Feb 27 12:26:05 oleg352-client sshd[29781]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:26:05 oleg352-client sshd[29781]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:26:05 oleg352-client sshd[29781]: Received disconnect from 192.168.203.52 port 42678:11: disconnected by user Feb 27 12:26:05 oleg352-client sshd[29781]: Disconnected from 192.168.203.52 port 42678 Feb 27 12:26:05 oleg352-client sshd[29781]: pam_unix(sshd:session): session closed for user root Feb 27 12:26:05 oleg352-client systemd-logind: Removed session 146. Feb 27 12:26:06 oleg352-client sshd[30022]: Accepted publickey for root from 192.168.203.52 port 42682 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:26:06 oleg352-client systemd-logind: New session 147 of user root. Feb 27 12:26:06 oleg352-client sshd[30022]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:26:06 oleg352-client systemd: Started Session 147 of user root. Feb 27 12:26:06 oleg352-client sshd[30022]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:26:07 oleg352-client kernel: Lustre: DEBUG MARKER: oleg352-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid Feb 27 12:26:07 oleg352-client sshd[30022]: Received disconnect from 192.168.203.52 port 42682:11: disconnected by user Feb 27 12:26:07 oleg352-client sshd[30022]: Disconnected from 192.168.203.52 port 42682 Feb 27 12:26:07 oleg352-client sshd[30022]: pam_unix(sshd:session): session closed for user root Feb 27 12:26:07 oleg352-client systemd-logind: Removed session 147. Feb 27 12:26:07 oleg352-client sshd[30190]: Accepted publickey for root from 192.168.203.52 port 42684 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:26:07 oleg352-client systemd: Started Session 148 of user root. Feb 27 12:26:07 oleg352-client systemd-logind: New session 148 of user root. Feb 27 12:26:07 oleg352-client sshd[30190]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:26:07 oleg352-client sshd[30190]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:26:08 oleg352-client kernel: Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Feb 27 12:26:08 oleg352-client sshd[30190]: Received disconnect from 192.168.203.52 port 42684:11: disconnected by user Feb 27 12:26:08 oleg352-client sshd[30190]: Disconnected from 192.168.203.52 port 42684 Feb 27 12:26:08 oleg352-client sshd[30190]: pam_unix(sshd:session): session closed for user root Feb 27 12:26:08 oleg352-client systemd-logind: Removed session 148. Feb 27 12:26:09 oleg352-client sshd[30260]: Accepted publickey for root from 192.168.203.52 port 42688 ssh2: RSA SHA256:FFZvFiaDhMvadvf0h6nTF/EV7gsGQZ3oCETk+6eowzU Feb 27 12:26:09 oleg352-client systemd-logind: New session 149 of user root. Feb 27 12:26:09 oleg352-client systemd: Started Session 149 of user root. Feb 27 12:26:09 oleg352-client sshd[30260]: pam_unix(sshd:session): session opened for user root by (uid=0) Feb 27 12:26:09 oleg352-client sshd[30260]: pam_lastlog(sshd:session): unable to open /var/log/lastlog: No such file or directory Feb 27 12:26:09 oleg352-client sshd[30260]: Received disconnect from 192.168.203.52 port 42688:11: disconnected by user Feb 27 12:26:09 oleg352-client sshd[30260]: Disconnected from 192.168.203.52 port 42688 Feb 27 12:26:09 oleg352-client sshd[30260]: pam_unix(sshd:session): session closed for user root Feb 27 12:26:09 oleg352-client systemd-logind: Removed session 149. Feb 27 12:26:09 oleg352-client kernel: Lustre: Unmounted lustre-client Feb 27 12:26:24 oleg352-client kernel: Key type lgssc unregistered Feb 27 12:26:24 oleg352-client kernel: LNet: 30757:0:(lib-ptl.c:956:lnet_clear_lazy_portal()) Active lazy portal 0 on exit Feb 27 12:26:25 oleg352-client kernel: LNet: Removed LNI 192.168.203.52@tcp Feb 27 12:26:25 oleg352-client systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Feb 27 12:26:29 oleg352-client sshd[1091]: Received disconnect from 192.168.200.253 port 39476:11: disconnected by user Feb 27 12:26:29 oleg352-client sshd[1091]: Disconnected from 192.168.200.253 port 39476 Feb 27 12:26:29 oleg352-client sshd[1091]: pam_unix(sshd:session): session closed for user root Feb 27 12:26:29 oleg352-client systemd-logind: Removed session 2. Feb 27 12:26:29 oleg352-client systemd: Removed slice User Slice of root.